-- Logs begin at Thu 2022-05-26 17:18:57 UTC, end at Thu 2022-05-26 18:41:46 UTC. -- May 26 18:06:33.985203 dv-cinder-843493-1-smb systemd[1]: Starting Devstack devstack@keystone.service... May 26 18:06:33.992689 dv-cinder-843493-1-smb devstack@keystone.service[80225]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini May 26 18:06:33.995421 dv-cinder-843493-1-smb devstack@keystone.service[80225]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu May 26 18:06:33 2022] *** May 26 18:06:33.995421 dv-cinder-843493-1-smb devstack@keystone.service[80225]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 May 26 18:06:33.995421 dv-cinder-843493-1-smb devstack@keystone.service[80225]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 May 26 18:06:33.995421 dv-cinder-843493-1-smb devstack@keystone.service[80225]: nodename: dv-cinder-843493-1-smb May 26 18:06:33.995421 dv-cinder-843493-1-smb devstack@keystone.service[80225]: machine: x86_64 May 26 18:06:33.995421 dv-cinder-843493-1-smb devstack@keystone.service[80225]: clock source: unix May 26 18:06:33.995421 dv-cinder-843493-1-smb devstack@keystone.service[80225]: pcre jit disabled May 26 18:06:33.995421 dv-cinder-843493-1-smb devstack@keystone.service[80225]: detected number of CPU cores: 4 May 26 18:06:33.995421 dv-cinder-843493-1-smb devstack@keystone.service[80225]: current working directory: / May 26 18:06:33.995421 dv-cinder-843493-1-smb devstack@keystone.service[80225]: detected binary path: /usr/bin/uwsgi-core May 26 18:06:33.995421 dv-cinder-843493-1-smb devstack@keystone.service[80225]: your processes number limit is 47680 May 26 18:06:33.995421 dv-cinder-843493-1-smb devstack@keystone.service[80225]: your memory page size is 4096 bytes May 26 18:06:33.995421 dv-cinder-843493-1-smb devstack@keystone.service[80225]: detected max file descriptor number: 2048 May 26 18:06:33.995421 dv-cinder-843493-1-smb devstack@keystone.service[80225]: lock engine: pthread robust mutexes May 26 18:06:33.996193 dv-cinder-843493-1-smb devstack@keystone.service[80225]: thunder lock: enabled May 26 18:06:33.996193 dv-cinder-843493-1-smb devstack@keystone.service[80225]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 May 26 18:06:33.996193 dv-cinder-843493-1-smb devstack@keystone.service[80225]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] May 26 18:06:34.039457 dv-cinder-843493-1-smb devstack@keystone.service[80225]: Python main interpreter initialized at 0x5631f293c9c0 May 26 18:06:34.039457 dv-cinder-843493-1-smb devstack@keystone.service[80225]: python threads support enabled May 26 18:06:34.039457 dv-cinder-843493-1-smb devstack@keystone.service[80225]: your server socket listen backlog is limited to 100 connections May 26 18:06:34.039457 dv-cinder-843493-1-smb devstack@keystone.service[80225]: your mercy for graceful operations on workers is 90 seconds May 26 18:06:34.039761 dv-cinder-843493-1-smb devstack@keystone.service[80225]: mapped 403077 bytes (393 KB) for 2 cores May 26 18:06:34.039864 dv-cinder-843493-1-smb devstack@keystone.service[80225]: *** Operational MODE: preforking *** May 26 18:06:34.040135 dv-cinder-843493-1-smb devstack@keystone.service[80225]: *** uWSGI is running in multiple interpreter mode *** May 26 18:06:34.040135 dv-cinder-843493-1-smb devstack@keystone.service[80225]: spawned uWSGI master process (pid: 80225) May 26 18:06:34.040336 dv-cinder-843493-1-smb systemd[1]: Started Devstack devstack@keystone.service. May 26 18:06:34.045058 dv-cinder-843493-1-smb devstack@keystone.service[80225]: spawned uWSGI worker 1 (pid: 80230, cores: 1) May 26 18:06:34.045058 dv-cinder-843493-1-smb devstack@keystone.service[80225]: spawned uWSGI worker 2 (pid: 80231, cores: 1) May 26 18:06:34.045058 dv-cinder-843493-1-smb devstack@keystone.service[80225]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... May 26 18:06:39.693799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:06:39.693799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: from cryptography.utils import int_from_bytes May 26 18:06:39.694587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:06:39.694587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: from cryptography.utils import int_from_bytes May 26 18:06:39.725224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:06:39.725224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: from cryptography.utils import int_from_bytes May 26 18:06:39.725705 dv-cinder-843493-1-smb devstack@keystone.service[80231]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead May 26 18:06:39.725705 dv-cinder-843493-1-smb devstack@keystone.service[80231]: from cryptography.utils import int_from_bytes May 26 18:06:39.744017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 18:06:39.744215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 18:06:39.744408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] command line args: [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 18:06:39.744679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 18:06:39.744858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ================================================================================ {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 18:06:39.745146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] admin_token = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.745423 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] config_dir = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.745612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.745793 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] config_source = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.745974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] debug = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.746173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.747395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.747395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.747395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.747395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.747632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] list_limit = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.747632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] log_config_append = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.747746 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.747939 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] log_dir = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.748101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] log_file = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.748336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.748587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.748840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.749116 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.749299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.749478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.749724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.749971 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.750205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.750439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.750670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.750902 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.751151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.751397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.751675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.752158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.752343 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] publish_errors = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.752575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.752806 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.753007 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.753256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.753490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.753724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] standard_threads = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.753955 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.754197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.754374 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.754552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] use_journal = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.754728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] use_json = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.754904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] use_stderr = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.755079 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] use_syslog = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.755309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.755566 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.755805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.756066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.756307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.756558 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.756795 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.757079 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.757319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.757567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.757816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.758064 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.758299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.758543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.758778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.759025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.759271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.759506 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.759759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.760010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.760255 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.760490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.760742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.761537 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.761795 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.762044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.762275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.762505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.762736 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.762973 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.763221 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.763468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.763696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.763924 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.764170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.764417 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.764654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.764902 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.765164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.765400 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.765635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.765865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.766094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.766323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.766553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.766788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.767037 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.767267 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.767508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.767737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.767973 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.768208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.768454 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.768683 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.768916 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.769177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.769412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.769647 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.769880 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.770109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.770356 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.770591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.770826 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.771055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.771314 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.771549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.771782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.772019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.772252 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.772520 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.772718 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} May 26 18:06:39.772797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.772923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} May 26 18:06:39.773037 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.773145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] command line args: [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} May 26 18:06:39.773234 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.773424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} May 26 18:06:39.773507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.773605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ================================================================================ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} May 26 18:06:39.773688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.773863 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] admin_token = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.773950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.774123 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config_dir = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.774201 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.774313 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.774396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.774496 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] config_source = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.774583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.774678 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] debug = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.774816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.774899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.775050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.775139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.775286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.775363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] insecure_debug = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.775519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.775605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.775751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.775839 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.775985 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.776062 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.776162 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_config_append = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.776238 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.776343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.776469 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.776552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_dir = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.777236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.777330 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.777490 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.777574 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.777742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.777826 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.777975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.778057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.778210 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.778287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.778394 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.778471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.778571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.778653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.778816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.778905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.779061 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.779139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.779295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.779371 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.779522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.779608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.779752 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.779828 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.779983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.780059 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.780228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.780316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.780462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.780546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] notification_format = cadf {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.780716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.780792 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.780976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.781235 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.781313 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.64/identity {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.781419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] publish_errors = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.781493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] auth.external = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.781665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.781743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.781898 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.781974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.782078 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.782168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.782327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.782411 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] auth.password = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.782562 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.782643 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] auth.token = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.782798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] standard_threads = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.782879 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.783030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] strict_password_check = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.783176 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.783284 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.783388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.783483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_eventlog = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.783585 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.783681 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_journal = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.783776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.783875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_json = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.783970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_stderr = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.784064 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.784192 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] use_syslog = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.784268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.784391 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] watch_log_file = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} May 26 18:06:39.784462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] credential.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.784554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.784632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.784796 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.784882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.785084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.785196 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.785325 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.785421 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.785568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.785646 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.785803 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.785884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.786052 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.786137 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.786291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.786364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.786526 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.786609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.786776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.786855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.787025 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.787109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.787261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.787345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.787509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.787593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.787747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.787835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.787998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.788075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.788232 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.788314 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.788469 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.788555 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.788718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.788796 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.788968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.789059 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.789221 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.789309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.789466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.789543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.789699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.789775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.789953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.790110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.790184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.790254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.790426 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.790510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.790660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.790746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.790901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.790978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.791133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.791210 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.791370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.791468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.791614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.791691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.791849 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.791958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.792078 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.792164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.792337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.792417 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.792565 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.792642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.792800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.792877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.793073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.793157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.793325 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.793413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.793556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.793635 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.793786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.793865 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.794014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.794091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.794259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.794336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.794504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.794582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.794733 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.794816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.794958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.795047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.795189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.795269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.795440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.795518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.795673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.795756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.795910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.796020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.796142 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.796222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.796381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.796459 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.796619 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.796696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.796867 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.797125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.797216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.797363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.797442 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.797600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.797781 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.797860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.798059 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.798143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.798296 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.798375 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.798526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.798605 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.798776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.798855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.799014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.799096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.799250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.799336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.799483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.799569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.799723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.799865 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.799953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.800027 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.800177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.800256 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.800413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.800490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.800647 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.800725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.800888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.800966 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.801151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.801230 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.801389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.801469 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.801639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.801718 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.801875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.801951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.802104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.802182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.802336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.802414 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.802586 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.enabled = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.802663 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.802831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.802910 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.803070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.803146 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.803307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.803391 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.803537 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.803611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.803760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.803839 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.803997 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.804074 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.804243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.804322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.804470 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.804547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.804717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.804795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.804961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.805056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.805226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.805305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.805460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.805539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.805690 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.805773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.805924 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.806002 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.806158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.806235 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.806391 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.806469 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.806620 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.806697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.806850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.806928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.807080 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.807159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.807317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.807395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.807548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.807686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.807792 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.807871 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.808052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.808136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.808297 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.808375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.808532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.808611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.808767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.808846 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.809017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.809108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.809264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.809344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.809504 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.external = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.809581 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.809737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.mapped = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.809823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.809970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.810049 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.810223 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.810301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.810454 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.810540 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.password = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.810691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] auth.token = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.810768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.810923 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.811000 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.811157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.811242 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.811391 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.811474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.811625 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.811702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.811864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.811948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.812095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.812174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.812329 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.812412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.812566 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.812650 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.812810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.812914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.813083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.813198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.813334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.813425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.813574 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.813675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.813818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.813938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.814056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.814177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.814320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.814424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.814575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.814653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.814813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.814899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.815067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.815147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] role.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.815346 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] role.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.815423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.815577 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.815671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.815827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.815905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.816072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.816155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.816323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.816409 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.816559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.816636 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.816799 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.816877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.817069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.817167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.817319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.817398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.817548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.817625 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.817791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.817878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.818028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.818113 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.818275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.818353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.818511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.818596 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.818757 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.818835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.818991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.819153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.819240 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.819389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.819468 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.819640 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.819722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.819891 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.819977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.820139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.820218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.820389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.820468 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.820633 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.820720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.820862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.820940 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.821126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.821205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.821380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.821470 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.821609 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.821687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.821841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.821919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.822071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.822158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.822299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.822376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.822547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.822625 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.822794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.822880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.823032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.823110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.823268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.823346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.824030 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.824124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.824267 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.824406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.824528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.824608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.824777 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.824865 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.825064 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.825146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.825304 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.825408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.825536 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.825656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.825774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.825894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.826014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.826137 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.826255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.826379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.826505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.826625 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.826736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.826859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.826984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.827140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.827216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.827319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.827457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.827564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.827706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.827813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.827953 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.828031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.828184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.828263 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.828421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.828555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.828635 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.password = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.828816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.connection = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.828903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.829082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.829164 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.829332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.829423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.829569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.829648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.829803 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.829881 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.830038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.830123 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.830273 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.830352 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.830507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.830585 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.830736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.830821 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.830975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.831052 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.831210 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.831320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.831450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.831560 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.831684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.831801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.831931 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.832040 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.832164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.832273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.832404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.832514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.832633 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.832776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.832860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.833039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.833123 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.833280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80230) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 18:06:39.833358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.833526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.833773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.834017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.834248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.834485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.834722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.834961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.835289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.835541 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.835794 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.836044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.836295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.836545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.836777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.837051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.837294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.837532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.837770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.838007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.838253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.838503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.838742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.838999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] policy.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.839794 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.840042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.840282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.840521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.840762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.841034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.841282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.841516 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.841753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.841995 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.842248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.842499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.842737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.842987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.843237 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.843475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.843722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.843964 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.844203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.844440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.844688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.844918 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] role.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.845193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.845442 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.845693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.845942 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.846191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.846439 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.846688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.846938 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.847171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.847419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.847668 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.847919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.848164 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.848558 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.848795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.849082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.849338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.849588 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.849838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.850075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.850333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.850590 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.850828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.851061 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.851295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.851527 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.851782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.852038 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.852286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.852524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.853048 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.853282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.853520 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.853760 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.854014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.provider = fernet {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.854251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.854510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.854804 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.855048 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.855293 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.855539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.855787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] trust.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.856024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.856262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.856499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.856745 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.857017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.857246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.857492 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.857794 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.858058 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.858301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.858551 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.858790 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.859031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.859268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.859505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.859741 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.859977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.860221 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.860455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.860708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.860946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.861220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.861455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.861700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.861931 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.862171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.862408 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} May 26 18:06:39.862579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=80231) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} May 26 18:06:39.864389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:39.864624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:39.864853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:39.873889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:39.888183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:39.888416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:39.888646 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:39.898529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:39.902440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:39.902675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:39.916899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:39.917166 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:39.955488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:39.960428 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.006305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.006539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.007699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.007933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.071779 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.071960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.072047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.072193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.072294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.072417 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.072500 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.072632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.072713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.072847 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.072929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.073094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.096508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.096611 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.096740 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.096823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.096970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.097071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.097220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.097313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.097441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.097523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.097660 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.097742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.097877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.097967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.109509 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.109605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.122476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.122711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.122809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.122938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.123021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.123159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.123240 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.123376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.123459 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.123591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.123673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.123806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.123887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80230) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.124028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=80231) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} May 26 18:06:40.141682 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.141842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.141926 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 18:06:40.142056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 18:06:40.142221 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.142394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.142477 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 18:06:40.142600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} May 26 18:06:40.142678 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.142873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.142968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.143133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.143213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.143393 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.143473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.143649 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.154866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.155143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.155409 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.155687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.156347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.156629 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.156901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.157209 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.163882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.165392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `MethodViewType` (API Prefix: ) [/credentials, /credentials/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.167228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.167510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.167790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.168070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.168351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.168609 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.168734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `MethodViewType` (API Prefix: ) [/domains, /domains/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.168998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.169092 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.169278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.169379 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.169550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.169633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.169830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.169910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.170098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.170202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.170474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.170749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.171020 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.171293 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.171560 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.197174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.199337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.199457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.199734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.201099 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `MethodViewType` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.201377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.205060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.205343 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.205661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.206723 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `MethodViewType` (API Prefix: ) [/groups, /groups/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.207000 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.212975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.213278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.214725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `MethodViewType` (API Prefix: ) [/limits, /limits/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.215008 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.217821 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.218226 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.218512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.218795 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.219073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.219349 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.219553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `MethodViewType` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.219635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.219873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.219963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.220220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.220505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.220785 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.221084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.221358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.221629 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.239437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.239715 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.241154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.241435 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.244457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.246702 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.248699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.249009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.250419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.250714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.254101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.255811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `MethodViewType` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.257751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.259507 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `MethodViewType` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.261591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.261891 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.262185 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.262472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.262758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.263045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.263371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.263672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.263966 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.264251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.264537 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.264828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.282241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.282522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.282789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.283051 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.284015 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `MethodViewType` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.284299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.284564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.284825 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.291148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.293436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.293528 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.293711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.295207 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.295491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.296776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.297080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.297362 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.297648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.297921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.298773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `MethodViewType` (API Prefix: ) [/policies, /policies/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.298893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.299173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.299453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.299737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.312218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.312486 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.312772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.313075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.313358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.313632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.313914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.313996 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `MethodViewType` (API Prefix: ) [/projects, /projects/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.314191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.314471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.314755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.315034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.315307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.315588 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.332064 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.333842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `MethodViewType` (API Prefix: ) [/regions, /regions/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.335391 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.337164 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `MethodViewType` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.338750 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.340405 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.340544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.342105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.342191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.342387 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.342665 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.343814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `MethodViewType` (API Prefix: ) [/roles, /roles/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.344101 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.344392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.350140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.351760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.351907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.353836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `MethodViewType` (API Prefix: ) [/services, /services/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.355884 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.356178 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.356460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.356740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.357655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.357948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.358232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.358550 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.365961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.366248 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.366631 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.367752 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `MethodViewType` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.368037 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.368424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.375132 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80230) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.375410 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.375687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.375963 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.376233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.376504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.376793 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.376959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `MethodViewType` (API Prefix: ) [/users, /users/] {{(pid=80231) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} May 26 18:06:40.377093 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.377265 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.377368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.377543 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.377635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.377833 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.377914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.378104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.378240 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.378382 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.378499 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.378644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80230) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.378737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.378925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.379194 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.379472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.379739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.380011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.380274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.380539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=80231) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} May 26 18:06:40.418165 dv-cinder-843493-1-smb devstack@keystone.service[80230]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5631f293c9c0 pid: 80230 (default app) May 26 18:06:40.419885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5631f293c9c0 pid: 80231 (default app) May 26 18:06:40.421454 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfcf4f-d2c6-4992-8037-136f282ed0c5 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:40.421755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfcf4f-d2c6-4992-8037-136f282ed0c5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:40.422037 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6cfcf4f-d2c6-4992-8037-136f282ed0c5 None None] PATH_INFO: `/v3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:40.426540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1/1] 10.222.0.64 () {50 vars in 791 bytes} [Thu May 26 18:06:40 2022] GET /identity/v3/ => generated 255 bytes in 8 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:06:48.256159 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794fcd2-56ea-49fc-bfef-bd531d884526 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:48.256702 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794fcd2-56ea-49fc-bfef-bd531d884526 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:48.256802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6794fcd2-56ea-49fc-bfef-bd531d884526 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:48.261765 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1/2] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:06:48 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:06:48.266703 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd3c2-9ce4-45e3-bbfc-2f181cc90b24 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:48.267077 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd3c2-9ce4-45e3-bbfc-2f181cc90b24 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:48.267251 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-013cd3c2-9ce4-45e3-bbfc-2f181cc90b24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:48.334145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: INFO dbcounter [None req-013cd3c2-9ce4-45e3-bbfc-2f181cc90b24 None None] Registered counter for database keystone May 26 18:06:48.354939 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG oslo_db.sqlalchemy.engines [None req-013cd3c2-9ce4-45e3-bbfc-2f181cc90b24 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80230) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:06:48.361052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writer thread running {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:06:48.537317 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG passlib.handlers.bcrypt [None req-013cd3c2-9ce4-45e3-bbfc-2f181cc90b24 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80230) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 18:06:48.537663 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG passlib.handlers.bcrypt [None req-013cd3c2-9ce4-45e3-bbfc-2f181cc90b24 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80230) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 18:06:48.592788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-013cd3c2-9ce4-45e3-bbfc-2f181cc90b24 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:48.594451 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-013cd3c2-9ce4-45e3-bbfc-2f181cc90b24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:48.716381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 2/3] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:06:48 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 451 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 18:06:48.884049 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794fcd2-56ea-49fc-bfef-bd531d884526 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:48.951983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: INFO dbcounter [None req-6794fcd2-56ea-49fc-bfef-bd531d884526 None None] Registered counter for database keystone May 26 18:06:48.971627 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG oslo_db.sqlalchemy.engines [None req-6794fcd2-56ea-49fc-bfef-bd531d884526 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=80231) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} May 26 18:06:48.977972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writer thread running {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} May 26 18:06:49.097478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6794fcd2-56ea-49fc-bfef-bd531d884526 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:49.101728 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-146b4a2b-00b9-4359-90f8-47212f37ff9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:49.102645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b4a2b-00b9-4359-90f8-47212f37ff9a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:49.102933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b4a2b-00b9-4359-90f8-47212f37ff9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:49.103216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-146b4a2b-00b9-4359-90f8-47212f37ff9a admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:49.111858 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b4a2b-00b9-4359-90f8-47212f37ff9a admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:49.162429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: WARNING keystone.common.rbac_enforcer.enforcer [None req-146b4a2b-00b9-4359-90f8-47212f37ff9a admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 18:06:49.162780 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-146b4a2b-00b9-4359-90f8-47212f37ff9a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:49.174228 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 2/4] 10.222.0.64 () {58 vars in 1324 bytes} [Thu May 26 18:06:48 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 291 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:06:49.180226 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cd3c2-9ce4-45e3-bbfc-2f181cc90b24 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:49.194467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-013cd3c2-9ce4-45e3-bbfc-2f181cc90b24 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:49.198781 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d32b0f36-e1ed-4d26-a3da-15d2ff0b7592 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:49.199897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b0f36-e1ed-4d26-a3da-15d2ff0b7592 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:49.200178 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b0f36-e1ed-4d26-a3da-15d2ff0b7592 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:49.200457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d32b0f36-e1ed-4d26-a3da-15d2ff0b7592 admin admin] PATH_INFO: `/v3/projects/04b116e5fb9e430e9155c1db8872f881` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:49.202030 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b0f36-e1ed-4d26-a3da-15d2ff0b7592 admin admin] RBAC: Authorizing `identity:get_project(project_id=04b116e5fb9e430e9155c1db8872f881)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:49.360913 dv-cinder-843493-1-smb devstack@keystone.service[80230]: WARNING keystone.common.rbac_enforcer.enforcer [None req-d32b0f36-e1ed-4d26-a3da-15d2ff0b7592 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. May 26 18:06:49.361591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d32b0f36-e1ed-4d26-a3da-15d2ff0b7592 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:49.365930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 3/5] 10.222.0.64 () {56 vars in 1207 bytes} [Thu May 26 18:06:49 2022] GET /identity/v3/projects/04b116e5fb9e430e9155c1db8872f881 => generated 344 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:06:51.518246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216ccd-04ac-4b13-b7ce-3487f71f0958 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:51.518730 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216ccd-04ac-4b13-b7ce-3487f71f0958 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:51.518730 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb216ccd-04ac-4b13-b7ce-3487f71f0958 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:51.522820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 3/6] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:06:51 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:06:51.528076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ddbc4-a0c0-4aa9-8df7-41787ed98f0b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:51.528486 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ddbc4-a0c0-4aa9-8df7-41787ed98f0b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:51.528631 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7ddbc4-a0c0-4aa9-8df7-41787ed98f0b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:51.547401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8f7ddbc4-a0c0-4aa9-8df7-41787ed98f0b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:51.548897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8f7ddbc4-a0c0-4aa9-8df7-41787ed98f0b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:51.556496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 4/7] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:06:51 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) May 26 18:06:51.578394 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb216ccd-04ac-4b13-b7ce-3487f71f0958 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:51.591023 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb216ccd-04ac-4b13-b7ce-3487f71f0958 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:51.595266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef566ad-63c7-4066-8011-0d1a4b01f514 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:51.595911 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef566ad-63c7-4066-8011-0d1a4b01f514 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:51.596194 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef566ad-63c7-4066-8011-0d1a4b01f514 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:51.596470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef566ad-63c7-4066-8011-0d1a4b01f514 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:51.604974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef566ad-63c7-4066-8011-0d1a4b01f514 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:51.606742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef566ad-63c7-4066-8011-0d1a4b01f514 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:51.615384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 4/8] 10.222.0.64 () {58 vars in 1324 bytes} [Thu May 26 18:06:51 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:06:51.621823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ddbc4-a0c0-4aa9-8df7-41787ed98f0b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:51.630758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7ddbc4-a0c0-4aa9-8df7-41787ed98f0b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:51.635186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91c22fa3-e61d-496a-a5b4-ae6cca40af97 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:51.636043 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c22fa3-e61d-496a-a5b4-ae6cca40af97 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:51.636326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c22fa3-e61d-496a-a5b4-ae6cca40af97 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:51.636602 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91c22fa3-e61d-496a-a5b4-ae6cca40af97 admin admin] PATH_INFO: `/v3/users/99d73c7eb544437daee425e1da4f8bea` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:51.638007 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c22fa3-e61d-496a-a5b4-ae6cca40af97 admin admin] RBAC: Authorizing `identity:get_user(user_id=99d73c7eb544437daee425e1da4f8bea)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:51.639817 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91c22fa3-e61d-496a-a5b4-ae6cca40af97 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:51.641400 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 5/9] 10.222.0.64 () {56 vars in 1198 bytes} [Thu May 26 18:06:51 2022] GET /identity/v3/users/99d73c7eb544437daee425e1da4f8bea => generated 247 bytes in 20 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:06:53.920603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138bb36-fb19-4698-9b83-7ae467f249c9 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:53.921161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138bb36-fb19-4698-9b83-7ae467f249c9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:53.921244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8138bb36-fb19-4698-9b83-7ae467f249c9 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:53.922624 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 5/10] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:06:53.927776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6f70-e129-43b0-8c45-dba24dd2edf3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:53.928196 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6f70-e129-43b0-8c45-dba24dd2edf3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:53.928334 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9d6f70-e129-43b0-8c45-dba24dd2edf3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:53.932324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69284fff-3c96-49af-a871-bdafb78bf928 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:53.932616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69284fff-3c96-49af-a871-bdafb78bf928 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:53.932897 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69284fff-3c96-49af-a871-bdafb78bf928 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:53.934193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 6/11] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:06:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:06:53.939175 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aacadf-feeb-4c0f-9706-b199eef3cfde None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:53.939464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aacadf-feeb-4c0f-9706-b199eef3cfde None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:53.939749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12aacadf-feeb-4c0f-9706-b199eef3cfde None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:53.945503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-1e9d6f70-e129-43b0-8c45-dba24dd2edf3 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:53.946747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1e9d6f70-e129-43b0-8c45-dba24dd2edf3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:53.979514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG passlib.handlers.bcrypt [None req-12aacadf-feeb-4c0f-9706-b199eef3cfde None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=80231) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} May 26 18:06:53.979952 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG passlib.handlers.bcrypt [None req-12aacadf-feeb-4c0f-9706-b199eef3cfde None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=80231) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} May 26 18:06:54.027193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-12aacadf-feeb-4c0f-9706-b199eef3cfde None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:54.028822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-12aacadf-feeb-4c0f-9706-b199eef3cfde None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:54.029139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 6/12] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:06:54.050460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d6f70-e129-43b0-8c45-dba24dd2edf3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:54.074380 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:54.128498 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 7/13] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:06:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:06:54.151627 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aacadf-feeb-4c0f-9706-b199eef3cfde None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:54.158105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e9d6f70-e129-43b0-8c45-dba24dd2edf3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:54.190645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c4b27-0fb3-46bc-be8b-ae1d60e7e29c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:54.191228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c4b27-0fb3-46bc-be8b-ae1d60e7e29c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:54.191508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c4b27-0fb3-46bc-be8b-ae1d60e7e29c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:54.191788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed5c4b27-0fb3-46bc-be8b-ae1d60e7e29c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:54.252308 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12aacadf-feeb-4c0f-9706-b199eef3cfde None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:54.254607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:54.257316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c4b27-0fb3-46bc-be8b-ae1d60e7e29c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:54.258828 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed5c4b27-0fb3-46bc-be8b-ae1d60e7e29c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:54.281674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:54.288833 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fbe38-3ece-47f4-bfe3-0a4d316d7704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:54.289882 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fbe38-3ece-47f4-bfe3-0a4d316d7704 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:54.290169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fbe38-3ece-47f4-bfe3-0a4d316d7704 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:54.290447 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed0fbe38-3ece-47f4-bfe3-0a4d316d7704 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:54.302317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed0fbe38-3ece-47f4-bfe3-0a4d316d7704 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ed0fbe38-3ece-47f4-bfe3-0a4d316d7704 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:06:54.314047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:06:54.315103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:06:54.316111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:06:54.316111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:06:54.316111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:06:54.316111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:06:54.316111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:06:54.316111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:06:54.316111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:06:54.316111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:06:54.316111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:06:54.316111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:06:54.316111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:06:54.316111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:06:54.316111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 8/14] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:06:54 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:06:54.320830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fbe38-3ece-47f4-bfe3-0a4d316d7704 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:54.358918 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 7/15] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:06:54 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 18:06:54.364231 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c4b27-0fb3-46bc-be8b-ae1d60e7e29c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:54.418710 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed0fbe38-3ece-47f4-bfe3-0a4d316d7704 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:54.451680 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c13460-2975-4270-8213-507c07d9870d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:54.452266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c13460-2975-4270-8213-507c07d9870d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:54.452548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c13460-2975-4270-8213-507c07d9870d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:54.452818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09c13460-2975-4270-8213-507c07d9870d None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:54.453592 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c13460-2975-4270-8213-507c07d9870d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:06:54.453896 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c13460-2975-4270-8213-507c07d9870d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:54.455321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09c13460-2975-4270-8213-507c07d9870d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:54.459478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed5c4b27-0fb3-46bc-be8b-ae1d60e7e29c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:54.466719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 9/16] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:06:54 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:06:54.472015 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c13460-2975-4270-8213-507c07d9870d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:54.482380 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:54.494926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b13d82-8918-498d-bde7-3669ece1afa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:54.495707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b13d82-8918-498d-bde7-3669ece1afa2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:54.495983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b13d82-8918-498d-bde7-3669ece1afa2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:54.496252 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b13d82-8918-498d-bde7-3669ece1afa2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:54.499661 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:54.506076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b13d82-8918-498d-bde7-3669ece1afa2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:54.507532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05b13d82-8918-498d-bde7-3669ece1afa2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-05b13d82-8918-498d-bde7-3669ece1afa2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:06:54.527557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:06:54.528383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:06:54.529188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:06:54.529188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:06:54.529188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:06:54.529188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:06:54.529188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 8/17] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:06:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:06:54.534393 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b13d82-8918-498d-bde7-3669ece1afa2 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:54.570566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09c13460-2975-4270-8213-507c07d9870d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:54.603725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b76ab-bbf2-44ff-ba89-4ecabef1d0f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:54.604599 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b76ab-bbf2-44ff-ba89-4ecabef1d0f6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:54.604877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b76ab-bbf2-44ff-ba89-4ecabef1d0f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:54.605178 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3b76ab-bbf2-44ff-ba89-4ecabef1d0f6 None admin] PATH_INFO: `/v3/users/99d73c7eb544437daee425e1da4f8bea` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:54.606708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b76ab-bbf2-44ff-ba89-4ecabef1d0f6 None admin] RBAC: Authorizing `identity:get_user(user_id=99d73c7eb544437daee425e1da4f8bea)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:54.608159 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc3b76ab-bbf2-44ff-ba89-4ecabef1d0f6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:54.609785 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 10/18] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:06:54 2022] GET /identity/v3/users/99d73c7eb544437daee425e1da4f8bea => generated 247 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:06:54.615014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b76ab-bbf2-44ff-ba89-4ecabef1d0f6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:54.633552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b13d82-8918-498d-bde7-3669ece1afa2 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:54.666622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c14d09-3823-475e-9706-add9758125d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:54.667275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c14d09-3823-475e-9706-add9758125d3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:54.667553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c14d09-3823-475e-9706-add9758125d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:54.667825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c14d09-3823-475e-9706-add9758125d3 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:54.668534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c14d09-3823-475e-9706-add9758125d3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:06:54.668838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c14d09-3823-475e-9706-add9758125d3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:54.670244 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85c14d09-3823-475e-9706-add9758125d3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:54.687616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 9/19] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:06:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:06:54.707377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:54.715795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3b76ab-bbf2-44ff-ba89-4ecabef1d0f6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:54.751350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1226237-691c-4fd9-bcc9-562310815c6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:54.752168 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1226237-691c-4fd9-bcc9-562310815c6b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:54.752453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1226237-691c-4fd9-bcc9-562310815c6b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:54.752728 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1226237-691c-4fd9-bcc9-562310815c6b None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:54.754033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1226237-691c-4fd9-bcc9-562310815c6b None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:54.755508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1226237-691c-4fd9-bcc9-562310815c6b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:54.757204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 11/20] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:06:54 2022] GET /identity/v3/domains/default => generated 199 bytes in 142 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:06:54.763788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c14d09-3823-475e-9706-add9758125d3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:54.800389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:54.871748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c14d09-3823-475e-9706-add9758125d3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:54.906348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b626f466-43d7-41ee-9997-112b8a2ef0f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:54.907010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626f466-43d7-41ee-9997-112b8a2ef0f0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:54.907298 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626f466-43d7-41ee-9997-112b8a2ef0f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:54.907578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b626f466-43d7-41ee-9997-112b8a2ef0f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:54.908406 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626f466-43d7-41ee-9997-112b8a2ef0f0 None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.domain.id=default, user.id=99d73c7eb544437daee425e1da4f8bea) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:06:54.908720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626f466-43d7-41ee-9997-112b8a2ef0f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:54.910214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b626f466-43d7-41ee-9997-112b8a2ef0f0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:54.917027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 10/21] 10.222.0.64 () {56 vars in 1322 bytes} [Thu May 26 18:06:54 2022] GET /identity/v3/role_assignments?user.id=99d73c7eb544437daee425e1da4f8bea&scope.domain.id=default&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 233 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:06:57.201517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56e4a5-c752-41ed-bf85-b2321330d178 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:57.202040 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56e4a5-c752-41ed-bf85-b2321330d178 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:57.202115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e56e4a5-c752-41ed-bf85-b2321330d178 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:57.203465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 12/22] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:06:57.208774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3b6e8-cb6d-4c14-b2de-18b449dfe084 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:57.209592 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3b6e8-cb6d-4c14-b2de-18b449dfe084 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:57.210098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06b3b6e8-cb6d-4c14-b2de-18b449dfe084 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:57.235825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-06b3b6e8-cb6d-4c14-b2de-18b449dfe084 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:57.237377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-06b3b6e8-cb6d-4c14-b2de-18b449dfe084 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:57.327005 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 11/23] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:06:57.362513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56e4a5-c752-41ed-bf85-b2321330d178 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:57.502194 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e56e4a5-c752-41ed-bf85-b2321330d178 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:57.553342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a8d480a-e61b-4121-aefa-a302bced8d43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:57.554541 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d480a-e61b-4121-aefa-a302bced8d43 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:57.555023 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d480a-e61b-4121-aefa-a302bced8d43 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:57.555517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a8d480a-e61b-4121-aefa-a302bced8d43 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:57.707581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d480a-e61b-4121-aefa-a302bced8d43 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:57.709426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a8d480a-e61b-4121-aefa-a302bced8d43 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:57.726212 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95545f-d4de-4dde-a46f-e3439728b5bb None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:57.727181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95545f-d4de-4dde-a46f-e3439728b5bb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:57.727666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa95545f-d4de-4dde-a46f-e3439728b5bb None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:57.729314 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 12/24] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:06:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7a8d480a-e61b-4121-aefa-a302bced8d43 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:06:57.731591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:06:57.732342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:06:57.733547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:06:57.733547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:06:57.733547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:06:57.733547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:06:57.733547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 13/25] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:06:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 371 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:06:57.738390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95545f-d4de-4dde-a46f-e3439728b5bb None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:57.739206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002005be-6198-448b-9b56-b14754a4411b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:57.739496 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002005be-6198-448b-9b56-b14754a4411b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:57.739776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002005be-6198-448b-9b56-b14754a4411b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:57.763757 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-002005be-6198-448b-9b56-b14754a4411b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:57.764870 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-002005be-6198-448b-9b56-b14754a4411b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:57.782513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:57.808536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:57.887167 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa95545f-d4de-4dde-a46f-e3439728b5bb None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:57.894755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 14/26] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:06:57.896122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b8304-8bed-4e48-9236-e78a062d67cd None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:57.896414 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b8304-8bed-4e48-9236-e78a062d67cd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:57.896830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3b8304-8bed-4e48-9236-e78a062d67cd None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:57.898474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 15/27] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:06:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:06:57.905509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9285f-5e92-4349-a8ed-d683d5aaceb2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:57.905800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9285f-5e92-4349-a8ed-d683d5aaceb2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:57.906188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e9285f-5e92-4349-a8ed-d683d5aaceb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:57.940040 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d385d4-003a-40ec-bd05-3f56e2fd3d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:57.940733 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d385d4-003a-40ec-bd05-3f56e2fd3d53 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:57.941035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d385d4-003a-40ec-bd05-3f56e2fd3d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:57.941316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d385d4-003a-40ec-bd05-3f56e2fd3d53 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:57.942066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d385d4-003a-40ec-bd05-3f56e2fd3d53 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:06:57.942376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d385d4-003a-40ec-bd05-3f56e2fd3d53 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:57.943844 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d385d4-003a-40ec-bd05-3f56e2fd3d53 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:57.958594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-20e9285f-5e92-4349-a8ed-d683d5aaceb2 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:57.959810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-20e9285f-5e92-4349-a8ed-d683d5aaceb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:57.978594 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 13/28] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:06:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:06:57.979515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d385d4-003a-40ec-bd05-3f56e2fd3d53 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:58.083253 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d385d4-003a-40ec-bd05-3f56e2fd3d53 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:58.092872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:58.131712 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 16/29] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:06:57 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 227 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:06:58.138107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9285f-5e92-4349-a8ed-d683d5aaceb2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:58.147637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e2bbc76-943c-4c62-bd49-5b71bf0a986c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:58.148192 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bbc76-943c-4c62-bd49-5b71bf0a986c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:58.148476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bbc76-943c-4c62-bd49-5b71bf0a986c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:58.148745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e2bbc76-943c-4c62-bd49-5b71bf0a986c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:58.180629 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e2bbc76-943c-4c62-bd49-5b71bf0a986c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-2e2bbc76-943c-4c62-bd49-5b71bf0a986c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:06:58.192543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:06:58.193667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:06:58.194398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:06:58.194398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:06:58.194398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:06:58.194398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:06:58.194398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:06:58.194398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:06:58.194398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:06:58.194398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:06:58.194398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:06:58.194398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:06:58.194398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:06:58.194398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:06:58.194398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 14/30] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:06:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:06:58.195395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab4ea1-b477-4761-af86-c64fb2ef7ffb None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:58.195483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab4ea1-b477-4761-af86-c64fb2ef7ffb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:58.195718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ab4ea1-b477-4761-af86-c64fb2ef7ffb None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:58.197023 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 15/31] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:06:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:06:58.197706 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab4ea1-b477-4761-af86-c64fb2ef7ffb None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:58.252235 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:58.282067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e9285f-5e92-4349-a8ed-d683d5aaceb2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:58.308100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ab4ea1-b477-4761-af86-c64fb2ef7ffb None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:58.322924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4830fee6-6c64-4961-b574-e50c8dea8cf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:58.323955 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830fee6-6c64-4961-b574-e50c8dea8cf8 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:58.324471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830fee6-6c64-4961-b574-e50c8dea8cf8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:58.324951 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4830fee6-6c64-4961-b574-e50c8dea8cf8 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:58.326002 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830fee6-6c64-4961-b574-e50c8dea8cf8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:58.327762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4830fee6-6c64-4961-b574-e50c8dea8cf8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:58.346103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261cece-2f54-4b1c-b97e-541e8044a72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:58.346864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261cece-2f54-4b1c-b97e-541e8044a72b None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:58.347148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261cece-2f54-4b1c-b97e-541e8044a72b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:58.347423 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9261cece-2f54-4b1c-b97e-541e8044a72b None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:58.348306 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261cece-2f54-4b1c-b97e-541e8044a72b None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:58.349846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9261cece-2f54-4b1c-b97e-541e8044a72b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:58.476836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 16/32] 10.222.0.64 () {60 vars in 1131 bytes} [Thu May 26 18:06:58 2022] POST /identity/v3/roles => generated 225 bytes in 279 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:06:58.477455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 17/33] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 26 18:06:58 2022] POST /identity/v3/projects => generated 301 bytes in 345 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:06:58.479832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639b273-5580-4f98-bc39-e12bd5730db4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:58.480340 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639b273-5580-4f98-bc39-e12bd5730db4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:58.480854 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4639b273-5580-4f98-bc39-e12bd5730db4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:58.483871 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261cece-2f54-4b1c-b97e-541e8044a72b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:58.509408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:58.518850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4639b273-5580-4f98-bc39-e12bd5730db4 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:58.521016 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4639b273-5580-4f98-bc39-e12bd5730db4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:58.628581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 18/34] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:06:58.632963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b6003-6898-4581-b7b5-eefaaa57c6b8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:58.633282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b6003-6898-4581-b7b5-eefaaa57c6b8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:58.633567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-776b6003-6898-4581-b7b5-eefaaa57c6b8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:58.635017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 19/35] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:06:58 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:06:58.640782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab820d9-a88f-409b-95b1-7da2b511c83a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:58.641101 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab820d9-a88f-409b-95b1-7da2b511c83a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:58.641384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ab820d9-a88f-409b-95b1-7da2b511c83a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:58.682601 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6ab820d9-a88f-409b-95b1-7da2b511c83a None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:58.683966 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6ab820d9-a88f-409b-95b1-7da2b511c83a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:58.749493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9261cece-2f54-4b1c-b97e-541e8044a72b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:58.762770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:58.787883 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 20/36] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:06:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 148 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:06:58.788743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab820d9-a88f-409b-95b1-7da2b511c83a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:58.806059 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95036531-9cc3-4099-a936-1725eb8e70a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:58.806747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95036531-9cc3-4099-a936-1725eb8e70a6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:58.807036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95036531-9cc3-4099-a936-1725eb8e70a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:58.807316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95036531-9cc3-4099-a936-1725eb8e70a6 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:58.808193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95036531-9cc3-4099-a936-1725eb8e70a6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:06:58.808507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95036531-9cc3-4099-a936-1725eb8e70a6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:58.810185 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95036531-9cc3-4099-a936-1725eb8e70a6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:58.823951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 17/37] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:06:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 347 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:06:58.829509 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95036531-9cc3-4099-a936-1725eb8e70a6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:58.906264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:58.906851 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ab820d9-a88f-409b-95b1-7da2b511c83a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:58.943243 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95036531-9cc3-4099-a936-1725eb8e70a6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:58.946909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5668d1a-269f-4a90-afe8-22ec604676ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:58.947596 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5668d1a-269f-4a90-afe8-22ec604676ce None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:58.947888 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5668d1a-269f-4a90-afe8-22ec604676ce None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:58.948175 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5668d1a-269f-4a90-afe8-22ec604676ce None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:58.948933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5668d1a-269f-4a90-afe8-22ec604676ce None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:58.950941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5668d1a-269f-4a90-afe8-22ec604676ce None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:58.967848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 21/38] 10.222.0.64 () {60 vars in 1131 bytes} [Thu May 26 18:06:58 2022] POST /identity/v3/roles => generated 219 bytes in 179 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:06:58.969024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5668d1a-269f-4a90-afe8-22ec604676ce None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:58.989238 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a77cdf-bf03-4e42-8161-0bb2151640a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:58.990117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a77cdf-bf03-4e42-8161-0bb2151640a0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:58.990411 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a77cdf-bf03-4e42-8161-0bb2151640a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:58.990693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6a77cdf-bf03-4e42-8161-0bb2151640a0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:58.992185 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a77cdf-bf03-4e42-8161-0bb2151640a0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:58.993990 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6a77cdf-bf03-4e42-8161-0bb2151640a0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:58.995758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 18/39] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:06:58 2022] GET /identity/v3/domains/default => generated 199 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:06:59.001781 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a77cdf-bf03-4e42-8161-0bb2151640a0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:59.038239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:59.114675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5668d1a-269f-4a90-afe8-22ec604676ce None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:59.128140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6a77cdf-bf03-4e42-8161-0bb2151640a0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:59.153596 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74816a08-b42c-4bb1-83cc-45a073931d59 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:59.154491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816a08-b42c-4bb1-83cc-45a073931d59 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:59.154780 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816a08-b42c-4bb1-83cc-45a073931d59 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:59.155063 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74816a08-b42c-4bb1-83cc-45a073931d59 None admin] PATH_INFO: `/v3/users/99d73c7eb544437daee425e1da4f8bea` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:59.156377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74816a08-b42c-4bb1-83cc-45a073931d59 None admin] RBAC: Authorizing `identity:get_user(user_id=99d73c7eb544437daee425e1da4f8bea)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:59.157843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74816a08-b42c-4bb1-83cc-45a073931d59 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:59.159539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 22/40] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:06:58 2022] GET /identity/v3/users/99d73c7eb544437daee425e1da4f8bea => generated 247 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:06:59.160801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cde96-bd04-4e11-921e-16f5b4be753b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:59.161118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cde96-bd04-4e11-921e-16f5b4be753b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:59.161405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f3cde96-bd04-4e11-921e-16f5b4be753b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:59.162854 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 23/41] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:06:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:06:59.166232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cde96-bd04-4e11-921e-16f5b4be753b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:59.179693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19f3491-56ad-46e7-92c1-c3b1c5322a97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:59.179693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f3491-56ad-46e7-92c1-c3b1c5322a97 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:59.179693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f3491-56ad-46e7-92c1-c3b1c5322a97 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:59.179693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19f3491-56ad-46e7-92c1-c3b1c5322a97 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:59.180026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f3491-56ad-46e7-92c1-c3b1c5322a97 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:59.180206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19f3491-56ad-46e7-92c1-c3b1c5322a97 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:59.189960 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:59.213637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 19/42] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 26 18:06:59 2022] POST /identity/v3/projects => generated 312 bytes in 212 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:06:59.215035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0756f-4231-4d62-99dd-bf543fd0fa1d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:59.215338 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0756f-4231-4d62-99dd-bf543fd0fa1d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:59.215625 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18b0756f-4231-4d62-99dd-bf543fd0fa1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:59.238027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-18b0756f-4231-4d62-99dd-bf543fd0fa1d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:06:59.239612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-18b0756f-4231-4d62-99dd-bf543fd0fa1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:06:59.304919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f3cde96-bd04-4e11-921e-16f5b4be753b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:59.318925 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 20/43] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:06:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:06:59.321051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:59.342565 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0756f-4231-4d62-99dd-bf543fd0fa1d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:59.351881 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afec0d-dc96-411e-bac2-ebd44c119de0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:59.352775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afec0d-dc96-411e-bac2-ebd44c119de0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:59.353097 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afec0d-dc96-411e-bac2-ebd44c119de0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:59.353781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28afec0d-dc96-411e-bac2-ebd44c119de0 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:59.355393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afec0d-dc96-411e-bac2-ebd44c119de0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:59.357103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28afec0d-dc96-411e-bac2-ebd44c119de0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:59.358823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 24/44] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:06:59 2022] GET /identity/v3/domains/default => generated 199 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:06:59.364739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afec0d-dc96-411e-bac2-ebd44c119de0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:06:59.462154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18b0756f-4231-4d62-99dd-bf543fd0fa1d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:59.480780 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28afec0d-dc96-411e-bac2-ebd44c119de0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:06:59.488772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:06:59.507711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0028d837-4f55-4c4f-979f-fe5abbdcb218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:59.508386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028d837-4f55-4c4f-979f-fe5abbdcb218 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:59.508670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028d837-4f55-4c4f-979f-fe5abbdcb218 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:59.509693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0028d837-4f55-4c4f-979f-fe5abbdcb218 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:59.510366 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028d837-4f55-4c4f-979f-fe5abbdcb218 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:59.511746 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0028d837-4f55-4c4f-979f-fe5abbdcb218 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:59.517862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d98835e2-e8cc-4971-8d9a-73e88b234268 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:06:59.518834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98835e2-e8cc-4971-8d9a-73e88b234268 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:06:59.519041 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98835e2-e8cc-4971-8d9a-73e88b234268 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:06:59.519359 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d98835e2-e8cc-4971-8d9a-73e88b234268 None admin] PATH_INFO: `/v3/domains/default/users/99d73c7eb544437daee425e1da4f8bea/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:06:59.521422 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98835e2-e8cc-4971-8d9a-73e88b234268 None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=99d73c7eb544437daee425e1da4f8bea, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:06:59.522874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d98835e2-e8cc-4971-8d9a-73e88b234268 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:06:59.525740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 21/45] 10.222.0.64 () {60 vars in 1131 bytes} [Thu May 26 18:06:59 2022] POST /identity/v3/roles => generated 223 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:06:59.539958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 25/46] 10.222.0.64 () {58 vars in 1361 bytes} [Thu May 26 18:06:59 2022] PUT /identity/v3/domains/default/users/99d73c7eb544437daee425e1da4f8bea/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:07:01.473013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadee7e-f553-40bf-9d84-48ae0ae65451 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:01.473497 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadee7e-f553-40bf-9d84-48ae0ae65451 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:01.473497 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baadee7e-f553-40bf-9d84-48ae0ae65451 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:01.474869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 22/47] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:01.480473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8541808-abd7-4737-99ed-c1649cf2f89f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:01.480865 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8541808-abd7-4737-99ed-c1649cf2f89f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:01.481206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8541808-abd7-4737-99ed-c1649cf2f89f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:01.497934 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a8541808-abd7-4737-99ed-c1649cf2f89f None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:01.499140 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a8541808-abd7-4737-99ed-c1649cf2f89f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:01.534240 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:01.569359 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 26/48] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:01.593700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadee7e-f553-40bf-9d84-48ae0ae65451 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:01.695045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baadee7e-f553-40bf-9d84-48ae0ae65451 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:01.728136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090721af-0859-47ec-ae4a-731af62daad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:01.728865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090721af-0859-47ec-ae4a-731af62daad3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:01.729186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090721af-0859-47ec-ae4a-731af62daad3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:01.729470 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090721af-0859-47ec-ae4a-731af62daad3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:01.730654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090721af-0859-47ec-ae4a-731af62daad3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:01.732129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090721af-0859-47ec-ae4a-731af62daad3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:01.733779 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 23/49] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:07:01 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:01.738669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e3c55-142c-41ce-aca6-e91472c26d10 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:01.738965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e3c55-142c-41ce-aca6-e91472c26d10 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:01.739213 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090721af-0859-47ec-ae4a-731af62daad3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:01.739318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-018e3c55-142c-41ce-aca6-e91472c26d10 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:01.740607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 27/50] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:01.745864 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753ede-9d92-4fa4-870a-e7aa73b84c98 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:01.746158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753ede-9d92-4fa4-870a-e7aa73b84c98 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:01.746441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16753ede-9d92-4fa4-870a-e7aa73b84c98 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:01.769812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-16753ede-9d92-4fa4-870a-e7aa73b84c98 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:01.771006 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-16753ede-9d92-4fa4-870a-e7aa73b84c98 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:01.787692 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:01.842122 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090721af-0859-47ec-ae4a-731af62daad3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:01.849011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 28/51] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:07:01.871898 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16753ede-9d92-4fa4-870a-e7aa73b84c98 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:01.875332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec289d47-b9cb-45dd-ae54-80cc95f274c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:01.876000 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec289d47-b9cb-45dd-ae54-80cc95f274c5 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:01.876290 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec289d47-b9cb-45dd-ae54-80cc95f274c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:01.876572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec289d47-b9cb-45dd-ae54-80cc95f274c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:01.877316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec289d47-b9cb-45dd-ae54-80cc95f274c5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:01.878784 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec289d47-b9cb-45dd-ae54-80cc95f274c5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:01.905373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 24/52] 10.222.0.64 () {60 vars in 1140 bytes} [Thu May 26 18:07:01 2022] POST /identity/v3/projects => generated 298 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:01.980204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16753ede-9d92-4fa4-870a-e7aa73b84c98 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:01.981765 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:02.016901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098d4a8-a307-4e69-b9c9-b93d789a6d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:02.017748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098d4a8-a307-4e69-b9c9-b93d789a6d47 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:02.018212 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098d4a8-a307-4e69-b9c9-b93d789a6d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:02.018319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9098d4a8-a307-4e69-b9c9-b93d789a6d47 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:02.029411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9098d4a8-a307-4e69-b9c9-b93d789a6d47 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9098d4a8-a307-4e69-b9c9-b93d789a6d47 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:02.037369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:02.038367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:02.039273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:02.039273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:02.039273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:02.039273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:02.039273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:02.039273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:02.039273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:02.039273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:02.039273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:02.039273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:02.039273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:02.039273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:02.039273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 29/53] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:07:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 167 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:07:02.045212 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec289d47-b9cb-45dd-ae54-80cc95f274c5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:02.147600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:02.151099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec289d47-b9cb-45dd-ae54-80cc95f274c5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:02.186571 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd606e-be14-477a-9ca0-f3d414128f47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:02.187249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd606e-be14-477a-9ca0-f3d414128f47 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:02.187537 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd606e-be14-477a-9ca0-f3d414128f47 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:02.187817 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbcd606e-be14-477a-9ca0-f3d414128f47 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:02.188569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd606e-be14-477a-9ca0-f3d414128f47 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:02.188881 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd606e-be14-477a-9ca0-f3d414128f47 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:02.190324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbcd606e-be14-477a-9ca0-f3d414128f47 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:02.198430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 25/54] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:02 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:02.204076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098d4a8-a307-4e69-b9c9-b93d789a6d47 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:02.301124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9098d4a8-a307-4e69-b9c9-b93d789a6d47 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:02.333625 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639212b4-5906-4998-98ce-c9e898332668 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:02.334493 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639212b4-5906-4998-98ce-c9e898332668 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:02.334774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639212b4-5906-4998-98ce-c9e898332668 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:02.335048 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-639212b4-5906-4998-98ce-c9e898332668 None admin] PATH_INFO: `/v3/users/99d73c7eb544437daee425e1da4f8bea` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:02.336212 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639212b4-5906-4998-98ce-c9e898332668 None admin] RBAC: Authorizing `identity:get_user(user_id=99d73c7eb544437daee425e1da4f8bea)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:02.337724 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-639212b4-5906-4998-98ce-c9e898332668 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:02.339511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 30/55] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:02 2022] GET /identity/v3/users/99d73c7eb544437daee425e1da4f8bea => generated 247 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:02.344790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd606e-be14-477a-9ca0-f3d414128f47 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:02.442828 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbcd606e-be14-477a-9ca0-f3d414128f47 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:02.475686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b96d96f-814c-4433-99bd-418e382880c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:02.476737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96d96f-814c-4433-99bd-418e382880c7 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:02.477044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96d96f-814c-4433-99bd-418e382880c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:02.477318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b96d96f-814c-4433-99bd-418e382880c7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:02.479030 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96d96f-814c-4433-99bd-418e382880c7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:02.480471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b96d96f-814c-4433-99bd-418e382880c7 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:02.482265 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 26/56] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:07:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:02.487871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639212b4-5906-4998-98ce-c9e898332668 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:02.517102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:02.583607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-639212b4-5906-4998-98ce-c9e898332668 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:02.616478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ec501dc-aee1-4270-9721-0625b4ac8dd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:02.617161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec501dc-aee1-4270-9721-0625b4ac8dd4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:02.617446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec501dc-aee1-4270-9721-0625b4ac8dd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:02.617722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ec501dc-aee1-4270-9721-0625b4ac8dd4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:02.618572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec501dc-aee1-4270-9721-0625b4ac8dd4 None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.domain.id=default, user.id=99d73c7eb544437daee425e1da4f8bea) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:02.618886 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec501dc-aee1-4270-9721-0625b4ac8dd4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:02.620323 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ec501dc-aee1-4270-9721-0625b4ac8dd4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:02.628191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 31/57] 10.222.0.64 () {56 vars in 1322 bytes} [Thu May 26 18:07:02 2022] GET /identity/v3/role_assignments?user.id=99d73c7eb544437daee425e1da4f8bea&scope.domain.id=default&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 530 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:04.105888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f14fd-7c1c-4496-b6ac-0224568e84d0 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:04.106407 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f14fd-7c1c-4496-b6ac-0224568e84d0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:04.106516 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243f14fd-7c1c-4496-b6ac-0224568e84d0 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:04.107815 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 27/58] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:04.113182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b934f-35fd-4f6e-8ba3-4d4b2cf83421 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:04.113551 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b934f-35fd-4f6e-8ba3-4d4b2cf83421 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:04.113813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e83b934f-35fd-4f6e-8ba3-4d4b2cf83421 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:04.130669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e83b934f-35fd-4f6e-8ba3-4d4b2cf83421 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:04.131841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e83b934f-35fd-4f6e-8ba3-4d4b2cf83421 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:04.195882 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 32/59] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:04.220100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f14fd-7c1c-4496-b6ac-0224568e84d0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:04.250831 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:04.318518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243f14fd-7c1c-4496-b6ac-0224568e84d0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:04.349782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1e3ca93-59a1-475a-93b2-4f3a0fe88680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:04.350563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3ca93-59a1-475a-93b2-4f3a0fe88680 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:04.351092 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3ca93-59a1-475a-93b2-4f3a0fe88680 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:04.351374 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1e3ca93-59a1-475a-93b2-4f3a0fe88680 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:04.353069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3ca93-59a1-475a-93b2-4f3a0fe88680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:04.354514 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1e3ca93-59a1-475a-93b2-4f3a0fe88680 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:04.356160 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 28/60] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:07:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:04.361346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b934f-35fd-4f6e-8ba3-4d4b2cf83421 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:04.385325 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:04.456801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e83b934f-35fd-4f6e-8ba3-4d4b2cf83421 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:04.489397 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7174ec3-6e25-4fe2-8f28-3c79134a45cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:04.490057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7174ec3-6e25-4fe2-8f28-3c79134a45cc None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:04.490343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7174ec3-6e25-4fe2-8f28-3c79134a45cc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:04.490622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7174ec3-6e25-4fe2-8f28-3c79134a45cc None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:04.491338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7174ec3-6e25-4fe2-8f28-3c79134a45cc None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:04.492762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7174ec3-6e25-4fe2-8f28-3c79134a45cc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:04.516512 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 33/61] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:07:04 2022] POST /identity/v3/users => generated 275 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:07.799654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf87eee-2d7b-430d-a67f-b2a397c86acb None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:07.800683 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf87eee-2d7b-430d-a67f-b2a397c86acb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:07.801230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abf87eee-2d7b-430d-a67f-b2a397c86acb None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:07.803062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 29/62] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:07 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:07.809697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ab487-b562-4f94-8da9-6307261d9f6e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:07.810657 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ab487-b562-4f94-8da9-6307261d9f6e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:07.811165 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb8ab487-b562-4f94-8da9-6307261d9f6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:07.838652 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-eb8ab487-b562-4f94-8da9-6307261d9f6e None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:07.840229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-eb8ab487-b562-4f94-8da9-6307261d9f6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:07.928712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242ba1-91a8-4a6b-827e-6fb2830d3803 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:07.929583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242ba1-91a8-4a6b-827e-6fb2830d3803 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:07.930655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da242ba1-91a8-4a6b-827e-6fb2830d3803 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:07.932490 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 34/63] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:07:07.932891 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 30/64] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:07.938675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca5e2b-06ee-45e7-be26-691cd00944ed None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:07.938977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca5e2b-06ee-45e7-be26-691cd00944ed None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:07.939258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7ca5e2b-06ee-45e7-be26-691cd00944ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:07.956665 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da242ba1-91a8-4a6b-827e-6fb2830d3803 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:07.961642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b7ca5e2b-06ee-45e7-be26-691cd00944ed None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:07.962826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b7ca5e2b-06ee-45e7-be26-691cd00944ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:07.972686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:08.064081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 35/65] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:08.065514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04935-c2cf-4d95-885c-9923bfc6d538 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.066056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04935-c2cf-4d95-885c-9923bfc6d538 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.066349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eb04935-c2cf-4d95-885c-9923bfc6d538 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.067650 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 36/66] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:08.077547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:08.079552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ab1f0-0c1c-4cdb-a705-6bce2694860f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.079850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ab1f0-0c1c-4cdb-a705-6bce2694860f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.080142 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1ab1f0-0c1c-4cdb-a705-6bce2694860f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.094148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da242ba1-91a8-4a6b-827e-6fb2830d3803 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:08.097713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3c1ab1f0-0c1c-4cdb-a705-6bce2694860f None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:08.098971 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3c1ab1f0-0c1c-4cdb-a705-6bce2694860f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:08.135127 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfa96d-3dad-4594-ba82-fff70b40f75c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:08.135949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfa96d-3dad-4594-ba82-fff70b40f75c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.136236 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfa96d-3dad-4594-ba82-fff70b40f75c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.136518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3edfa96d-3dad-4594-ba82-fff70b40f75c None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.148613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3edfa96d-3dad-4594-ba82-fff70b40f75c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-3edfa96d-3dad-4594-ba82-fff70b40f75c None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:08.160004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:08.160836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:08.161639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:08.161639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:08.161639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:08.161639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:08.161639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:08.161639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:08.161639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:08.161639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:08.161639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:08.161639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:08.161639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:08.161639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:08.161639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 31/67] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:07:07 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:08.162237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfa96d-3dad-4594-ba82-fff70b40f75c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:08.189103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 37/68] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:08.190333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ab1f0-0c1c-4cdb-a705-6bce2694860f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:08.289157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:08.304115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3edfa96d-3dad-4594-ba82-fff70b40f75c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:08.325431 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1ab1f0-0c1c-4cdb-a705-6bce2694860f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:08.342906 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6a824-7ae5-4fa3-9c5b-bd5d3d515f21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:08.344039 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6a824-7ae5-4fa3-9c5b-bd5d3d515f21 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.344545 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6a824-7ae5-4fa3-9c5b-bd5d3d515f21 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.345046 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c6a824-7ae5-4fa3-9c5b-bd5d3d515f21 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.356688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c6a824-7ae5-4fa3-9c5b-bd5d3d515f21 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:08.362019 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a74c1-b676-4570-8ac7-fdb042aaffbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:08.362703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a74c1-b676-4570-8ac7-fdb042aaffbc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.362991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a74c1-b676-4570-8ac7-fdb042aaffbc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.363276 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a8a74c1-b676-4570-8ac7-fdb042aaffbc None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.364031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a74c1-b676-4570-8ac7-fdb042aaffbc None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:08.364348 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a74c1-b676-4570-8ac7-fdb042aaffbc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:08.365770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a8a74c1-b676-4570-8ac7-fdb042aaffbc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-d6c6a824-7ae5-4fa3-9c5b-bd5d3d515f21 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:08.366549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:08.367335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:08.368656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:08.368656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:08.368656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:08.368656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:08.368656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:08.368656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:08.368656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:08.368656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:08.368656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:08.368656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:08.368656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:08.368656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:08.375413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 38/69] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:07:08 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:08.375962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 32/70] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:08.376149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a74c1-b676-4570-8ac7-fdb042aaffbc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:08.377360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6a824-7ae5-4fa3-9c5b-bd5d3d515f21 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:08.397660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:08.483758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a8a74c1-b676-4570-8ac7-fdb042aaffbc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:08.487216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c6a824-7ae5-4fa3-9c5b-bd5d3d515f21 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:08.513006 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:08.518318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97a40768-7547-4842-838e-745afae3284d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:08.519112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a40768-7547-4842-838e-745afae3284d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.519400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a40768-7547-4842-838e-745afae3284d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.519682 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97a40768-7547-4842-838e-745afae3284d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.521363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b781c9f-a1fa-4338-94f8-3f810345fa1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:08.522021 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b781c9f-a1fa-4338-94f8-3f810345fa1f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.522315 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b781c9f-a1fa-4338-94f8-3f810345fa1f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.522595 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b781c9f-a1fa-4338-94f8-3f810345fa1f None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.523342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b781c9f-a1fa-4338-94f8-3f810345fa1f None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:08.523674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b781c9f-a1fa-4338-94f8-3f810345fa1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:08.525587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b781c9f-a1fa-4338-94f8-3f810345fa1f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:08.530338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97a40768-7547-4842-838e-745afae3284d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:08.533734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 33/71] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:08 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:08.534525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b781c9f-a1fa-4338-94f8-3f810345fa1f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-97a40768-7547-4842-838e-745afae3284d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:08.538288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:08.539094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:08.540451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:08.540451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:08.540451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:08.540451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:08.540451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:08.540451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:08.540451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:08.540451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:08.540451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:08.540451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:08.540451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:08.540451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:08.540451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 39/72] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:07:08 2022] GET /identity/v3/roles/admin => generated 83 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:08.541682 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba460ea-f284-47a8-a922-52b0abe0efbe None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.541682 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba460ea-f284-47a8-a922-52b0abe0efbe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.541892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba460ea-f284-47a8-a922-52b0abe0efbe None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.545112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 40/73] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:08.546518 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ce52b-a038-4b99-aed7-223c2380cfa1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.546886 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ce52b-a038-4b99-aed7-223c2380cfa1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.547180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-753ce52b-a038-4b99-aed7-223c2380cfa1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.548465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 41/74] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:08.550064 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ce52b-a038-4b99-aed7-223c2380cfa1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:08.616797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:08.636536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b781c9f-a1fa-4338-94f8-3f810345fa1f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:08.649868 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-753ce52b-a038-4b99-aed7-223c2380cfa1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:08.671409 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3c6e7-6e01-4bfe-b7b1-edef5082feac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:08.672316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3c6e7-6e01-4bfe-b7b1-edef5082feac None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.672608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3c6e7-6e01-4bfe-b7b1-edef5082feac None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.672882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f3c6e7-6e01-4bfe-b7b1-edef5082feac None admin] PATH_INFO: `/v3/users/b5af8a8fa8504036930130dd8858a838` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.683330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4ea6b3f-300d-49b6-ba1b-c6d040a3b950 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:08.684196 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6b3f-300d-49b6-ba1b-c6d040a3b950 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.684488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6b3f-300d-49b6-ba1b-c6d040a3b950 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.684773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4ea6b3f-300d-49b6-ba1b-c6d040a3b950 None admin] PATH_INFO: `/v3/users/b5af8a8fa8504036930130dd8858a838` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.686321 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3c6e7-6e01-4bfe-b7b1-edef5082feac None admin] RBAC: Authorizing `identity:get_user(user_id=b5af8a8fa8504036930130dd8858a838)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:08.687790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f3c6e7-6e01-4bfe-b7b1-edef5082feac None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:08.689473 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 34/75] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:08 2022] GET /identity/v3/users/b5af8a8fa8504036930130dd8858a838 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:08.690240 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3c6e7-6e01-4bfe-b7b1-edef5082feac None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:08.701266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea6b3f-300d-49b6-ba1b-c6d040a3b950 None admin] RBAC: Authorizing `identity:get_user(user_id=b5af8a8fa8504036930130dd8858a838)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:08.702695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4ea6b3f-300d-49b6-ba1b-c6d040a3b950 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:08.704382 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 42/76] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:08 2022] GET /identity/v3/users/b5af8a8fa8504036930130dd8858a838 => generated 275 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:08.705714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d088972-dbd7-4dd2-89be-1374d9a0ced7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.706004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d088972-dbd7-4dd2-89be-1374d9a0ced7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.706281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d088972-dbd7-4dd2-89be-1374d9a0ced7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.722475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4d088972-dbd7-4dd2-89be-1374d9a0ced7 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:08.723677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4d088972-dbd7-4dd2-89be-1374d9a0ced7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:08.770729 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:08.791344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 43/77] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:08.792160 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f3c6e7-6e01-4bfe-b7b1-edef5082feac None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:08.792614 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6339ad-352a-4888-809a-9e555f2dbac0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.792910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6339ad-352a-4888-809a-9e555f2dbac0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.793221 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6339ad-352a-4888-809a-9e555f2dbac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.808555 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6d6339ad-352a-4888-809a-9e555f2dbac0 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:08.809771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6d6339ad-352a-4888-809a-9e555f2dbac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:08.826343 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda993-81fd-4bac-9fb1-58e0bb559c3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:08.827015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda993-81fd-4bac-9fb1-58e0bb559c3e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.827297 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda993-81fd-4bac-9fb1-58e0bb559c3e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.827577 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbcda993-81fd-4bac-9fb1-58e0bb559c3e None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.828317 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcda993-81fd-4bac-9fb1-58e0bb559c3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:08.828626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcda993-81fd-4bac-9fb1-58e0bb559c3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:08.830026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbcda993-81fd-4bac-9fb1-58e0bb559c3e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:08.834953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:08.839305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 35/78] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:08.840279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda993-81fd-4bac-9fb1-58e0bb559c3e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:08.877161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 44/79] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:08.889452 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6339ad-352a-4888-809a-9e555f2dbac0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:08.949829 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbcda993-81fd-4bac-9fb1-58e0bb559c3e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:08.974354 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6339ad-352a-4888-809a-9e555f2dbac0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:08.982917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8456b99-e3b9-496f-8a40-646a2606e326 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:08.983570 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8456b99-e3b9-496f-8a40-646a2606e326 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:08.983860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8456b99-e3b9-496f-8a40-646a2606e326 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:08.984143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8456b99-e3b9-496f-8a40-646a2606e326 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:08.985936 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:09.010275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c3e5-97f8-44d3-b17a-3c09624eba11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:09.010928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c3e5-97f8-44d3-b17a-3c09624eba11 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:09.011219 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c3e5-97f8-44d3-b17a-3c09624eba11 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:09.011502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4921c3e5-97f8-44d3-b17a-3c09624eba11 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:09.047179 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:09.050099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8456b99-e3b9-496f-8a40-646a2606e326 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:09.052238 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8456b99-e3b9-496f-8a40-646a2606e326 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:09.078482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921c3e5-97f8-44d3-b17a-3c09624eba11 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:09.079945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4921c3e5-97f8-44d3-b17a-3c09624eba11 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:09.151326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 36/80] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:09.152245 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8456b99-e3b9-496f-8a40-646a2606e326 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:09.188312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 45/81] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 306 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:09.188312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c3e5-97f8-44d3-b17a-3c09624eba11 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:09.196828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:09.249231 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:09.252953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8456b99-e3b9-496f-8a40-646a2606e326 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:09.282980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4921c3e5-97f8-44d3-b17a-3c09624eba11 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:09.286841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a9a54-4b39-4775-a12c-098a357b54d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:09.287638 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a9a54-4b39-4775-a12c-098a357b54d2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:09.287925 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a9a54-4b39-4775-a12c-098a357b54d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:09.288208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-032a9a54-4b39-4775-a12c-098a357b54d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:09.289457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a9a54-4b39-4775-a12c-098a357b54d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:09.290946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-032a9a54-4b39-4775-a12c-098a357b54d2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:09.292564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 37/82] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:07:09 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:09.293358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a9a54-4b39-4775-a12c-098a357b54d2 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:09.317564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cc01d-258b-4b66-909d-6bbe12725849 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:09.318429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cc01d-258b-4b66-909d-6bbe12725849 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:09.318713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cc01d-258b-4b66-909d-6bbe12725849 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:09.318985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-345cc01d-258b-4b66-909d-6bbe12725849 None admin] PATH_INFO: `/v3/users/99d73c7eb544437daee425e1da4f8bea` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:09.320167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cc01d-258b-4b66-909d-6bbe12725849 None admin] RBAC: Authorizing `identity:get_user(user_id=99d73c7eb544437daee425e1da4f8bea)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:09.322218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-345cc01d-258b-4b66-909d-6bbe12725849 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:09.323818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 46/83] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:09 2022] GET /identity/v3/users/99d73c7eb544437daee425e1da4f8bea => generated 247 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:09.324556 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cc01d-258b-4b66-909d-6bbe12725849 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:09.396473 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-032a9a54-4b39-4775-a12c-098a357b54d2 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:09.402838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:09.424347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-345cc01d-258b-4b66-909d-6bbe12725849 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:09.430471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc913e7-06dd-4fe2-8705-5283b980e167 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:09.431264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc913e7-06dd-4fe2-8705-5283b980e167 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:09.431553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc913e7-06dd-4fe2-8705-5283b980e167 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:09.431840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfc913e7-06dd-4fe2-8705-5283b980e167 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:09.441820 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfc913e7-06dd-4fe2-8705-5283b980e167 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-dfc913e7-06dd-4fe2-8705-5283b980e167 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:09.450058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:09.450860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:09.451587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:09.451587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:09.451587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:09.451587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:09.451587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:09.451587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:09.451587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:09.451587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:09.451587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:09.451587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:09.451587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:09.451587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:09.451587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 38/84] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:09 2022] GET /identity/v3/roles/member => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:09.452186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc913e7-06dd-4fe2-8705-5283b980e167 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:09.462834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73e427-883d-4ce4-abd0-2bd12db186a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:09.463693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73e427-883d-4ce4-abd0-2bd12db186a0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:09.463973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73e427-883d-4ce4-abd0-2bd12db186a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:09.464248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e73e427-883d-4ce4-abd0-2bd12db186a0 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:09.465452 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73e427-883d-4ce4-abd0-2bd12db186a0 None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:09.466878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e73e427-883d-4ce4-abd0-2bd12db186a0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:09.468557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 47/85] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:09 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:09.469324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73e427-883d-4ce4-abd0-2bd12db186a0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:09.485879 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:09.557751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfc913e7-06dd-4fe2-8705-5283b980e167 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:09.575074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e73e427-883d-4ce4-abd0-2bd12db186a0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:09.589803 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a00202-3d9f-4126-bf54-10770e36a33a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:09.590660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a00202-3d9f-4126-bf54-10770e36a33a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:09.590944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a00202-3d9f-4126-bf54-10770e36a33a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:09.591217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a00202-3d9f-4126-bf54-10770e36a33a None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:09.592398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a00202-3d9f-4126-bf54-10770e36a33a None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:09.593869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a00202-3d9f-4126-bf54-10770e36a33a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:09.595803 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 39/86] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:09 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:09.596299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a00202-3d9f-4126-bf54-10770e36a33a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:09.609899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e464d4-f9d1-449f-9833-a73817d929f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:09.610602 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e464d4-f9d1-449f-9833-a73817d929f0 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:09.610890 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e464d4-f9d1-449f-9833-a73817d929f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:09.611170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e464d4-f9d1-449f-9833-a73817d929f0 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:09.612255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e464d4-f9d1-449f-9833-a73817d929f0 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:09.614137 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e464d4-f9d1-449f-9833-a73817d929f0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:09.633699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 48/87] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:07:09 2022] POST /identity/v3/users => generated 289 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:09.634316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e464d4-f9d1-449f-9833-a73817d929f0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:09.636825 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:09.701855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:09.709057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a00202-3d9f-4126-bf54-10770e36a33a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:09.751213 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2342f47-6cac-4f0f-b1c1-c9cf0d6ba7b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:09.752171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2342f47-6cac-4f0f-b1c1-c9cf0d6ba7b1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:09.752456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2342f47-6cac-4f0f-b1c1-c9cf0d6ba7b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:09.752737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2342f47-6cac-4f0f-b1c1-c9cf0d6ba7b1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:09.760134 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e464d4-f9d1-449f-9833-a73817d929f0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:09.798787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a3a48-9958-4ce7-a6d6-b947546d7acc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:09.799824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a3a48-9958-4ce7-a6d6-b947546d7acc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:09.800112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a3a48-9958-4ce7-a6d6-b947546d7acc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:09.800397 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076a3a48-9958-4ce7-a6d6-b947546d7acc None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:09.801191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a3a48-9958-4ce7-a6d6-b947546d7acc None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:09.801504 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a3a48-9958-4ce7-a6d6-b947546d7acc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:09.802978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076a3a48-9958-4ce7-a6d6-b947546d7acc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:09.812477 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 49/88] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:09.813170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a3a48-9958-4ce7-a6d6-b947546d7acc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:09.838798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2342f47-6cac-4f0f-b1c1-c9cf0d6ba7b1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:09.840268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2342f47-6cac-4f0f-b1c1-c9cf0d6ba7b1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:09.883410 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:09.933971 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076a3a48-9958-4ce7-a6d6-b947546d7acc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:09.965077 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:09.972278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 40/89] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 376 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:09.977996 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2342f47-6cac-4f0f-b1c1-c9cf0d6ba7b1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:09.979251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709105c-5356-4ab9-a612-c371f49088fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:09.980024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709105c-5356-4ab9-a612-c371f49088fd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:09.980557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709105c-5356-4ab9-a612-c371f49088fd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:09.980895 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5709105c-5356-4ab9-a612-c371f49088fd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:09.982671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709105c-5356-4ab9-a612-c371f49088fd None admin] RBAC: Adding query filter params (role.id=1b7e8aa514f04cef9c1da777642b34a8, scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14, user.id=b5af8a8fa8504036930130dd8858a838) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:09.982995 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709105c-5356-4ab9-a612-c371f49088fd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:09.984468 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5709105c-5356-4ab9-a612-c371f49088fd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:09.994144 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 50/90] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:09 2022] GET /identity/v3/role_assignments?user.id=b5af8a8fa8504036930130dd8858a838&scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14&role.id=1b7e8aa514f04cef9c1da777642b34a8 => generated 259 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:09.994783 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709105c-5356-4ab9-a612-c371f49088fd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:10.097515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2342f47-6cac-4f0f-b1c1-c9cf0d6ba7b1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:10.139285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3bc75-ba52-448d-8935-cb68e1e2f444 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:10.140705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3bc75-ba52-448d-8935-cb68e1e2f444 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:10.141243 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3bc75-ba52-448d-8935-cb68e1e2f444 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:10.141744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10e3bc75-ba52-448d-8935-cb68e1e2f444 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:10.142822 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3bc75-ba52-448d-8935-cb68e1e2f444 None admin] RBAC: Adding query filter params (role.id=f4ccd6ca72d7486d85d90f7585de12c9, scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14, user.id=b5af8a8fa8504036930130dd8858a838) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:10.143345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3bc75-ba52-448d-8935-cb68e1e2f444 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:10.145065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10e3bc75-ba52-448d-8935-cb68e1e2f444 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:10.152949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 41/91] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:09 2022] GET /identity/v3/role_assignments?user.id=b5af8a8fa8504036930130dd8858a838&scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14&role.id=f4ccd6ca72d7486d85d90f7585de12c9 => generated 259 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:10.154339 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3bc75-ba52-448d-8935-cb68e1e2f444 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:10.229653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:10.280697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10e3bc75-ba52-448d-8935-cb68e1e2f444 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:10.311029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5709105c-5356-4ab9-a612-c371f49088fd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:10.322136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ca9d7-780d-4b19-8653-93a18ad08f9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:10.323366 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ca9d7-780d-4b19-8653-93a18ad08f9b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:10.324386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ca9d7-780d-4b19-8653-93a18ad08f9b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:10.324885 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59ca9d7-780d-4b19-8653-93a18ad08f9b None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:10.333750 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ca9d7-780d-4b19-8653-93a18ad08f9b None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:10.335268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59ca9d7-780d-4b19-8653-93a18ad08f9b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:10.339093 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 42/92] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:10 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:10.345776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ca9d7-780d-4b19-8653-93a18ad08f9b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:10.372410 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:10.385533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a0298-913f-4639-a01e-88447a70c2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:10.386430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a0298-913f-4639-a01e-88447a70c2ea None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:10.386719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a0298-913f-4639-a01e-88447a70c2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:10.387001 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc0a0298-913f-4639-a01e-88447a70c2ea None admin] PATH_INFO: `/v3/users/b5af8a8fa8504036930130dd8858a838` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:10.392817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a0298-913f-4639-a01e-88447a70c2ea None admin] RBAC: Authorizing `identity:get_user(user_id=b5af8a8fa8504036930130dd8858a838)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:10.394329 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc0a0298-913f-4639-a01e-88447a70c2ea None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:10.396057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 51/93] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:09 2022] GET /identity/v3/users/b5af8a8fa8504036930130dd8858a838 => generated 275 bytes in 402 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:10.401687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a0298-913f-4639-a01e-88447a70c2ea None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:10.558444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59ca9d7-780d-4b19-8653-93a18ad08f9b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:10.571977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc0a0298-913f-4639-a01e-88447a70c2ea None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:10.622672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55708337-cd32-4f33-a59b-dd9c140c83b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:10.623702 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55708337-cd32-4f33-a59b-dd9c140c83b6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:10.624192 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55708337-cd32-4f33-a59b-dd9c140c83b6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:10.624658 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55708337-cd32-4f33-a59b-dd9c140c83b6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:10.638066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:10.666628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4872ee-ebee-4bab-9832-f2b164e94da1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:10.667311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4872ee-ebee-4bab-9832-f2b164e94da1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:10.667597 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4872ee-ebee-4bab-9832-f2b164e94da1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:10.667875 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd4872ee-ebee-4bab-9832-f2b164e94da1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:10.668720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4872ee-ebee-4bab-9832-f2b164e94da1 None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14, user.id=99d73c7eb544437daee425e1da4f8bea) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:10.669061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4872ee-ebee-4bab-9832-f2b164e94da1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:10.670550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd4872ee-ebee-4bab-9832-f2b164e94da1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:10.687019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 43/94] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:10 2022] GET /identity/v3/role_assignments?user.id=99d73c7eb544437daee425e1da4f8bea&scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 259 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:10.745457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:10.749735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55708337-cd32-4f33-a59b-dd9c140c83b6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:10.751243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55708337-cd32-4f33-a59b-dd9c140c83b6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:10.899801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 52/95] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 498 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:10.905356 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4872ee-ebee-4bab-9832-f2b164e94da1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:11.061036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd4872ee-ebee-4bab-9832-f2b164e94da1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:11.105922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c22fc25e-ef89-495a-952c-4867c87dffab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:11.107019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fc25e-ef89-495a-952c-4867c87dffab None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:11.107478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fc25e-ef89-495a-952c-4867c87dffab None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:11.107915 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c22fc25e-ef89-495a-952c-4867c87dffab None admin] PATH_INFO: `/v3/projects/62eee1e5319041ee8372d79246e7ac7e` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:11.109290 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fc25e-ef89-495a-952c-4867c87dffab None admin] RBAC: Authorizing `identity:get_project(project_id=62eee1e5319041ee8372d79246e7ac7e)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:11.110880 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c22fc25e-ef89-495a-952c-4867c87dffab None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:11.113083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 44/96] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:10 2022] GET /identity/v3/projects/62eee1e5319041ee8372d79246e7ac7e => generated 312 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:11.118455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55708337-cd32-4f33-a59b-dd9c140c83b6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:11.221549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:11.223750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55708337-cd32-4f33-a59b-dd9c140c83b6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:11.259780 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e795b216-02c6-4afb-9864-2b29c29255cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:11.260450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795b216-02c6-4afb-9864-2b29c29255cb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:11.260729 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795b216-02c6-4afb-9864-2b29c29255cb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:11.261036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e795b216-02c6-4afb-9864-2b29c29255cb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:11.261872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795b216-02c6-4afb-9864-2b29c29255cb None admin] RBAC: Adding query filter params (role.id=f4ccd6ca72d7486d85d90f7585de12c9, scope.project.id=62eee1e5319041ee8372d79246e7ac7e, user.id=b5af8a8fa8504036930130dd8858a838) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:11.262188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795b216-02c6-4afb-9864-2b29c29255cb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:11.263617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e795b216-02c6-4afb-9864-2b29c29255cb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:11.269550 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 53/97] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:11 2022] GET /identity/v3/role_assignments?user.id=b5af8a8fa8504036930130dd8858a838&scope.project.id=62eee1e5319041ee8372d79246e7ac7e&role.id=f4ccd6ca72d7486d85d90f7585de12c9 => generated 259 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:12.623061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bcfa8-17b6-4573-907f-3557a9abb675 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:12.623533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bcfa8-17b6-4573-907f-3557a9abb675 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:12.623533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de6bcfa8-17b6-4573-907f-3557a9abb675 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:12.625050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 45/98] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:12.630214 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727ce99-a3a2-4b1f-b7c9-89275d082df1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:12.630600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727ce99-a3a2-4b1f-b7c9-89275d082df1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:12.630776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3727ce99-a3a2-4b1f-b7c9-89275d082df1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:12.648320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3727ce99-a3a2-4b1f-b7c9-89275d082df1 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:12.650027 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3727ce99-a3a2-4b1f-b7c9-89275d082df1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:12.719609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 54/99] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:12.742756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bcfa8-17b6-4573-907f-3557a9abb675 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:12.808163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:12.851998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de6bcfa8-17b6-4573-907f-3557a9abb675 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:12.886278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a91324-7e58-4102-a361-e81acb7cfc75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:12.887161 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a91324-7e58-4102-a361-e81acb7cfc75 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:12.887446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a91324-7e58-4102-a361-e81acb7cfc75 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:12.887724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40a91324-7e58-4102-a361-e81acb7cfc75 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:12.901205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40a91324-7e58-4102-a361-e81acb7cfc75 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-40a91324-7e58-4102-a361-e81acb7cfc75 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:12.909474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:12.910437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:12.912673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:12.912673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:12.912673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:12.912673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:12.912673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:12.912673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:12.912673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:12.912673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:12.912673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:12.912673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:12.912673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:12.912673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:12.912673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 46/100] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:12 2022] GET /identity/v3/roles/reader => generated 84 bytes in 169 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:12.918030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727ce99-a3a2-4b1f-b7c9-89275d082df1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:13.020777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3727ce99-a3a2-4b1f-b7c9-89275d082df1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:13.022331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:13.056798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b6d4c8a-d30b-4a18-a9e5-425f2d37acf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:13.057505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d4c8a-d30b-4a18-a9e5-425f2d37acf6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.057792 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d4c8a-d30b-4a18-a9e5-425f2d37acf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.058069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b6d4c8a-d30b-4a18-a9e5-425f2d37acf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.058871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d4c8a-d30b-4a18-a9e5-425f2d37acf6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:13.059184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d4c8a-d30b-4a18-a9e5-425f2d37acf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:13.060608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b6d4c8a-d30b-4a18-a9e5-425f2d37acf6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:13.068993 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 55/101] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:13.083679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a91324-7e58-4102-a361-e81acb7cfc75 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:13.103979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23cc10-6783-4bf8-8829-2ea23aaa1443 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.104318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23cc10-6783-4bf8-8829-2ea23aaa1443 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.104534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f23cc10-6783-4bf8-8829-2ea23aaa1443 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.105998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 56/102] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:13.119369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41640cef-a4a8-4b95-819e-172c516681cd None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.119661 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41640cef-a4a8-4b95-819e-172c516681cd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.119929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41640cef-a4a8-4b95-819e-172c516681cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.151188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-41640cef-a4a8-4b95-819e-172c516681cd None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:13.152382 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-41640cef-a4a8-4b95-819e-172c516681cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:13.208202 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40a91324-7e58-4102-a361-e81acb7cfc75 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:13.237487 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:13.249503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02097d5-fb36-4e35-b6b5-31464ca45e7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:13.253243 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02097d5-fb36-4e35-b6b5-31464ca45e7e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.253708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02097d5-fb36-4e35-b6b5-31464ca45e7e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.254128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02097d5-fb36-4e35-b6b5-31464ca45e7e None admin] PATH_INFO: `/v3/users/ca0a549904894f4cb90420f778512355` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.277216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02097d5-fb36-4e35-b6b5-31464ca45e7e None admin] RBAC: Authorizing `identity:get_user(user_id=ca0a549904894f4cb90420f778512355)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:13.281452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02097d5-fb36-4e35-b6b5-31464ca45e7e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:13.283166 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 57/103] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (3 switches on core 0) May 26 18:07:13.289440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 47/104] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:13 2022] GET /identity/v3/users/ca0a549904894f4cb90420f778512355 => generated 289 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:13.290977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41640cef-a4a8-4b95-819e-172c516681cd None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:13.377555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02097d5-fb36-4e35-b6b5-31464ca45e7e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:13.416817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:13.456827 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41640cef-a4a8-4b95-819e-172c516681cd None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:13.523203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b56eab-33e4-476d-ba9c-d678fc29ba98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:13.523867 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56eab-33e4-476d-ba9c-d678fc29ba98 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.524148 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56eab-33e4-476d-ba9c-d678fc29ba98 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.524598 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b56eab-33e4-476d-ba9c-d678fc29ba98 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.564043 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02097d5-fb36-4e35-b6b5-31464ca45e7e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:13.596235 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b56eab-33e4-476d-ba9c-d678fc29ba98 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:13.598156 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b56eab-33e4-476d-ba9c-d678fc29ba98 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:13.600110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcd5c921-e134-473f-be67-de3ef2db5d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:13.602230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5c921-e134-473f-be67-de3ef2db5d96 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.602736 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5c921-e134-473f-be67-de3ef2db5d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.603215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcd5c921-e134-473f-be67-de3ef2db5d96 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.614564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcd5c921-e134-473f-be67-de3ef2db5d96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-dcd5c921-e134-473f-be67-de3ef2db5d96 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:13.624191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:13.625465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:13.626295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:13.626295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:13.626295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:13.626295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:13.626295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:13.626295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:13.626295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:13.626295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:13.626295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:13.626295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:13.626295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:13.626295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:13.628778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 48/105] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:07:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:07:13.630466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea3e60-6aee-4372-8b0e-ef910dad9df6 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.630969 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea3e60-6aee-4372-8b0e-ef910dad9df6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.631443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8eea3e60-6aee-4372-8b0e-ef910dad9df6 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.632949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 49/106] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:13.634507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07396c3-be44-439e-9772-aa8b5120cce5 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.634996 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07396c3-be44-439e-9772-aa8b5120cce5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.635471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07396c3-be44-439e-9772-aa8b5120cce5 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.636903 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 50/107] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:13.637839 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07396c3-be44-439e-9772-aa8b5120cce5 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:13.687640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:13.693521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:13.707582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 58/108] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 417 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:13.713884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fd5cd-e0c0-4a79-a8ce-5603cdd8ef96 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.714014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fd5cd-e0c0-4a79-a8ce-5603cdd8ef96 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.714285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb0fd5cd-e0c0-4a79-a8ce-5603cdd8ef96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.731907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-eb0fd5cd-e0c0-4a79-a8ce-5603cdd8ef96 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:13.733117 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-eb0fd5cd-e0c0-4a79-a8ce-5603cdd8ef96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:13.758272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07396c3-be44-439e-9772-aa8b5120cce5 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:13.796142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d3f07b9-e6f5-4663-945e-f0184ae4d884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:13.797237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f07b9-e6f5-4663-945e-f0184ae4d884 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.797770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f07b9-e6f5-4663-945e-f0184ae4d884 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.798249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d3f07b9-e6f5-4663-945e-f0184ae4d884 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.799306 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f07b9-e6f5-4663-945e-f0184ae4d884 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:13.799819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f07b9-e6f5-4663-945e-f0184ae4d884 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:13.801554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d3f07b9-e6f5-4663-945e-f0184ae4d884 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:13.810885 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 51/109] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:07:13 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:13.812383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d326d1e-ec62-478b-9bd3-8351190eb241 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.812875 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d326d1e-ec62-478b-9bd3-8351190eb241 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.813321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 59/110] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:13.813587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d326d1e-ec62-478b-9bd3-8351190eb241 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.814425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fd5cd-e0c0-4a79-a8ce-5603cdd8ef96 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:13.833682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0d326d1e-ec62-478b-9bd3-8351190eb241 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:13.835259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0d326d1e-ec62-478b-9bd3-8351190eb241 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:13.911854 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 52/111] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:13.913051 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d326d1e-ec62-478b-9bd3-8351190eb241 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:13.927878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb0fd5cd-e0c0-4a79-a8ce-5603cdd8ef96 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:13.945484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:13.956114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:13.983924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de948c2-eeb4-4be0-b7b7-e3a9c5d22251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:13.985111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de948c2-eeb4-4be0-b7b7-e3a9c5d22251 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:13.985111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de948c2-eeb4-4be0-b7b7-e3a9c5d22251 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:13.985410 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de948c2-eeb4-4be0-b7b7-e3a9c5d22251 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:13.986710 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de948c2-eeb4-4be0-b7b7-e3a9c5d22251 None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:13.988318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de948c2-eeb4-4be0-b7b7-e3a9c5d22251 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:13.990066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 60/112] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:13 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:13.995932 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de948c2-eeb4-4be0-b7b7-e3a9c5d22251 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:14.035735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d326d1e-ec62-478b-9bd3-8351190eb241 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:14.076101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47dea7-9d32-4113-afab-d0a3e1ef1d7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:14.077554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47dea7-9d32-4113-afab-d0a3e1ef1d7a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.078045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47dea7-9d32-4113-afab-d0a3e1ef1d7a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.078555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd47dea7-9d32-4113-afab-d0a3e1ef1d7a None admin] PATH_INFO: `/v3/users/b5af8a8fa8504036930130dd8858a838` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.080142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47dea7-9d32-4113-afab-d0a3e1ef1d7a None admin] RBAC: Authorizing `identity:get_user(user_id=b5af8a8fa8504036930130dd8858a838)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:14.081842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd47dea7-9d32-4113-afab-d0a3e1ef1d7a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:14.084187 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 53/113] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:13 2022] GET /identity/v3/users/b5af8a8fa8504036930130dd8858a838 => generated 275 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:14.085189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47dea7-9d32-4113-afab-d0a3e1ef1d7a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:14.099294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de948c2-eeb4-4be0-b7b7-e3a9c5d22251 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:14.134231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bcf0f-1da0-4b57-afc0-fb787de34675 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:14.135262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bcf0f-1da0-4b57-afc0-fb787de34675 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.135371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bcf0f-1da0-4b57-afc0-fb787de34675 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.135570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-140bcf0f-1da0-4b57-afc0-fb787de34675 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.146122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-140bcf0f-1da0-4b57-afc0-fb787de34675 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-140bcf0f-1da0-4b57-afc0-fb787de34675 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:14.154502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:14.155333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:14.156066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:14.156066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:14.156066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:14.156066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:14.156066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:14.156066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:14.156066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:14.156066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:14.156066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:14.156066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:14.156066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:14.156066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:14.156066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 61/114] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:13 2022] GET /identity/v3/roles/member => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:14.157161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bcf0f-1da0-4b57-afc0-fb787de34675 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:14.201090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:14.203243 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:14.208062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd47dea7-9d32-4113-afab-d0a3e1ef1d7a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:14.245612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c8b48-8786-4a89-9ccf-1f6c6fee67f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:14.246754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c8b48-8786-4a89-9ccf-1f6c6fee67f2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.247043 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c8b48-8786-4a89-9ccf-1f6c6fee67f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.247319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050c8b48-8786-4a89-9ccf-1f6c6fee67f2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.248480 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c8b48-8786-4a89-9ccf-1f6c6fee67f2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:14.250384 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050c8b48-8786-4a89-9ccf-1f6c6fee67f2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:14.256897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 54/115] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:07:14 2022] GET /identity/v3/domains/default => generated 199 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:14.256897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c8b48-8786-4a89-9ccf-1f6c6fee67f2 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:14.262005 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-140bcf0f-1da0-4b57-afc0-fb787de34675 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:14.296518 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a5a51-f7f0-433e-bf52-369b54020dca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:14.297235 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a5a51-f7f0-433e-bf52-369b54020dca None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.297525 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a5a51-f7f0-433e-bf52-369b54020dca None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.297806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4a5a51-f7f0-433e-bf52-369b54020dca None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.298679 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a5a51-f7f0-433e-bf52-369b54020dca None admin] RBAC: Adding query filter params (role.id=9918eec87e3345c2ad6ca136d1e94dd3, scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14, user.id=ca0a549904894f4cb90420f778512355) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:14.299005 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a5a51-f7f0-433e-bf52-369b54020dca None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:14.300510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4a5a51-f7f0-433e-bf52-369b54020dca None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:14.306850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 62/116] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:14 2022] GET /identity/v3/role_assignments?user.id=ca0a549904894f4cb90420f778512355&scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14&role.id=9918eec87e3345c2ad6ca136d1e94dd3 => generated 259 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:14.307711 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a5a51-f7f0-433e-bf52-369b54020dca None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:14.395143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050c8b48-8786-4a89-9ccf-1f6c6fee67f2 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:14.432848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4a5a51-f7f0-433e-bf52-369b54020dca None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:14.436708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:14.448439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51d9132-d565-48c5-b61b-a14e19571d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:14.449442 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d9132-d565-48c5-b61b-a14e19571d64 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.449731 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d9132-d565-48c5-b61b-a14e19571d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.450014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51d9132-d565-48c5-b61b-a14e19571d64 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.451382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d9132-d565-48c5-b61b-a14e19571d64 None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:14.452822 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51d9132-d565-48c5-b61b-a14e19571d64 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:14.454856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 55/117] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:14 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:14.455993 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3faf3e-952a-48a0-986e-5880340b7ea8 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.456220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3faf3e-952a-48a0-986e-5880340b7ea8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.456576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3faf3e-952a-48a0-986e-5880340b7ea8 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.457914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 56/118] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:14.458471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3faf3e-952a-48a0-986e-5880340b7ea8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:14.484120 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33519052-4e17-452c-acc4-9d1364d677ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:14.485398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33519052-4e17-452c-acc4-9d1364d677ce None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.485865 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33519052-4e17-452c-acc4-9d1364d677ce None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.486559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33519052-4e17-452c-acc4-9d1364d677ce None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.488014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33519052-4e17-452c-acc4-9d1364d677ce None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:14.488800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33519052-4e17-452c-acc4-9d1364d677ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:14.490719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33519052-4e17-452c-acc4-9d1364d677ce None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:14.499406 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:14.500958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 63/119] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:14 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:14.502243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02de60a-6184-426a-bf25-7f68f5698467 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.502538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02de60a-6184-426a-bf25-7f68f5698467 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.502815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d02de60a-6184-426a-bf25-7f68f5698467 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.524749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d02de60a-6184-426a-bf25-7f68f5698467 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:14.525991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d02de60a-6184-426a-bf25-7f68f5698467 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:14.576392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3faf3e-952a-48a0-986e-5880340b7ea8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:14.601017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 64/120] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:14.601017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02de60a-6184-426a-bf25-7f68f5698467 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:14.620653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c155c15-8dfe-42af-aef0-961ca9635711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:14.621548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c155c15-8dfe-42af-aef0-961ca9635711 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.621912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c155c15-8dfe-42af-aef0-961ca9635711 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.622268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c155c15-8dfe-42af-aef0-961ca9635711 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.623058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c155c15-8dfe-42af-aef0-961ca9635711 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:14.624838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c155c15-8dfe-42af-aef0-961ca9635711 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:14.650861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 57/121] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 26 18:07:14 2022] POST /identity/v3/projects => generated 302 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:14.650861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe768c-eed1-4024-91c4-7745154e5929 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.650861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe768c-eed1-4024-91c4-7745154e5929 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.650861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52fe768c-eed1-4024-91c4-7745154e5929 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.650861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 58/122] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:14.650861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe768c-eed1-4024-91c4-7745154e5929 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:14.737454 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:14.744256 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d02de60a-6184-426a-bf25-7f68f5698467 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:14.767290 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:14.785505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b00659-3cad-48a6-916e-4ba212aa2704 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:14.785997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52fe768c-eed1-4024-91c4-7745154e5929 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:14.786987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b00659-3cad-48a6-916e-4ba212aa2704 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.787545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b00659-3cad-48a6-916e-4ba212aa2704 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.788024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4b00659-3cad-48a6-916e-4ba212aa2704 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14/users/b5af8a8fa8504036930130dd8858a838/roles/1b7e8aa514f04cef9c1da777642b34a8` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.791944 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b00659-3cad-48a6-916e-4ba212aa2704 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14, user_id=b5af8a8fa8504036930130dd8858a838, role_id=1b7e8aa514f04cef9c1da777642b34a8)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:14.793774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4b00659-3cad-48a6-916e-4ba212aa2704 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:14.810199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 65/123] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:07:14 2022] PUT /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14/users/b5af8a8fa8504036930130dd8858a838/roles/1b7e8aa514f04cef9c1da777642b34a8 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:14.811463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b00659-3cad-48a6-916e-4ba212aa2704 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:14.862708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a45f0e04-462d-45f8-b032-0f125ff1dfae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:14.863531 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f0e04-462d-45f8-b032-0f125ff1dfae None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.863824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f0e04-462d-45f8-b032-0f125ff1dfae None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.864096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a45f0e04-462d-45f8-b032-0f125ff1dfae None admin] PATH_INFO: `/v3/users/b5af8a8fa8504036930130dd8858a838` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.865363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f0e04-462d-45f8-b032-0f125ff1dfae None admin] RBAC: Authorizing `identity:get_user(user_id=b5af8a8fa8504036930130dd8858a838)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:14.866959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a45f0e04-462d-45f8-b032-0f125ff1dfae None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:14.869153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 59/124] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:14 2022] GET /identity/v3/users/b5af8a8fa8504036930130dd8858a838 => generated 275 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:14.870434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d077231-91cd-402a-89f9-816d573fc915 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.870700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d077231-91cd-402a-89f9-816d573fc915 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.870978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d077231-91cd-402a-89f9-816d573fc915 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.905624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-1d077231-91cd-402a-89f9-816d573fc915 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:14.907267 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1d077231-91cd-402a-89f9-816d573fc915 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:14.939563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4b00659-3cad-48a6-916e-4ba212aa2704 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:14.980399 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53685435-7df5-4344-ae46-e4a126fc8646 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:14.981570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53685435-7df5-4344-ae46-e4a126fc8646 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:14.982035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53685435-7df5-4344-ae46-e4a126fc8646 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:14.982485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53685435-7df5-4344-ae46-e4a126fc8646 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:14.996030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53685435-7df5-4344-ae46-e4a126fc8646 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:15.000094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 60/125] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:14 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:15.001224 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d077231-91cd-402a-89f9-816d573fc915 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-53685435-7df5-4344-ae46-e4a126fc8646 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:15.005009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:15.005835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:15.006561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:15.006561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:15.006561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:15.006561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:15.006561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:15.006561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:15.006561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:15.006561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:15.006561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:15.006561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:15.006561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:15.006561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:15.006561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 66/126] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:07:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:15.011914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53685435-7df5-4344-ae46-e4a126fc8646 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:15.049221 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:15.131665 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:15.154269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d077231-91cd-402a-89f9-816d573fc915 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:15.167224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53685435-7df5-4344-ae46-e4a126fc8646 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:15.215609 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2dde0-54ab-41a7-9c58-61634c386d53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:15.216491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2dde0-54ab-41a7-9c58-61634c386d53 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:15.216783 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2dde0-54ab-41a7-9c58-61634c386d53 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:15.219138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b2dde0-54ab-41a7-9c58-61634c386d53 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:15.221873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2dde0-54ab-41a7-9c58-61634c386d53 None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:15.223363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b2dde0-54ab-41a7-9c58-61634c386d53 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:15.230329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 61/127] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:15 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:15.230964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2dde0-54ab-41a7-9c58-61634c386d53 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:15.242560 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0d136-9bf0-4970-a1f9-9962c7e9fb51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:15.243336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d136-9bf0-4970-a1f9-9962c7e9fb51 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:15.243698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d136-9bf0-4970-a1f9-9962c7e9fb51 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:15.244051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed0d136-9bf0-4970-a1f9-9962c7e9fb51 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:15.244949 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0d136-9bf0-4970-a1f9-9962c7e9fb51 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:15.245371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0d136-9bf0-4970-a1f9-9962c7e9fb51 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:15.247009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed0d136-9bf0-4970-a1f9-9962c7e9fb51 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:15.257685 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 67/128] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:15 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:15.258936 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0d136-9bf0-4970-a1f9-9962c7e9fb51 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:15.353381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:15.376845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed0d136-9bf0-4970-a1f9-9962c7e9fb51 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:15.416457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47630960-73df-435b-baf9-936562fcb045 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:15.417629 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47630960-73df-435b-baf9-936562fcb045 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:15.417994 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47630960-73df-435b-baf9-936562fcb045 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:15.418353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47630960-73df-435b-baf9-936562fcb045 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14/users/b5af8a8fa8504036930130dd8858a838/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:15.420769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47630960-73df-435b-baf9-936562fcb045 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14, user_id=b5af8a8fa8504036930130dd8858a838, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:15.422486 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47630960-73df-435b-baf9-936562fcb045 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:15.439260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 68/129] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:07:15 2022] PUT /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14/users/b5af8a8fa8504036930130dd8858a838/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:15.440476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47630960-73df-435b-baf9-936562fcb045 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:15.511369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b2dde0-54ab-41a7-9c58-61634c386d53 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:15.569506 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47630960-73df-435b-baf9-936562fcb045 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:15.582364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052d9fe-fc57-4010-bd06-cda79a5717bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:15.583181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052d9fe-fc57-4010-bd06-cda79a5717bf None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:15.583470 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052d9fe-fc57-4010-bd06-cda79a5717bf None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:15.583750 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3052d9fe-fc57-4010-bd06-cda79a5717bf None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:15.607746 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3052d9fe-fc57-4010-bd06-cda79a5717bf None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:15.609664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1256398-33e5-4352-ad88-0241d7beddb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:15.610572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1256398-33e5-4352-ad88-0241d7beddb6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:15.610862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1256398-33e5-4352-ad88-0241d7beddb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:15.611147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1256398-33e5-4352-ad88-0241d7beddb6 None admin] PATH_INFO: `/v3/users/99d73c7eb544437daee425e1da4f8bea` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:15.612468 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1256398-33e5-4352-ad88-0241d7beddb6 None admin] RBAC: Authorizing `identity:get_user(user_id=99d73c7eb544437daee425e1da4f8bea)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:15.614138 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1256398-33e5-4352-ad88-0241d7beddb6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:15.620348 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 69/130] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:15 2022] GET /identity/v3/users/99d73c7eb544437daee425e1da4f8bea => generated 247 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:15.621796 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1256398-33e5-4352-ad88-0241d7beddb6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-3052d9fe-fc57-4010-bd06-cda79a5717bf None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:15.623095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:15.623952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:15.624728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:15.624728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:15.624728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:15.624728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:15.624728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:15.624728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:15.624728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:15.624728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:15.624728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:15.624728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:15.624728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:15.624728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:15.627618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 62/131] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:15 2022] GET /identity/v3/roles/member => generated 84 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:15.633903 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052d9fe-fc57-4010-bd06-cda79a5717bf None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:15.645472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:15.661821 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:15.748665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1256398-33e5-4352-ad88-0241d7beddb6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:15.788997 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa2e51-4ba2-454f-9256-7db30df73b98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:15.789833 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa2e51-4ba2-454f-9256-7db30df73b98 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:15.790174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa2e51-4ba2-454f-9256-7db30df73b98 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:15.790457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cffa2e51-4ba2-454f-9256-7db30df73b98 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:15.791797 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa2e51-4ba2-454f-9256-7db30df73b98 None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:15.793466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cffa2e51-4ba2-454f-9256-7db30df73b98 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:15.796179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 70/132] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:15 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:15.801887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa2e51-4ba2-454f-9256-7db30df73b98 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:15.900514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:15.921160 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cffa2e51-4ba2-454f-9256-7db30df73b98 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:15.962449 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ede27-8de7-4b6c-a83c-cd2d3daf9dd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:15.963346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ede27-8de7-4b6c-a83c-cd2d3daf9dd9 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:15.963556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3052d9fe-fc57-4010-bd06-cda79a5717bf None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:15.963664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ede27-8de7-4b6c-a83c-cd2d3daf9dd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:15.963890 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-756ede27-8de7-4b6c-a83c-cd2d3daf9dd9 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14/users/99d73c7eb544437daee425e1da4f8bea/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:15.966138 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ede27-8de7-4b6c-a83c-cd2d3daf9dd9 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14, user_id=99d73c7eb544437daee425e1da4f8bea, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:15.968514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-756ede27-8de7-4b6c-a83c-cd2d3daf9dd9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:15.983692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 71/133] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:07:15 2022] PUT /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14/users/99d73c7eb544437daee425e1da4f8bea/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 182 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:16.043794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e8449-c7c8-4ce2-9753-a53be6dc66e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:16.044890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e8449-c7c8-4ce2-9753-a53be6dc66e4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:16.045408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e8449-c7c8-4ce2-9753-a53be6dc66e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:16.045903 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f5e8449-c7c8-4ce2-9753-a53be6dc66e4 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:16.046933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e8449-c7c8-4ce2-9753-a53be6dc66e4 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:16.047453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e8449-c7c8-4ce2-9753-a53be6dc66e4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:16.052682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f5e8449-c7c8-4ce2-9753-a53be6dc66e4 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:16.063662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 63/134] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:15 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 430 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:16.069834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ede27-8de7-4b6c-a83c-cd2d3daf9dd9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:16.212176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-756ede27-8de7-4b6c-a83c-cd2d3daf9dd9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:16.249858 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158163fd-2c12-45ba-9889-ddf485e5033e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:16.250751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158163fd-2c12-45ba-9889-ddf485e5033e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:16.251036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158163fd-2c12-45ba-9889-ddf485e5033e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:16.251388 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-158163fd-2c12-45ba-9889-ddf485e5033e None admin] PATH_INFO: `/v3/users/b5af8a8fa8504036930130dd8858a838` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:16.252690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158163fd-2c12-45ba-9889-ddf485e5033e None admin] RBAC: Authorizing `identity:get_user(user_id=b5af8a8fa8504036930130dd8858a838)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:16.254181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-158163fd-2c12-45ba-9889-ddf485e5033e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:16.255882 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 72/135] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:16 2022] GET /identity/v3/users/b5af8a8fa8504036930130dd8858a838 => generated 275 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:16.262191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e8449-c7c8-4ce2-9753-a53be6dc66e4 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:16.370890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:16.405276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f5e8449-c7c8-4ce2-9753-a53be6dc66e4 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:16.453803 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c8a21ef-229b-4af9-bde3-6b4d02561f35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:16.455054 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a21ef-229b-4af9-bde3-6b4d02561f35 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:16.455552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a21ef-229b-4af9-bde3-6b4d02561f35 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:16.456023 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c8a21ef-229b-4af9-bde3-6b4d02561f35 None admin] PATH_INFO: `/v3/projects/62eee1e5319041ee8372d79246e7ac7e` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:16.457441 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a21ef-229b-4af9-bde3-6b4d02561f35 None admin] RBAC: Authorizing `identity:get_project(project_id=62eee1e5319041ee8372d79246e7ac7e)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:16.459101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c8a21ef-229b-4af9-bde3-6b4d02561f35 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:16.461207 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 64/136] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:16 2022] GET /identity/v3/projects/62eee1e5319041ee8372d79246e7ac7e => generated 312 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:16.467059 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158163fd-2c12-45ba-9889-ddf485e5033e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:16.470787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:16.577777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-158163fd-2c12-45ba-9889-ddf485e5033e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:16.612385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4acc4140-e44a-4708-93d5-e8c9a582db06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:16.613315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc4140-e44a-4708-93d5-e8c9a582db06 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:16.613602 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc4140-e44a-4708-93d5-e8c9a582db06 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:16.613885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4acc4140-e44a-4708-93d5-e8c9a582db06 None admin] PATH_INFO: `/v3/projects/62eee1e5319041ee8372d79246e7ac7e/users/b5af8a8fa8504036930130dd8858a838/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:16.615833 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc4140-e44a-4708-93d5-e8c9a582db06 None admin] RBAC: Authorizing `identity:create_grant(project_id=62eee1e5319041ee8372d79246e7ac7e, user_id=b5af8a8fa8504036930130dd8858a838, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:16.617871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4acc4140-e44a-4708-93d5-e8c9a582db06 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:16.631009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 73/137] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:07:16 2022] PUT /identity/v3/projects/62eee1e5319041ee8372d79246e7ac7e/users/b5af8a8fa8504036930130dd8858a838/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:17.762208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63847ac4-d585-4f2f-aa9b-f3fa5db0f32f None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:17.763188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63847ac4-d585-4f2f-aa9b-f3fa5db0f32f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:17.763683 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63847ac4-d585-4f2f-aa9b-f3fa5db0f32f None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:17.765299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 65/138] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:17.770596 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4ec5a-f0a8-4ae5-b160-ec3e5799734e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:17.771435 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4ec5a-f0a8-4ae5-b160-ec3e5799734e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:17.771921 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0e4ec5a-f0a8-4ae5-b160-ec3e5799734e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:17.798027 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f0e4ec5a-f0a8-4ae5-b160-ec3e5799734e None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:17.799543 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f0e4ec5a-f0a8-4ae5-b160-ec3e5799734e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:17.869416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:17.878813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfcd80-728a-4cab-ac9a-6b0359891d19 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:17.879396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfcd80-728a-4cab-ac9a-6b0359891d19 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:17.879775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 74/139] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:17.880116 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83bfcd80-728a-4cab-ac9a-6b0359891d19 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:17.881729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 66/140] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:17.898877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dfc98-d149-41c4-9cc4-40f4c734fd79 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:17.899160 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dfc98-d149-41c4-9cc4-40f4c734fd79 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:17.899437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-791dfc98-d149-41c4-9cc4-40f4c734fd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:17.921430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-791dfc98-d149-41c4-9cc4-40f4c734fd79 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:17.922636 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-791dfc98-d149-41c4-9cc4-40f4c734fd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:17.987143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfcd80-728a-4cab-ac9a-6b0359891d19 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:18.005392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 75/141] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:18.041381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dfc98-d149-41c4-9cc4-40f4c734fd79 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:18.187372 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-791dfc98-d149-41c4-9cc4-40f4c734fd79 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:18.225471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:18.227271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83bfcd80-728a-4cab-ac9a-6b0359891d19 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:18.257874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ea454-f104-46c7-aa89-db75412f049f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:18.258721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ea454-f104-46c7-aa89-db75412f049f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.259004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ea454-f104-46c7-aa89-db75412f049f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.259280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4ea454-f104-46c7-aa89-db75412f049f None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.276569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4ea454-f104-46c7-aa89-db75412f049f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-af4ea454-f104-46c7-aa89-db75412f049f None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:18.289892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:18.290973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:18.291948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:18.291948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:18.291948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:18.291948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:18.291948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:18.291948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:18.291948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:18.291948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:18.291948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:18.291948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:18.291948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:18.291948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:18.295929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 76/142] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:18 2022] GET /identity/v3/roles/reader => generated 84 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:07:18.304377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ea454-f104-46c7-aa89-db75412f049f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:18.317338 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287ccdd8-2228-4e3f-b239-0f28d049f5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:18.318406 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ccdd8-2228-4e3f-b239-0f28d049f5d1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.318831 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ccdd8-2228-4e3f-b239-0f28d049f5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.319245 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287ccdd8-2228-4e3f-b239-0f28d049f5d1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.321648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ccdd8-2228-4e3f-b239-0f28d049f5d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:18.325957 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-287ccdd8-2228-4e3f-b239-0f28d049f5d1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:18.327793 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 67/143] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:07:17 2022] GET /identity/v3/domains/default => generated 199 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:18.330053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35d8de-466d-426b-9836-2f17f06c0d0e None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.331967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35d8de-466d-426b-9836-2f17f06c0d0e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.332460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db35d8de-466d-426b-9836-2f17f06c0d0e None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.336311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 68/144] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:18 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:18.339092 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35d8de-466d-426b-9836-2f17f06c0d0e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:18.365204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:18.453393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4ea454-f104-46c7-aa89-db75412f049f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:18.489104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d317b-b296-41dd-95f1-3cf25d98adf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:18.490158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d317b-b296-41dd-95f1-3cf25d98adf6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.490642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d317b-b296-41dd-95f1-3cf25d98adf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.491138 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d317b-b296-41dd-95f1-3cf25d98adf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.492749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d317b-b296-41dd-95f1-3cf25d98adf6 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:18.493279 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d317b-b296-41dd-95f1-3cf25d98adf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:18.494947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c3d317b-b296-41dd-95f1-3cf25d98adf6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:18.503988 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 77/145] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:18 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:18.509785 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c321998-30c3-4d73-a750-ba060df70871 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.510328 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c321998-30c3-4d73-a750-ba060df70871 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.510798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c321998-30c3-4d73-a750-ba060df70871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.528412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0c321998-30c3-4d73-a750-ba060df70871 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:18.530005 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0c321998-30c3-4d73-a750-ba060df70871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:18.552251 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db35d8de-466d-426b-9836-2f17f06c0d0e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:18.577364 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:18.621717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76271b-3985-48d1-952a-1f211fbdb6d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:18.622836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76271b-3985-48d1-952a-1f211fbdb6d1 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.623359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76271b-3985-48d1-952a-1f211fbdb6d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.623839 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd76271b-3985-48d1-952a-1f211fbdb6d1 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.624767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76271b-3985-48d1-952a-1f211fbdb6d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:18.627483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd76271b-3985-48d1-952a-1f211fbdb6d1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:18.637440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 78/146] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:18.638722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c321998-30c3-4d73-a750-ba060df70871 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:18.688516 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 69/147] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:07:18 2022] POST /identity/v3/users => generated 283 bytes in 350 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:18.689411 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76271b-3985-48d1-952a-1f211fbdb6d1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:18.761821 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c321998-30c3-4d73-a750-ba060df70871 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:18.801513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a691bb0-c87b-4ec9-b778-e7e2037b8ff8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:18.803510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691bb0-c87b-4ec9-b778-e7e2037b8ff8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.804577 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691bb0-c87b-4ec9-b778-e7e2037b8ff8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.805074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a691bb0-c87b-4ec9-b778-e7e2037b8ff8 None admin] PATH_INFO: `/v3/users/ca0a549904894f4cb90420f778512355` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.806686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a691bb0-c87b-4ec9-b778-e7e2037b8ff8 None admin] RBAC: Authorizing `identity:get_user(user_id=ca0a549904894f4cb90420f778512355)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:18.808359 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a691bb0-c87b-4ec9-b778-e7e2037b8ff8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:18.810499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 79/148] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:18 2022] GET /identity/v3/users/ca0a549904894f4cb90420f778512355 => generated 289 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:18.816492 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a691bb0-c87b-4ec9-b778-e7e2037b8ff8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:18.822869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:18.867366 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:18.893438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd76271b-3985-48d1-952a-1f211fbdb6d1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:18.939955 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03032839-483b-4ad1-b94a-5d298ef1a0ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:18.941811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03032839-483b-4ad1-b94a-5d298ef1a0ac None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.942349 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03032839-483b-4ad1-b94a-5d298ef1a0ac None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.943056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03032839-483b-4ad1-b94a-5d298ef1a0ac None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.944937 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a691bb0-c87b-4ec9-b778-e7e2037b8ff8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:18.958933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03032839-483b-4ad1-b94a-5d298ef1a0ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-03032839-483b-4ad1-b94a-5d298ef1a0ac None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:18.970656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:18.971575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:18.972310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:18.972310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:18.972310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:18.972310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:18.972310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:18.972310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:18.972310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:18.972310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:18.972310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:18.972310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:18.972310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:18.972310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:18.974667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 70/149] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:07:18 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:18.979263 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b193d64-1933-462c-b833-1052b608bf88 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:18.979263 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b193d64-1933-462c-b833-1052b608bf88 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:18.979263 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b193d64-1933-462c-b833-1052b608bf88 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:18.979263 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 71/150] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:18.990525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b193d64-1933-462c-b833-1052b608bf88 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:19.011578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2ced81-5c60-423b-8b62-4fa51b549615 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:19.012469 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ced81-5c60-423b-8b62-4fa51b549615 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.012921 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ced81-5c60-423b-8b62-4fa51b549615 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.013232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2ced81-5c60-423b-8b62-4fa51b549615 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.015040 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ced81-5c60-423b-8b62-4fa51b549615 None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:19.016781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2ced81-5c60-423b-8b62-4fa51b549615 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:19.022244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 80/151] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:18 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:19.024077 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376747-7cf3-40fb-ac1d-16c9daaaf622 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.024362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376747-7cf3-40fb-ac1d-16c9daaaf622 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.028187 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06376747-7cf3-40fb-ac1d-16c9daaaf622 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.050371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-06376747-7cf3-40fb-ac1d-16c9daaaf622 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:19.050869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-06376747-7cf3-40fb-ac1d-16c9daaaf622 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:19.127037 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 81/152] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:19.133005 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376747-7cf3-40fb-ac1d-16c9daaaf622 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:19.161230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b193d64-1933-462c-b833-1052b608bf88 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:19.189328 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:19.191130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:19.204448 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-224a3df2-0cea-4a8d-8a40-eb21935b1693 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:19.205181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a3df2-0cea-4a8d-8a40-eb21935b1693 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.205468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a3df2-0cea-4a8d-8a40-eb21935b1693 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.205747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224a3df2-0cea-4a8d-8a40-eb21935b1693 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.206500 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a3df2-0cea-4a8d-8a40-eb21935b1693 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:19.206808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a3df2-0cea-4a8d-8a40-eb21935b1693 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:19.208183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-224a3df2-0cea-4a8d-8a40-eb21935b1693 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:19.217520 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 72/153] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:07:18 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:19.218782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffed61a-5ed6-4824-a371-b877374c53c4 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.219069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffed61a-5ed6-4824-a371-b877374c53c4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.219350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ffed61a-5ed6-4824-a371-b877374c53c4 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.220714 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 73/154] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:19.221294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffed61a-5ed6-4824-a371-b877374c53c4 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:19.272711 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06376747-7cf3-40fb-ac1d-16c9daaaf622 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:19.321941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2179c8-1390-4c8d-882d-84261b8f051e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:19.323199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2179c8-1390-4c8d-882d-84261b8f051e None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.323708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2179c8-1390-4c8d-882d-84261b8f051e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.324680 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b2179c8-1390-4c8d-882d-84261b8f051e None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14/users/ca0a549904894f4cb90420f778512355/roles/9918eec87e3345c2ad6ca136d1e94dd3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.327433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2179c8-1390-4c8d-882d-84261b8f051e None admin] RBAC: Authorizing `identity:create_grant(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14, user_id=ca0a549904894f4cb90420f778512355, role_id=9918eec87e3345c2ad6ca136d1e94dd3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:19.329886 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b2179c8-1390-4c8d-882d-84261b8f051e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:19.352643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 82/155] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:07:19 2022] PUT /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14/users/ca0a549904894f4cb90420f778512355/roles/9918eec87e3345c2ad6ca136d1e94dd3 => generated 0 bytes in 225 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:19.354170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2179c8-1390-4c8d-882d-84261b8f051e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:19.364437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ffed61a-5ed6-4824-a371-b877374c53c4 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:19.418057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ea0b65f-28ce-4c99-b51a-873f27a7e625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:19.418791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b65f-28ce-4c99-b51a-873f27a7e625 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.419126 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b65f-28ce-4c99-b51a-873f27a7e625 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.419423 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ea0b65f-28ce-4c99-b51a-873f27a7e625 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.437582 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ea0b65f-28ce-4c99-b51a-873f27a7e625 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-9ea0b65f-28ce-4c99-b51a-873f27a7e625 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:19.447842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:19.448809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:19.449853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:19.449853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:19.449853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:19.449853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:19.449853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:19.449853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:19.449853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:19.449853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:19.449853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:19.449853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:19.449853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:19.449853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:19.449853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 74/156] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:19 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:19.450562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4bb74-3b77-4ce0-829b-714331fd181b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.451173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4bb74-3b77-4ce0-829b-714331fd181b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.451173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7a4bb74-3b77-4ce0-829b-714331fd181b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.482228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c7a4bb74-3b77-4ce0-829b-714331fd181b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:19.483734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c7a4bb74-3b77-4ce0-829b-714331fd181b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:19.500530 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:19.503840 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b2179c8-1390-4c8d-882d-84261b8f051e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:19.558305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:19.559805 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc4789-5941-4548-8b7c-8e2a45ed3a50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:19.561116 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc4789-5941-4548-8b7c-8e2a45ed3a50 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.561615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc4789-5941-4548-8b7c-8e2a45ed3a50 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.562106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aadc4789-5941-4548-8b7c-8e2a45ed3a50 None admin] PATH_INFO: `/v3/users/b5af8a8fa8504036930130dd8858a838` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.563834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc4789-5941-4548-8b7c-8e2a45ed3a50 None admin] RBAC: Authorizing `identity:get_user(user_id=b5af8a8fa8504036930130dd8858a838)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:19.566891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aadc4789-5941-4548-8b7c-8e2a45ed3a50 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:19.573950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 83/157] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:19 2022] GET /identity/v3/users/b5af8a8fa8504036930130dd8858a838 => generated 275 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:19.575331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc4789-5941-4548-8b7c-8e2a45ed3a50 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:19.612677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 75/158] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:19.613900 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4bb74-3b77-4ce0-829b-714331fd181b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:19.703053 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aadc4789-5941-4548-8b7c-8e2a45ed3a50 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:19.742394 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4dab5c3-d2fe-4871-87d2-8c1080cf6ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:19.743069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dab5c3-d2fe-4871-87d2-8c1080cf6ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.743351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dab5c3-d2fe-4871-87d2-8c1080cf6ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.743628 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4dab5c3-d2fe-4871-87d2-8c1080cf6ec0 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.744374 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dab5c3-d2fe-4871-87d2-8c1080cf6ec0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:19.744680 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dab5c3-d2fe-4871-87d2-8c1080cf6ec0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:19.746089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4dab5c3-d2fe-4871-87d2-8c1080cf6ec0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:19.749054 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7a4bb74-3b77-4ce0-829b-714331fd181b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:19.755147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 84/159] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:19 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:19.756460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2739ef-b73b-4965-b162-1dfb71136c72 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.756748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2739ef-b73b-4965-b162-1dfb71136c72 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.757668 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d2739ef-b73b-4965-b162-1dfb71136c72 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.758940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 85/160] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:19.759690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2739ef-b73b-4965-b162-1dfb71136c72 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:19.793164 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:19.798021 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82a06b70-8f70-4850-b62a-84df193b603f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:19.799227 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06b70-8f70-4850-b62a-84df193b603f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.799513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06b70-8f70-4850-b62a-84df193b603f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.801005 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82a06b70-8f70-4850-b62a-84df193b603f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.877462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:19.882776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a06b70-8f70-4850-b62a-84df193b603f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:19.884275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82a06b70-8f70-4850-b62a-84df193b603f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:19.895174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d2739ef-b73b-4965-b162-1dfb71136c72 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:19.934758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87eee-cf13-4135-83cb-3e7a0a99ecf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:19.935699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87eee-cf13-4135-83cb-3e7a0a99ecf2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:19.935993 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87eee-cf13-4135-83cb-3e7a0a99ecf2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:19.936273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e87eee-cf13-4135-83cb-3e7a0a99ecf2 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:19.949223 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e87eee-cf13-4135-83cb-3e7a0a99ecf2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-14e87eee-cf13-4135-83cb-3e7a0a99ecf2 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:19.957252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:19.958203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:19.958941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:19.958941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:19.958941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:19.958941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:19.958941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:19.958941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:19.958941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:19.958941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:19.958941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:19.958941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:19.958941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:19.958941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:19.958941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 86/161] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:07:19 2022] GET /identity/v3/roles/admin => generated 83 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:19.959586 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87eee-cf13-4135-83cb-3e7a0a99ecf2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:20.016919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 76/162] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:20.018742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d43f0-2a45-445b-a18c-6ea4a180835c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:20.019166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d43f0-2a45-445b-a18c-6ea4a180835c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:20.019606 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c05d43f0-2a45-445b-a18c-6ea4a180835c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:20.037069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c05d43f0-2a45-445b-a18c-6ea4a180835c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:20.039024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c05d43f0-2a45-445b-a18c-6ea4a180835c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:20.059014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:20.070031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e87eee-cf13-4135-83cb-3e7a0a99ecf2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:20.110784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cc376-df11-42a2-8b71-1b3ba60dd4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:20.112262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc376-df11-42a2-8b71-1b3ba60dd4d5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:20.112549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc376-df11-42a2-8b71-1b3ba60dd4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:20.112830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2cc376-df11-42a2-8b71-1b3ba60dd4d5 None admin] PATH_INFO: `/v3/users/b5af8a8fa8504036930130dd8858a838` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:20.115786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cc376-df11-42a2-8b71-1b3ba60dd4d5 None admin] RBAC: Authorizing `identity:get_user(user_id=b5af8a8fa8504036930130dd8858a838)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:20.119672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2cc376-df11-42a2-8b71-1b3ba60dd4d5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:20.123503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 87/164] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:19 2022] GET /identity/v3/users/b5af8a8fa8504036930130dd8858a838 => generated 275 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:20.123503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cc376-df11-42a2-8b71-1b3ba60dd4d5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:20.123828 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 77/164] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:20.125028 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d43f0-2a45-445b-a18c-6ea4a180835c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:20.141628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:20.233189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2cc376-df11-42a2-8b71-1b3ba60dd4d5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:20.257020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c05d43f0-2a45-445b-a18c-6ea4a180835c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:20.268441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1636-f452-4d1f-b19b-fafeb0869a3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:20.269155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1636-f452-4d1f-b19b-fafeb0869a3e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:20.269494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1636-f452-4d1f-b19b-fafeb0869a3e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:20.269777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-701a1636-f452-4d1f-b19b-fafeb0869a3e None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:20.270538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a1636-f452-4d1f-b19b-fafeb0869a3e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:20.270853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a1636-f452-4d1f-b19b-fafeb0869a3e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:20.272291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-701a1636-f452-4d1f-b19b-fafeb0869a3e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:20.281274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 88/165] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:20 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:20.282109 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1636-f452-4d1f-b19b-fafeb0869a3e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:20.295184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7869f-8fd6-43b9-8cd3-2e23f5f4118b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:20.296154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7869f-8fd6-43b9-8cd3-2e23f5f4118b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:20.296441 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7869f-8fd6-43b9-8cd3-2e23f5f4118b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:20.296715 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88d7869f-8fd6-43b9-8cd3-2e23f5f4118b None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:20.297912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7869f-8fd6-43b9-8cd3-2e23f5f4118b None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:20.299601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88d7869f-8fd6-43b9-8cd3-2e23f5f4118b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:20.301723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 78/166] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:20 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:20.302654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7869f-8fd6-43b9-8cd3-2e23f5f4118b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:20.306354 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:20.388004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:20.389924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-701a1636-f452-4d1f-b19b-fafeb0869a3e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:20.426340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88d7869f-8fd6-43b9-8cd3-2e23f5f4118b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:20.428105 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a48e1a-0ec2-4aa9-bae3-ffb8ef7390bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:20.429023 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48e1a-0ec2-4aa9-bae3-ffb8ef7390bb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:20.429521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48e1a-0ec2-4aa9-bae3-ffb8ef7390bb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:20.430394 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2a48e1a-0ec2-4aa9-bae3-ffb8ef7390bb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:20.480369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f836773-6585-4409-bff4-1c0a881a7f8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:20.481461 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f836773-6585-4409-bff4-1c0a881a7f8c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:20.481911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f836773-6585-4409-bff4-1c0a881a7f8c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:20.482323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f836773-6585-4409-bff4-1c0a881a7f8c None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:20.501127 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f836773-6585-4409-bff4-1c0a881a7f8c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-1f836773-6585-4409-bff4-1c0a881a7f8c None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:20.514204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:20.515073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:20.515989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:20.515989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:20.515989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:20.515989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:20.515989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:20.515989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:20.515989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:20.515989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:20.515989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:20.515989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:20.515989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:20.515989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:20.515989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 79/167] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:20 2022] GET /identity/v3/roles/member => generated 84 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:20.516841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f836773-6585-4409-bff4-1c0a881a7f8c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:20.519310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a48e1a-0ec2-4aa9-bae3-ffb8ef7390bb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:20.520799 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2a48e1a-0ec2-4aa9-bae3-ffb8ef7390bb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:20.563335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:20.658796 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 89/168] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:20 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:20.661734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a48e1a-0ec2-4aa9-bae3-ffb8ef7390bb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:20.692454 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f836773-6585-4409-bff4-1c0a881a7f8c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:20.750073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44e69e-6ec4-4ead-9438-c505df010cc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:20.751247 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44e69e-6ec4-4ead-9438-c505df010cc9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:20.751682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44e69e-6ec4-4ead-9438-c505df010cc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:20.752157 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce44e69e-6ec4-4ead-9438-c505df010cc9 None admin] PATH_INFO: `/v3/users/99d73c7eb544437daee425e1da4f8bea` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:20.753597 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44e69e-6ec4-4ead-9438-c505df010cc9 None admin] RBAC: Authorizing `identity:get_user(user_id=99d73c7eb544437daee425e1da4f8bea)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:20.761005 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce44e69e-6ec4-4ead-9438-c505df010cc9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:20.763169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 80/169] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:20 2022] GET /identity/v3/users/99d73c7eb544437daee425e1da4f8bea => generated 247 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:20.764229 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44e69e-6ec4-4ead-9438-c505df010cc9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:20.768733 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2a48e1a-0ec2-4aa9-bae3-ffb8ef7390bb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:20.769861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:20.793141 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:20.815862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402103d3-74db-43c6-a007-5095420f4917 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:20.816870 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402103d3-74db-43c6-a007-5095420f4917 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:20.817412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402103d3-74db-43c6-a007-5095420f4917 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:20.817836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-402103d3-74db-43c6-a007-5095420f4917 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:20.818876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402103d3-74db-43c6-a007-5095420f4917 None admin] RBAC: Adding query filter params (role.id=1b7e8aa514f04cef9c1da777642b34a8, scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14, user.id=b5af8a8fa8504036930130dd8858a838) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:20.819926 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402103d3-74db-43c6-a007-5095420f4917 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:20.821654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-402103d3-74db-43c6-a007-5095420f4917 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:20.839270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 90/170] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:20 2022] GET /identity/v3/role_assignments?user.id=b5af8a8fa8504036930130dd8858a838&scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14&role.id=1b7e8aa514f04cef9c1da777642b34a8 => generated 608 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:20.840131 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402103d3-74db-43c6-a007-5095420f4917 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:21.009717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce44e69e-6ec4-4ead-9438-c505df010cc9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:21.062055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66931b-e185-4e4c-832c-1a35d39ac337 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:21.062744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66931b-e185-4e4c-832c-1a35d39ac337 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:21.063028 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66931b-e185-4e4c-832c-1a35d39ac337 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:21.063299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a66931b-e185-4e4c-832c-1a35d39ac337 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:21.064166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66931b-e185-4e4c-832c-1a35d39ac337 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:21.064481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66931b-e185-4e4c-832c-1a35d39ac337 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:21.065888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a66931b-e185-4e4c-832c-1a35d39ac337 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:21.079533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 81/171] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:20 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:21.080478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66931b-e185-4e4c-832c-1a35d39ac337 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:21.139421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-402103d3-74db-43c6-a007-5095420f4917 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:21.185390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:21.238281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6000593-cbbb-4375-ae62-b9fa5fc931fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:21.239174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6000593-cbbb-4375-ae62-b9fa5fc931fb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:21.239463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6000593-cbbb-4375-ae62-b9fa5fc931fb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:21.239744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6000593-cbbb-4375-ae62-b9fa5fc931fb None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:21.241671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6000593-cbbb-4375-ae62-b9fa5fc931fb None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:21.243161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6000593-cbbb-4375-ae62-b9fa5fc931fb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:21.244964 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 91/172] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:20 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 405 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:21.245772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6000593-cbbb-4375-ae62-b9fa5fc931fb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:21.277286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a66931b-e185-4e4c-832c-1a35d39ac337 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:21.332002 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:21.379422 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb61011-1c23-4a97-9cfc-a5d97a97fb45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:21.380231 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb61011-1c23-4a97-9cfc-a5d97a97fb45 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:21.380621 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb61011-1c23-4a97-9cfc-a5d97a97fb45 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:21.381040 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb61011-1c23-4a97-9cfc-a5d97a97fb45 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:21.388093 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6000593-cbbb-4375-ae62-b9fa5fc931fb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:21.460387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2624e0b-33aa-4d6e-8b17-ad41d44f93b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:21.461305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2624e0b-33aa-4d6e-8b17-ad41d44f93b8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:21.461589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2624e0b-33aa-4d6e-8b17-ad41d44f93b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:21.461866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2624e0b-33aa-4d6e-8b17-ad41d44f93b8 None admin] PATH_INFO: `/v3/users/b5af8a8fa8504036930130dd8858a838` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:21.463123 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2624e0b-33aa-4d6e-8b17-ad41d44f93b8 None admin] RBAC: Authorizing `identity:get_user(user_id=b5af8a8fa8504036930130dd8858a838)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:21.464572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2624e0b-33aa-4d6e-8b17-ad41d44f93b8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:21.466249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 92/173] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:21 2022] GET /identity/v3/users/b5af8a8fa8504036930130dd8858a838 => generated 275 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:21.469241 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2624e0b-33aa-4d6e-8b17-ad41d44f93b8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:21.514658 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb61011-1c23-4a97-9cfc-a5d97a97fb45 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:21.516335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb61011-1c23-4a97-9cfc-a5d97a97fb45 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:21.593712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:21.639482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2624e0b-33aa-4d6e-8b17-ad41d44f93b8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:21.639675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 82/174] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 559 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:21.640769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb61011-1c23-4a97-9cfc-a5d97a97fb45 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:21.670547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:21.688645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e735c3-000f-4ca8-938c-134219f4892f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:21.689198 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e735c3-000f-4ca8-938c-134219f4892f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:21.689483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e735c3-000f-4ca8-938c-134219f4892f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:21.689762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76e735c3-000f-4ca8-938c-134219f4892f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:21.690593 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e735c3-000f-4ca8-938c-134219f4892f None admin] RBAC: Adding query filter params (role.id=f4ccd6ca72d7486d85d90f7585de12c9, scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14, user.id=b5af8a8fa8504036930130dd8858a838) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:21.690906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e735c3-000f-4ca8-938c-134219f4892f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:21.692443 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76e735c3-000f-4ca8-938c-134219f4892f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:21.702749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 93/175] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:21 2022] GET /identity/v3/role_assignments?user.id=b5af8a8fa8504036930130dd8858a838&scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14&role.id=f4ccd6ca72d7486d85d90f7585de12c9 => generated 608 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:21.703660 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e735c3-000f-4ca8-938c-134219f4892f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:21.760929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb61011-1c23-4a97-9cfc-a5d97a97fb45 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:21.801330 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd767a-6d72-4365-be22-5ad621e61834 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:21.802376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd767a-6d72-4365-be22-5ad621e61834 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:21.802922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd767a-6d72-4365-be22-5ad621e61834 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:21.803398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61fd767a-6d72-4365-be22-5ad621e61834 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:21.832176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76e735c3-000f-4ca8-938c-134219f4892f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:21.842593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:21.869245 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6807f2-8125-41e7-86a8-845ba84c9a0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:21.869930 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6807f2-8125-41e7-86a8-845ba84c9a0d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:21.870211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6807f2-8125-41e7-86a8-845ba84c9a0d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:21.870482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b6807f2-8125-41e7-86a8-845ba84c9a0d None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:21.871694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6807f2-8125-41e7-86a8-845ba84c9a0d None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:21.873252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b6807f2-8125-41e7-86a8-845ba84c9a0d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:21.875652 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 94/176] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:21 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:21.881189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6807f2-8125-41e7-86a8-845ba84c9a0d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:21.887954 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd767a-6d72-4365-be22-5ad621e61834 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:21.889644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61fd767a-6d72-4365-be22-5ad621e61834 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:21.960440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:22.010417 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 83/177] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:21 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:22.016024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd767a-6d72-4365-be22-5ad621e61834 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:22.040586 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b6807f2-8125-41e7-86a8-845ba84c9a0d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:22.120811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:22.131629 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce45a5-319f-488f-82b7-c2df4ba47d3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:22.132324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce45a5-319f-488f-82b7-c2df4ba47d3c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:22.132613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce45a5-319f-488f-82b7-c2df4ba47d3c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:22.132892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67ce45a5-319f-488f-82b7-c2df4ba47d3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:22.134097 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce45a5-319f-488f-82b7-c2df4ba47d3c None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14, user.id=99d73c7eb544437daee425e1da4f8bea) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:22.134097 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce45a5-319f-488f-82b7-c2df4ba47d3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:22.135500 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67ce45a5-319f-488f-82b7-c2df4ba47d3c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:22.150014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 95/178] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:21 2022] GET /identity/v3/role_assignments?user.id=99d73c7eb544437daee425e1da4f8bea&scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 608 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:22.170266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61fd767a-6d72-4365-be22-5ad621e61834 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:22.221308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38ef1f79-e862-4b6e-ac0b-ffe89a544c87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:22.222221 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef1f79-e862-4b6e-ac0b-ffe89a544c87 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:22.222509 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef1f79-e862-4b6e-ac0b-ffe89a544c87 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:22.222787 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38ef1f79-e862-4b6e-ac0b-ffe89a544c87 None admin] PATH_INFO: `/v3/projects/62eee1e5319041ee8372d79246e7ac7e` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:22.224061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef1f79-e862-4b6e-ac0b-ffe89a544c87 None admin] RBAC: Authorizing `identity:get_project(project_id=62eee1e5319041ee8372d79246e7ac7e)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:22.226466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38ef1f79-e862-4b6e-ac0b-ffe89a544c87 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:22.228643 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 84/179] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:22 2022] GET /identity/v3/projects/62eee1e5319041ee8372d79246e7ac7e => generated 312 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:22.234407 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce45a5-319f-488f-82b7-c2df4ba47d3c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:22.378002 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67ce45a5-319f-488f-82b7-c2df4ba47d3c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:22.399278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:22.418486 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eee7b5c2-cc34-417c-ab92-92a804319589 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:22.419547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7b5c2-cc34-417c-ab92-92a804319589 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:22.420043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7b5c2-cc34-417c-ab92-92a804319589 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:22.420514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eee7b5c2-cc34-417c-ab92-92a804319589 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:22.421617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7b5c2-cc34-417c-ab92-92a804319589 None admin] RBAC: Adding query filter params (role.id=f4ccd6ca72d7486d85d90f7585de12c9, scope.project.id=62eee1e5319041ee8372d79246e7ac7e, user.id=b5af8a8fa8504036930130dd8858a838) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:22.422154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7b5c2-cc34-417c-ab92-92a804319589 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:22.423837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eee7b5c2-cc34-417c-ab92-92a804319589 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:22.434343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 96/180] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:22 2022] GET /identity/v3/role_assignments?user.id=b5af8a8fa8504036930130dd8858a838&scope.project.id=62eee1e5319041ee8372d79246e7ac7e&role.id=f4ccd6ca72d7486d85d90f7585de12c9 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:22.873608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0309946-cbeb-45dc-88cf-f9d3deaf4a51 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:22.873947 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0309946-cbeb-45dc-88cf-f9d3deaf4a51 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:22.874137 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0309946-cbeb-45dc-88cf-f9d3deaf4a51 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:22.875598 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 85/181] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:22.881714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f88e89-b3cf-4fa2-9ba9-de9116c00dba None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:22.882814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f88e89-b3cf-4fa2-9ba9-de9116c00dba None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:22.883311 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8f88e89-b3cf-4fa2-9ba9-de9116c00dba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:22.902206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c8f88e89-b3cf-4fa2-9ba9-de9116c00dba None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:22.903763 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c8f88e89-b3cf-4fa2-9ba9-de9116c00dba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:22.984158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 97/182] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:07:23.011954 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0309946-cbeb-45dc-88cf-f9d3deaf4a51 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:23.030623 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137b710-8402-49cf-89c4-62878ff8d70f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.030938 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137b710-8402-49cf-89c4-62878ff8d70f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.031190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3137b710-8402-49cf-89c4-62878ff8d70f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.032758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 98/183] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:23.039231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cbec6-5fff-4fc1-a535-54c75da214ef None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.039515 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cbec6-5fff-4fc1-a535-54c75da214ef None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.039949 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d95cbec6-5fff-4fc1-a535-54c75da214ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.058854 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d95cbec6-5fff-4fc1-a535-54c75da214ef None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:23.060343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d95cbec6-5fff-4fc1-a535-54c75da214ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:23.167626 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 99/184] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:07:23.170084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0309946-cbeb-45dc-88cf-f9d3deaf4a51 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:23.190436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cbec6-5fff-4fc1-a535-54c75da214ef None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:23.212531 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9c45e2b-6e0c-41d9-b9e9-22013b337845 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:23.213388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c45e2b-6e0c-41d9-b9e9-22013b337845 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.213920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c45e2b-6e0c-41d9-b9e9-22013b337845 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.214203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9c45e2b-6e0c-41d9-b9e9-22013b337845 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.216800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:23.231864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9c45e2b-6e0c-41d9-b9e9-22013b337845 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:23.235987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-a9c45e2b-6e0c-41d9-b9e9-22013b337845 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:23.244195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:23.245166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:23.245937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:23.245937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:23.245937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:23.245937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:23.245937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:23.245937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:23.245937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:23.245937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:23.245937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:23.245937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:23.245937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:23.245937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:23.245937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 86/185] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:07:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:23.246791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39f8fd-9502-48c0-8265-a14fc7fbb986 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.250036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39f8fd-9502-48c0-8265-a14fc7fbb986 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.250036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f39f8fd-9502-48c0-8265-a14fc7fbb986 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.250036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 87/186] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:23 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:23.253104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39f8fd-9502-48c0-8265-a14fc7fbb986 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:23.301706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d95cbec6-5fff-4fc1-a535-54c75da214ef None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:23.334389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41447ff1-77e0-4b12-a1cf-b2cda4882123 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:23.335199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41447ff1-77e0-4b12-a1cf-b2cda4882123 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.335480 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41447ff1-77e0-4b12-a1cf-b2cda4882123 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.335755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41447ff1-77e0-4b12-a1cf-b2cda4882123 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.345876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41447ff1-77e0-4b12-a1cf-b2cda4882123 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:23.354024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f39f8fd-9502-48c0-8265-a14fc7fbb986 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-41447ff1-77e0-4b12-a1cf-b2cda4882123 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:23.354362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:23.355444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:23.356197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:23.356197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:23.356197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:23.356197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:23.356197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:23.356197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:23.356197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:23.356197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:23.356197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:23.356197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:23.356197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:23.356197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:23.356197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 100/187] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:23.361511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e80a6-065a-4813-a82c-10251c16c183 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.361796 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e80a6-065a-4813-a82c-10251c16c183 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.362072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9e80a6-065a-4813-a82c-10251c16c183 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.378494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-de9e80a6-065a-4813-a82c-10251c16c183 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:23.379666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-de9e80a6-065a-4813-a82c-10251c16c183 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:23.393481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-477f016e-9dad-4f55-ae53-6cf6bbcea171 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:23.394612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f016e-9dad-4f55-ae53-6cf6bbcea171 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.395104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f016e-9dad-4f55-ae53-6cf6bbcea171 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.395662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-477f016e-9dad-4f55-ae53-6cf6bbcea171 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.396786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f016e-9dad-4f55-ae53-6cf6bbcea171 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:23.397134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f016e-9dad-4f55-ae53-6cf6bbcea171 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:23.399082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-477f016e-9dad-4f55-ae53-6cf6bbcea171 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:23.409096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 88/188] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:23.410417 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb67ef-4cc0-41e5-bb07-474f61165d49 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.410704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb67ef-4cc0-41e5-bb07-474f61165d49 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.410982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63fb67ef-4cc0-41e5-bb07-474f61165d49 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.412220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 89/189] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:23.414637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb67ef-4cc0-41e5-bb07-474f61165d49 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:23.450058 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 101/190] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:23.450903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e80a6-065a-4813-a82c-10251c16c183 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:23.478061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:23.481165 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:23.521612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63fb67ef-4cc0-41e5-bb07-474f61165d49 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:23.548925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9e80a6-065a-4813-a82c-10251c16c183 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:23.555856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-672aa37c-6094-4984-adfd-521aa94a9e73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:23.556517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa37c-6094-4984-adfd-521aa94a9e73 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.556798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa37c-6094-4984-adfd-521aa94a9e73 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.557115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-672aa37c-6094-4984-adfd-521aa94a9e73 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.557859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672aa37c-6094-4984-adfd-521aa94a9e73 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:23.558167 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672aa37c-6094-4984-adfd-521aa94a9e73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:23.559548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-672aa37c-6094-4984-adfd-521aa94a9e73 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:23.567452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 90/191] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:23 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:23.568611 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb9080-ed26-4d22-abcb-4703ea132984 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.568890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb9080-ed26-4d22-abcb-4703ea132984 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.569209 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bb9080-ed26-4d22-abcb-4703ea132984 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.582419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f30903-c50e-4c09-97a7-565605520567 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:23.583282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30903-c50e-4c09-97a7-565605520567 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.583559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30903-c50e-4c09-97a7-565605520567 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.583832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f30903-c50e-4c09-97a7-565605520567 None admin] PATH_INFO: `/v3/users/c3786097d445466ab7b081892e150e4a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.584441 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a7bb9080-ed26-4d22-abcb-4703ea132984 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:23.586117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a7bb9080-ed26-4d22-abcb-4703ea132984 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:23.597425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f30903-c50e-4c09-97a7-565605520567 None admin] RBAC: Authorizing `identity:get_user(user_id=c3786097d445466ab7b081892e150e4a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:23.598869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30f30903-c50e-4c09-97a7-565605520567 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:23.601416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 102/192] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:23 2022] GET /identity/v3/users/c3786097d445466ab7b081892e150e4a => generated 283 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:23.602136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f30903-c50e-4c09-97a7-565605520567 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:23.655316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 91/193] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:23.656165 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb9080-ed26-4d22-abcb-4703ea132984 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:23.689989 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:23.702958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f30903-c50e-4c09-97a7-565605520567 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:23.710985 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:23.736567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abad168-db31-4ff1-b540-55bde513999e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:23.737395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad168-db31-4ff1-b540-55bde513999e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.737683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad168-db31-4ff1-b540-55bde513999e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.737961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6abad168-db31-4ff1-b540-55bde513999e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.748909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6abad168-db31-4ff1-b540-55bde513999e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6abad168-db31-4ff1-b540-55bde513999e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:23.756961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:23.757985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:23.758726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:23.758726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:23.758726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:23.758726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:23.758726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:23.758726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:23.758726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:23.758726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:23.758726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:23.758726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:23.758726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:23.758726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:23.758726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 103/194] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:07:23 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:23.759829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abad168-db31-4ff1-b540-55bde513999e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:23.763449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bb9080-ed26-4d22-abcb-4703ea132984 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:23.797953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137d738-9d91-4eac-8b06-af349d31065f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:23.798824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137d738-9d91-4eac-8b06-af349d31065f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.799109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137d738-9d91-4eac-8b06-af349d31065f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.799388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c137d738-9d91-4eac-8b06-af349d31065f None admin] PATH_INFO: `/v3/users/ca0a549904894f4cb90420f778512355` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.800577 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137d738-9d91-4eac-8b06-af349d31065f None admin] RBAC: Authorizing `identity:get_user(user_id=ca0a549904894f4cb90420f778512355)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:23.802068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c137d738-9d91-4eac-8b06-af349d31065f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:23.803681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 92/195] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:23 2022] GET /identity/v3/users/ca0a549904894f4cb90420f778512355 => generated 289 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:23.805010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137d738-9d91-4eac-8b06-af349d31065f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:23.861505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6abad168-db31-4ff1-b540-55bde513999e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:23.898354 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b9241-71b4-41a7-b4b8-52ac820223ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:23.899003 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b9241-71b4-41a7-b4b8-52ac820223ac None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.899291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b9241-71b4-41a7-b4b8-52ac820223ac None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.899569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-595b9241-71b4-41a7-b4b8-52ac820223ac None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.902660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c137d738-9d91-4eac-8b06-af349d31065f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:23.917893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:23.919987 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:23.939806 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0b2a2-e572-4ab6-97ca-24d3a8c6d267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:23.940634 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0b2a2-e572-4ab6-97ca-24d3a8c6d267 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:23.940922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0b2a2-e572-4ab6-97ca-24d3a8c6d267 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:23.941235 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa0b2a2-e572-4ab6-97ca-24d3a8c6d267 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:23.942401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0b2a2-e572-4ab6-97ca-24d3a8c6d267 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:23.943849 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fa0b2a2-e572-4ab6-97ca-24d3a8c6d267 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:23.945501 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 93/196] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:07:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:23.950843 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0b2a2-e572-4ab6-97ca-24d3a8c6d267 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:23.969538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b9241-71b4-41a7-b4b8-52ac820223ac None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:23.970995 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-595b9241-71b4-41a7-b4b8-52ac820223ac None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:24.049663 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fa0b2a2-e572-4ab6-97ca-24d3a8c6d267 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:24.067805 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 104/197] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:24.068491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b9241-71b4-41a7-b4b8-52ac820223ac None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:24.083896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85218af-636e-465d-92b3-4e1d7e9d7d27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:24.084577 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85218af-636e-465d-92b3-4e1d7e9d7d27 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:24.084863 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85218af-636e-465d-92b3-4e1d7e9d7d27 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:24.085173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85218af-636e-465d-92b3-4e1d7e9d7d27 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:24.085951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85218af-636e-465d-92b3-4e1d7e9d7d27 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:24.086266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85218af-636e-465d-92b3-4e1d7e9d7d27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:24.087648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85218af-636e-465d-92b3-4e1d7e9d7d27 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:24.095719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 94/198] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:07:23 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:24.095719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85218af-636e-465d-92b3-4e1d7e9d7d27 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:24.119084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:24.149855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:24.171652 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-595b9241-71b4-41a7-b4b8-52ac820223ac None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:24.204202 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85218af-636e-465d-92b3-4e1d7e9d7d27 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:24.205876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac5c79-4a51-424d-b727-f2a649899d15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:24.206540 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac5c79-4a51-424d-b727-f2a649899d15 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:24.206820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac5c79-4a51-424d-b727-f2a649899d15 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:24.207107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45ac5c79-4a51-424d-b727-f2a649899d15 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:24.238305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69a0e7-cbcb-4a43-b982-ac179e84e83f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:24.238964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69a0e7-cbcb-4a43-b982-ac179e84e83f None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:24.239243 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69a0e7-cbcb-4a43-b982-ac179e84e83f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:24.239516 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf69a0e7-cbcb-4a43-b982-ac179e84e83f None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:24.240214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69a0e7-cbcb-4a43-b982-ac179e84e83f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:24.241786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf69a0e7-cbcb-4a43-b982-ac179e84e83f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:24.271727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 95/199] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:07:24 2022] POST /identity/v3/users => generated 297 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:24.273298 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69a0e7-cbcb-4a43-b982-ac179e84e83f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:24.276308 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac5c79-4a51-424d-b727-f2a649899d15 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:24.277877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45ac5c79-4a51-424d-b727-f2a649899d15 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:24.334959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:24.396959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 105/200] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:24.402990 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac5c79-4a51-424d-b727-f2a649899d15 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:24.417031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf69a0e7-cbcb-4a43-b982-ac179e84e83f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:24.419539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:24.468034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6f297-b1f2-4c0e-a099-52606f2812d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:24.468832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6f297-b1f2-4c0e-a099-52606f2812d7 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:24.469145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6f297-b1f2-4c0e-a099-52606f2812d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:24.469853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99f6f297-b1f2-4c0e-a099-52606f2812d7 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:24.470729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6f297-b1f2-4c0e-a099-52606f2812d7 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:24.472190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99f6f297-b1f2-4c0e-a099-52606f2812d7 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:24.474412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 96/201] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:24 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:24.474771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6f297-b1f2-4c0e-a099-52606f2812d7 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:24.534388 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45ac5c79-4a51-424d-b727-f2a649899d15 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:24.579352 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437e84-8094-48cb-a3ff-f77f90386f6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:24.580749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437e84-8094-48cb-a3ff-f77f90386f6b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:24.581634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437e84-8094-48cb-a3ff-f77f90386f6b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:24.582246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f437e84-8094-48cb-a3ff-f77f90386f6b None admin] PATH_INFO: `/v3/users/c3786097d445466ab7b081892e150e4a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:24.584124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f437e84-8094-48cb-a3ff-f77f90386f6b None admin] RBAC: Authorizing `identity:get_user(user_id=c3786097d445466ab7b081892e150e4a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:24.586799 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f437e84-8094-48cb-a3ff-f77f90386f6b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:24.588807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 106/202] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:24 2022] GET /identity/v3/users/c3786097d445466ab7b081892e150e4a => generated 283 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:24.589816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437e84-8094-48cb-a3ff-f77f90386f6b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:24.603065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99f6f297-b1f2-4c0e-a099-52606f2812d7 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:24.612381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:24.647190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd068a-9764-492e-9884-ce74c3f42328 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:24.648121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd068a-9764-492e-9884-ce74c3f42328 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:24.650216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd068a-9764-492e-9884-ce74c3f42328 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:24.650501 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49dd068a-9764-492e-9884-ce74c3f42328 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:24.651773 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd068a-9764-492e-9884-ce74c3f42328 None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:24.653315 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49dd068a-9764-492e-9884-ce74c3f42328 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:24.655181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 97/203] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:24 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:24.655783 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd068a-9764-492e-9884-ce74c3f42328 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:24.717059 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:24.717454 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f437e84-8094-48cb-a3ff-f77f90386f6b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:24.756821 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b783023-8908-496d-ad19-c75f08b5ccd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:24.757176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b783023-8908-496d-ad19-c75f08b5ccd9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:24.757469 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b783023-8908-496d-ad19-c75f08b5ccd9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:24.757748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b783023-8908-496d-ad19-c75f08b5ccd9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:24.758595 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b783023-8908-496d-ad19-c75f08b5ccd9 None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=a9a90082c4c1407981192ee9bb7a8e19, user.id=c3786097d445466ab7b081892e150e4a) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:24.758909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b783023-8908-496d-ad19-c75f08b5ccd9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:24.760363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b783023-8908-496d-ad19-c75f08b5ccd9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:24.766561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 107/204] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:24 2022] GET /identity/v3/role_assignments?user.id=c3786097d445466ab7b081892e150e4a&scope.project.id=a9a90082c4c1407981192ee9bb7a8e19&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 259 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:24.767139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b783023-8908-496d-ad19-c75f08b5ccd9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:24.810764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49dd068a-9764-492e-9884-ce74c3f42328 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:24.854509 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f5bd2-5de5-4502-9293-635e3a3ec2d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:24.855170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f5bd2-5de5-4502-9293-635e3a3ec2d8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:24.855443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f5bd2-5de5-4502-9293-635e3a3ec2d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:24.855833 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-925f5bd2-5de5-4502-9293-635e3a3ec2d8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:24.873443 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:24.902732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b783023-8908-496d-ad19-c75f08b5ccd9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:24.941753 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f5bd2-5de5-4502-9293-635e3a3ec2d8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:24.943244 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-925f5bd2-5de5-4502-9293-635e3a3ec2d8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:24.957809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353bb20-12ff-4ac9-b437-fb1fd2a37870 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:24.959533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353bb20-12ff-4ac9-b437-fb1fd2a37870 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:24.960255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353bb20-12ff-4ac9-b437-fb1fd2a37870 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:24.961341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a353bb20-12ff-4ac9-b437-fb1fd2a37870 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:24.962919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353bb20-12ff-4ac9-b437-fb1fd2a37870 None admin] RBAC: Adding query filter params (role.id=9918eec87e3345c2ad6ca136d1e94dd3, scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14, user.id=ca0a549904894f4cb90420f778512355) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:24.963443 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353bb20-12ff-4ac9-b437-fb1fd2a37870 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:24.965252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a353bb20-12ff-4ac9-b437-fb1fd2a37870 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:24.974440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 108/205] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:24 2022] GET /identity/v3/role_assignments?user.id=ca0a549904894f4cb90420f778512355&scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14&role.id=9918eec87e3345c2ad6ca136d1e94dd3 => generated 608 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:24.997424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:25.109655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 98/206] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 454 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:25.115349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353bb20-12ff-4ac9-b437-fb1fd2a37870 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:25.272800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a353bb20-12ff-4ac9-b437-fb1fd2a37870 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:25.314781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fdbc06-ced8-43da-bdfb-83a0a4570f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:25.315648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdbc06-ced8-43da-bdfb-83a0a4570f56 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:25.315932 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdbc06-ced8-43da-bdfb-83a0a4570f56 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:25.316205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fdbc06-ced8-43da-bdfb-83a0a4570f56 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:25.317421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdbc06-ced8-43da-bdfb-83a0a4570f56 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:25.318869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79fdbc06-ced8-43da-bdfb-83a0a4570f56 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:25.321185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 109/207] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:25 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:25.326919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f5bd2-5de5-4502-9293-635e3a3ec2d8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:25.438030 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-925f5bd2-5de5-4502-9293-635e3a3ec2d8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:25.477933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e927c54f-4b3e-46c1-82e9-0e30bd9292f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:25.478918 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927c54f-4b3e-46c1-82e9-0e30bd9292f5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:25.479382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927c54f-4b3e-46c1-82e9-0e30bd9292f5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:25.479838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e927c54f-4b3e-46c1-82e9-0e30bd9292f5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:25.480860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927c54f-4b3e-46c1-82e9-0e30bd9292f5 None admin] RBAC: Adding query filter params (role.id=1b7e8aa514f04cef9c1da777642b34a8, scope.project.id=a9a90082c4c1407981192ee9bb7a8e19, user.id=c3786097d445466ab7b081892e150e4a) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:25.481373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927c54f-4b3e-46c1-82e9-0e30bd9292f5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:25.482988 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e927c54f-4b3e-46c1-82e9-0e30bd9292f5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:25.493886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 99/208] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:25 2022] GET /identity/v3/role_assignments?user.id=c3786097d445466ab7b081892e150e4a&scope.project.id=a9a90082c4c1407981192ee9bb7a8e19&role.id=1b7e8aa514f04cef9c1da777642b34a8 => generated 259 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:26.737414 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f841fa-06b2-4c44-996b-4cee5705e61f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:26.737928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f841fa-06b2-4c44-996b-4cee5705e61f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:26.738002 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f841fa-06b2-4c44-996b-4cee5705e61f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:26.739590 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 110/209] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:26.745048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471e20d-336b-49f0-a19e-80888f16f8ec None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:26.745874 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471e20d-336b-49f0-a19e-80888f16f8ec None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:26.746370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d471e20d-336b-49f0-a19e-80888f16f8ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:26.751609 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:26.763006 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b67a11-3623-45b7-9105-a49915441404 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:26.763630 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b67a11-3623-45b7-9105-a49915441404 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:26.764107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b67a11-3623-45b7-9105-a49915441404 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:26.765538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d471e20d-336b-49f0-a19e-80888f16f8ec None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:26.765978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 111/210] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:26.767018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d471e20d-336b-49f0-a19e-80888f16f8ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:26.771557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df53f69-68d1-49ef-a068-166b584f4766 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:26.772086 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df53f69-68d1-49ef-a068-166b584f4766 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:26.772583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df53f69-68d1-49ef-a068-166b584f4766 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:26.791962 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2df53f69-68d1-49ef-a068-166b584f4766 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:26.793648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2df53f69-68d1-49ef-a068-166b584f4766 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:26.802017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:26.841895 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 100/211] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:26.871098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471e20d-336b-49f0-a19e-80888f16f8ec None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:26.872342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 112/212] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:26.896280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df53f69-68d1-49ef-a068-166b584f4766 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:26.996296 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d471e20d-336b-49f0-a19e-80888f16f8ec None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:27.002647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df53f69-68d1-49ef-a068-166b584f4766 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:27.036026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:27.043820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61a057-0638-4c2b-b891-f0e6f3dd16c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:27.044646 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61a057-0638-4c2b-b891-f0e6f3dd16c9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:27.044925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61a057-0638-4c2b-b891-f0e6f3dd16c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:27.045781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f61a057-0638-4c2b-b891-f0e6f3dd16c9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:27.046955 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e311418-7cd6-4d86-8bc9-3736fc49a2d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:27.047764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e311418-7cd6-4d86-8bc9-3736fc49a2d5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:27.048043 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e311418-7cd6-4d86-8bc9-3736fc49a2d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:27.048316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e311418-7cd6-4d86-8bc9-3736fc49a2d5 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:27.049584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61a057-0638-4c2b-b891-f0e6f3dd16c9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:27.051085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f61a057-0638-4c2b-b891-f0e6f3dd16c9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:27.053094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 113/213] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:07:26 2022] GET /identity/v3/domains/default => generated 199 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:27.058988 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61a057-0638-4c2b-b891-f0e6f3dd16c9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:27.066514 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e311418-7cd6-4d86-8bc9-3736fc49a2d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:27.072639 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-9e311418-7cd6-4d86-8bc9-3736fc49a2d5 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:27.077729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:27.078614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:27.079367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:27.079367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:27.079367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:27.079367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:27.079367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:27.079367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:27.079367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:27.079367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:27.079367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:27.079367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:27.079367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:27.079367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:27.079367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 101/214] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:26 2022] GET /identity/v3/roles/member => generated 84 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:07:27.085661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e311418-7cd6-4d86-8bc9-3736fc49a2d5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:27.188871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f61a057-0638-4c2b-b891-f0e6f3dd16c9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:27.211098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e311418-7cd6-4d86-8bc9-3736fc49a2d5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:27.232659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84586872-74b2-4875-b74b-f99148228e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:27.233371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84586872-74b2-4875-b74b-f99148228e77 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:27.233673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84586872-74b2-4875-b74b-f99148228e77 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:27.233900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84586872-74b2-4875-b74b-f99148228e77 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:27.234758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84586872-74b2-4875-b74b-f99148228e77 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:27.236270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84586872-74b2-4875-b74b-f99148228e77 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:27.245624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28998385-7f03-4d69-aee6-1b13cbe31d83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:27.246354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28998385-7f03-4d69-aee6-1b13cbe31d83 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:27.246583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28998385-7f03-4d69-aee6-1b13cbe31d83 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:27.246863 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28998385-7f03-4d69-aee6-1b13cbe31d83 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:27.247610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28998385-7f03-4d69-aee6-1b13cbe31d83 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:27.248056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28998385-7f03-4d69-aee6-1b13cbe31d83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:27.249650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28998385-7f03-4d69-aee6-1b13cbe31d83 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:27.258035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 102/215] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:27 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:27.259305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42595943-6409-4344-8a8f-c6fa2a4d88d8 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:27.259593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42595943-6409-4344-8a8f-c6fa2a4d88d8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:27.259869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42595943-6409-4344-8a8f-c6fa2a4d88d8 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:27.261046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 114/216] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:07:27 2022] POST /identity/v3/users => generated 297 bytes in 202 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:07:27.263405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84586872-74b2-4875-b74b-f99148228e77 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:27.269620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 103/217] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:27 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:27.276976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb11c4-d253-4916-94dc-5ea3280cd971 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:27.277398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb11c4-d253-4916-94dc-5ea3280cd971 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:27.277757 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58cb11c4-d253-4916-94dc-5ea3280cd971 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:27.303095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-58cb11c4-d253-4916-94dc-5ea3280cd971 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:27.305032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-58cb11c4-d253-4916-94dc-5ea3280cd971 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:27.346578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:27.377207 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:27.401062 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84586872-74b2-4875-b74b-f99148228e77 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:27.407287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 104/218] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:07:27.429980 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb11c4-d253-4916-94dc-5ea3280cd971 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:27.445450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e9985-85c7-48b8-91cb-fbc05d317583 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:27.446756 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e9985-85c7-48b8-91cb-fbc05d317583 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:27.447233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e9985-85c7-48b8-91cb-fbc05d317583 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:27.447749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82e9985-85c7-48b8-91cb-fbc05d317583 None admin] PATH_INFO: `/v3/users/8d89f735e58042a5b2fddb37f8df5260` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:27.462815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e9985-85c7-48b8-91cb-fbc05d317583 None admin] RBAC: Authorizing `identity:get_user(user_id=8d89f735e58042a5b2fddb37f8df5260)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:27.464584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82e9985-85c7-48b8-91cb-fbc05d317583 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:27.466663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 115/219] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:27 2022] GET /identity/v3/users/8d89f735e58042a5b2fddb37f8df5260 => generated 297 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:27.472221 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e9985-85c7-48b8-91cb-fbc05d317583 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:27.556313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58cb11c4-d253-4916-94dc-5ea3280cd971 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:27.599663 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a7a7-81e6-4ae7-8598-31b14e0c80ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:27.599865 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82e9985-85c7-48b8-91cb-fbc05d317583 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:27.600464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a7a7-81e6-4ae7-8598-31b14e0c80ef None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:27.601053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a7a7-81e6-4ae7-8598-31b14e0c80ef None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:27.601386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af64a7a7-81e6-4ae7-8598-31b14e0c80ef None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:27.622449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af64a7a7-81e6-4ae7-8598-31b14e0c80ef None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-af64a7a7-81e6-4ae7-8598-31b14e0c80ef None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:27.631666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:27.633166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:27.633961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:27.633961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:27.633961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:27.633961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:27.633961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:27.633961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:27.633961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:27.633961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:27.633961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:27.633961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:27.633961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:27.633961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:27.635569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:27.637987 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 105/220] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:07:27 2022] GET /identity/v3/roles/admin => generated 83 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:27.644256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a7a7-81e6-4ae7-8598-31b14e0c80ef None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:27.653859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad5ca0-9979-4396-b06e-74f1e3519568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:27.654526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad5ca0-9979-4396-b06e-74f1e3519568 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:27.654809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad5ca0-9979-4396-b06e-74f1e3519568 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:27.655085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cad5ca0-9979-4396-b06e-74f1e3519568 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:27.698685 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:27.742083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad5ca0-9979-4396-b06e-74f1e3519568 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:27.744296 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cad5ca0-9979-4396-b06e-74f1e3519568 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:27.769905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af64a7a7-81e6-4ae7-8598-31b14e0c80ef None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:27.813215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc1a6d-8970-476e-b548-120fe9469ef2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:27.814594 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc1a6d-8970-476e-b548-120fe9469ef2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:27.815280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc1a6d-8970-476e-b548-120fe9469ef2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:27.815701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7dc1a6d-8970-476e-b548-120fe9469ef2 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:27.816865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc1a6d-8970-476e-b548-120fe9469ef2 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:27.817766 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc1a6d-8970-476e-b548-120fe9469ef2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:27.819810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7dc1a6d-8970-476e-b548-120fe9469ef2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:27.831908 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 106/221] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:27 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:27.841979 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc1a6d-8970-476e-b548-120fe9469ef2 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:27.865449 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 116/222] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:27 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 394 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:27.872501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad5ca0-9979-4396-b06e-74f1e3519568 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:27.900047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:27.993143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7dc1a6d-8970-476e-b548-120fe9469ef2 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:27.997333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cad5ca0-9979-4396-b06e-74f1e3519568 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:28.000493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:28.036513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f709f64-974b-4908-9f62-2dcb662b1787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:28.037530 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f709f64-974b-4908-9f62-2dcb662b1787 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:28.037829 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f709f64-974b-4908-9f62-2dcb662b1787 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:28.038357 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f709f64-974b-4908-9f62-2dcb662b1787 None admin] PATH_INFO: `/v3/users/c3786097d445466ab7b081892e150e4a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:28.039440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f709f64-974b-4908-9f62-2dcb662b1787 None admin] RBAC: Authorizing `identity:get_user(user_id=c3786097d445466ab7b081892e150e4a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:28.040902 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f709f64-974b-4908-9f62-2dcb662b1787 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:28.043628 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3620618f-a6d1-4698-aa4e-431819351b42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:28.044743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620618f-a6d1-4698-aa4e-431819351b42 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:28.045261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620618f-a6d1-4698-aa4e-431819351b42 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:28.045754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3620618f-a6d1-4698-aa4e-431819351b42 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:28.047133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 107/223] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:27 2022] GET /identity/v3/users/c3786097d445466ab7b081892e150e4a => generated 283 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:28.047869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620618f-a6d1-4698-aa4e-431819351b42 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:28.048505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d220dfe-9a94-44ab-a6a5-e551ccbf1164 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:28.048798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d220dfe-9a94-44ab-a6a5-e551ccbf1164 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:28.049133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d220dfe-9a94-44ab-a6a5-e551ccbf1164 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:28.050185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3620618f-a6d1-4698-aa4e-431819351b42 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:28.050761 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 108/224] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:28.051515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d220dfe-9a94-44ab-a6a5-e551ccbf1164 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:28.052764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 117/225] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:27 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:28.062540 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b964c1-bde9-45f0-91d0-9165d556a285 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:28.062840 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b964c1-bde9-45f0-91d0-9165d556a285 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:28.063100 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b964c1-bde9-45f0-91d0-9165d556a285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:28.092087 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d2b964c1-bde9-45f0-91d0-9165d556a285 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:28.093225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d2b964c1-bde9-45f0-91d0-9165d556a285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:28.167073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 118/226] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:28.167923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b964c1-bde9-45f0-91d0-9165d556a285 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:28.187823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d220dfe-9a94-44ab-a6a5-e551ccbf1164 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:28.216350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:28.228803 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07edd5f-fe85-4984-87ed-f5c2d29706c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:28.230639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07edd5f-fe85-4984-87ed-f5c2d29706c0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:28.230923 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07edd5f-fe85-4984-87ed-f5c2d29706c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:28.231204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a07edd5f-fe85-4984-87ed-f5c2d29706c0 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:28.233725 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07edd5f-fe85-4984-87ed-f5c2d29706c0 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:28.235411 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a07edd5f-fe85-4984-87ed-f5c2d29706c0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:28.237536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 109/227] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:28 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:28.238719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07edd5f-fe85-4984-87ed-f5c2d29706c0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:28.288382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:28.310701 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2b964c1-bde9-45f0-91d0-9165d556a285 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:28.347396 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299df1e9-3a99-49aa-a003-130f128bc474 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:28.348052 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299df1e9-3a99-49aa-a003-130f128bc474 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:28.348337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299df1e9-3a99-49aa-a003-130f128bc474 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:28.348898 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299df1e9-3a99-49aa-a003-130f128bc474 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:28.349620 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299df1e9-3a99-49aa-a003-130f128bc474 None admin] RBAC: Adding query filter params (role.id=f4ccd6ca72d7486d85d90f7585de12c9, scope.project.id=a9a90082c4c1407981192ee9bb7a8e19, user.id=8d89f735e58042a5b2fddb37f8df5260) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:28.349980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299df1e9-3a99-49aa-a003-130f128bc474 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:28.352262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299df1e9-3a99-49aa-a003-130f128bc474 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:28.356207 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a07edd5f-fe85-4984-87ed-f5c2d29706c0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:28.365013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 119/228] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:28 2022] GET /identity/v3/role_assignments?user.id=8d89f735e58042a5b2fddb37f8df5260&scope.project.id=a9a90082c4c1407981192ee9bb7a8e19&role.id=f4ccd6ca72d7486d85d90f7585de12c9 => generated 259 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:28.365013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299df1e9-3a99-49aa-a003-130f128bc474 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:28.443830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6183ff-ced8-4469-8e4e-31b8564cf403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:28.444670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6183ff-ced8-4469-8e4e-31b8564cf403 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:28.445031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6183ff-ced8-4469-8e4e-31b8564cf403 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:28.445364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e6183ff-ced8-4469-8e4e-31b8564cf403 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:28.468384 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e6183ff-ced8-4469-8e4e-31b8564cf403 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-8e6183ff-ced8-4469-8e4e-31b8564cf403 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:28.488217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:28.489200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:28.489959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:28.489959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:28.489959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:28.489959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:28.489959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:28.489959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:28.489959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:28.489959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:28.489959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:28.489959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:28.489959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:28.489959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:28.491322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 110/229] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:07:28 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:28.497600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6183ff-ced8-4469-8e4e-31b8564cf403 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:28.549931 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299df1e9-3a99-49aa-a003-130f128bc474 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:28.564482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:28.590708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a13870-7123-462a-b002-97001757a9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:28.591755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a13870-7123-462a-b002-97001757a9ae None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:28.592070 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a13870-7123-462a-b002-97001757a9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:28.592405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04a13870-7123-462a-b002-97001757a9ae None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19/users/c3786097d445466ab7b081892e150e4a/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:28.594471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a13870-7123-462a-b002-97001757a9ae None admin] RBAC: Authorizing `identity:create_grant(project_id=a9a90082c4c1407981192ee9bb7a8e19, user_id=c3786097d445466ab7b081892e150e4a, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:28.595919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04a13870-7123-462a-b002-97001757a9ae None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:28.613950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 120/230] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:07:28 2022] PUT /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19/users/c3786097d445466ab7b081892e150e4a/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 255 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:28.679834 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e6183ff-ced8-4469-8e4e-31b8564cf403 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:28.682316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:28.718488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0bb77-6420-4e1a-ba3a-577803abab40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:28.719529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0bb77-6420-4e1a-ba3a-577803abab40 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:28.720146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0bb77-6420-4e1a-ba3a-577803abab40 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:28.720596 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fc0bb77-6420-4e1a-ba3a-577803abab40 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:28.721561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0bb77-6420-4e1a-ba3a-577803abab40 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:28.722082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0bb77-6420-4e1a-ba3a-577803abab40 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:28.723661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fc0bb77-6420-4e1a-ba3a-577803abab40 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:28.734571 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 111/231] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:07:28 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:28.740178 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a13870-7123-462a-b002-97001757a9ae None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:28.861175 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04a13870-7123-462a-b002-97001757a9ae None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:28.900532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb520b-16eb-4ebe-ba66-476d0c083f5e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:28.901449 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb520b-16eb-4ebe-ba66-476d0c083f5e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:28.901734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb520b-16eb-4ebe-ba66-476d0c083f5e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:28.902014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cb520b-16eb-4ebe-ba66-476d0c083f5e None admin] PATH_INFO: `/v3/users/c3786097d445466ab7b081892e150e4a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:28.903224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb520b-16eb-4ebe-ba66-476d0c083f5e None admin] RBAC: Authorizing `identity:get_user(user_id=c3786097d445466ab7b081892e150e4a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:28.904678 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cb520b-16eb-4ebe-ba66-476d0c083f5e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:28.906744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 121/232] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:28 2022] GET /identity/v3/users/c3786097d445466ab7b081892e150e4a => generated 283 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:28.911802 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0bb77-6420-4e1a-ba3a-577803abab40 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:29.056820 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fc0bb77-6420-4e1a-ba3a-577803abab40 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:29.101258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f5a2ffc-33ed-4023-af68-2ece1bfdc56f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:29.102392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a2ffc-33ed-4023-af68-2ece1bfdc56f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:29.102848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a2ffc-33ed-4023-af68-2ece1bfdc56f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:29.103260 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f5a2ffc-33ed-4023-af68-2ece1bfdc56f None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:29.104578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a2ffc-33ed-4023-af68-2ece1bfdc56f None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:29.106189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f5a2ffc-33ed-4023-af68-2ece1bfdc56f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:29.108046 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 112/233] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:28 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:29.114149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb520b-16eb-4ebe-ba66-476d0c083f5e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:29.146008 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:29.260869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cb520b-16eb-4ebe-ba66-476d0c083f5e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:29.294813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df08d452-dff4-407f-9e8d-1c0c57305007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:29.295707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08d452-dff4-407f-9e8d-1c0c57305007 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:29.295993 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08d452-dff4-407f-9e8d-1c0c57305007 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:29.296274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df08d452-dff4-407f-9e8d-1c0c57305007 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19/users/c3786097d445466ab7b081892e150e4a/roles/1b7e8aa514f04cef9c1da777642b34a8` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:29.298550 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08d452-dff4-407f-9e8d-1c0c57305007 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9a90082c4c1407981192ee9bb7a8e19, user_id=c3786097d445466ab7b081892e150e4a, role_id=1b7e8aa514f04cef9c1da777642b34a8)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:29.300013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df08d452-dff4-407f-9e8d-1c0c57305007 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:29.341871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 122/234] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:07:29 2022] PUT /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19/users/c3786097d445466ab7b081892e150e4a/roles/1b7e8aa514f04cef9c1da777642b34a8 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:30.147650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364757f9-0acf-47b2-aead-285badb4d363 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:30.148047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364757f9-0acf-47b2-aead-285badb4d363 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:30.148215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-364757f9-0acf-47b2-aead-285badb4d363 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:30.150470 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 113/235] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:30.155683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03c793-7a22-4c14-8af0-989dd200ceb7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:30.156088 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03c793-7a22-4c14-8af0-989dd200ceb7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:30.156247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e03c793-7a22-4c14-8af0-989dd200ceb7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:30.185029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7e03c793-7a22-4c14-8af0-989dd200ceb7 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:30.185029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7e03c793-7a22-4c14-8af0-989dd200ceb7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:30.271377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 123/236] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:30.306317 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364757f9-0acf-47b2-aead-285badb4d363 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:30.346422 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:30.441382 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7ccbf-dfaf-45f7-88de-753e3d7e0513 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:30.441619 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7ccbf-dfaf-45f7-88de-753e3d7e0513 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:30.441876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94c7ccbf-dfaf-45f7-88de-753e3d7e0513 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:30.443266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 124/237] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:07:30.448103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-364757f9-0acf-47b2-aead-285badb4d363 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:30.459986 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1838e9-0a14-4792-8d3c-5d35d6ddf211 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:30.460270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1838e9-0a14-4792-8d3c-5d35d6ddf211 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:30.460557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad1838e9-0a14-4792-8d3c-5d35d6ddf211 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:30.473362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:30.482917 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ad1838e9-0a14-4792-8d3c-5d35d6ddf211 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:30.484112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ad1838e9-0a14-4792-8d3c-5d35d6ddf211 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:30.520832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9767ddd-3e06-45c4-87fd-6b60c4c17890 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:30.521668 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9767ddd-3e06-45c4-87fd-6b60c4c17890 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:30.521955 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9767ddd-3e06-45c4-87fd-6b60c4c17890 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:30.522233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9767ddd-3e06-45c4-87fd-6b60c4c17890 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:30.535643 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9767ddd-3e06-45c4-87fd-6b60c4c17890 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-e9767ddd-3e06-45c4-87fd-6b60c4c17890 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:30.544168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:30.545069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:30.545837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:30.545837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:30.545837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:30.545837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:30.545837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:30.545837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:30.545837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:30.545837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:30.545837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:30.545837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:30.545837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:30.545837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:30.545837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 114/238] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:30 2022] GET /identity/v3/roles/reader => generated 84 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:30.550986 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9767ddd-3e06-45c4-87fd-6b60c4c17890 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:30.653370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:30.665112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 125/239] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 206 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:07:30.668904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9767ddd-3e06-45c4-87fd-6b60c4c17890 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:30.707461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1838e9-0a14-4792-8d3c-5d35d6ddf211 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:30.724215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63bb9a-4b18-41dd-9f19-fb67e2837442 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:30.725203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63bb9a-4b18-41dd-9f19-fb67e2837442 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:30.725632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63bb9a-4b18-41dd-9f19-fb67e2837442 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:30.726336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd63bb9a-4b18-41dd-9f19-fb67e2837442 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:30.727274 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63bb9a-4b18-41dd-9f19-fb67e2837442 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:30.728891 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63bb9a-4b18-41dd-9f19-fb67e2837442 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:30.730467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd63bb9a-4b18-41dd-9f19-fb67e2837442 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:30.751042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 115/240] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:30.754164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63bb9a-4b18-41dd-9f19-fb67e2837442 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:30.889075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad1838e9-0a14-4792-8d3c-5d35d6ddf211 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:30.898381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd63bb9a-4b18-41dd-9f19-fb67e2837442 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:30.928418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-955be0a8-d643-4ac4-a9dd-473d8ca1adfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:30.930394 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955be0a8-d643-4ac4-a9dd-473d8ca1adfe None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:30.930823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955be0a8-d643-4ac4-a9dd-473d8ca1adfe None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:30.931244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-955be0a8-d643-4ac4-a9dd-473d8ca1adfe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:30.932706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955be0a8-d643-4ac4-a9dd-473d8ca1adfe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:30.934454 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-955be0a8-d643-4ac4-a9dd-473d8ca1adfe None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:30.936693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 126/241] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:07:30 2022] GET /identity/v3/domains/default => generated 199 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:30.938192 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4e1d6-e535-40d9-b6c4-aa6431a47420 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:30.938609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4e1d6-e535-40d9-b6c4-aa6431a47420 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:30.939051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bb4e1d6-e535-40d9-b6c4-aa6431a47420 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:30.940707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 127/242] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:30.941677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4e1d6-e535-40d9-b6c4-aa6431a47420 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:30.942777 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e16b3dd-070c-4037-a48c-4bb51a844ba8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:30.943759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16b3dd-070c-4037-a48c-4bb51a844ba8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:30.944140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16b3dd-070c-4037-a48c-4bb51a844ba8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:30.944789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e16b3dd-070c-4037-a48c-4bb51a844ba8 None admin] PATH_INFO: `/v3/users/b7cbbff2598145ed9fea5c5922389984` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:30.945464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:30.966026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16b3dd-070c-4037-a48c-4bb51a844ba8 None admin] RBAC: Authorizing `identity:get_user(user_id=b7cbbff2598145ed9fea5c5922389984)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:30.967582 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e16b3dd-070c-4037-a48c-4bb51a844ba8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:30.970418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 116/243] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:30 2022] GET /identity/v3/users/b7cbbff2598145ed9fea5c5922389984 => generated 297 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:30.971958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc63b20-bc97-4271-ab7c-d2c1165b663f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:30.972379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc63b20-bc97-4271-ab7c-d2c1165b663f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:30.973193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc63b20-bc97-4271-ab7c-d2c1165b663f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:30.996445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5fc63b20-bc97-4271-ab7c-d2c1165b663f None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:30.998088 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5fc63b20-bc97-4271-ab7c-d2c1165b663f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:31.008660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:31.068285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bb4e1d6-e535-40d9-b6c4-aa6431a47420 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:31.074174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 117/244] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:31.075398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc63b20-bc97-4271-ab7c-d2c1165b663f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:31.114838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916d08d-9f6e-4184-bcd1-1929182c1ba7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:31.115628 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916d08d-9f6e-4184-bcd1-1929182c1ba7 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:31.115980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916d08d-9f6e-4184-bcd1-1929182c1ba7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:31.116325 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d916d08d-9f6e-4184-bcd1-1929182c1ba7 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:31.117183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916d08d-9f6e-4184-bcd1-1929182c1ba7 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:31.119372 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d916d08d-9f6e-4184-bcd1-1929182c1ba7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:31.157165 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 128/245] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:07:30 2022] POST /identity/v3/users => generated 293 bytes in 216 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:31.160227 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916d08d-9f6e-4184-bcd1-1929182c1ba7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:31.231429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc63b20-bc97-4271-ab7c-d2c1165b663f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:31.289889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:31.298492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882e6df-a8b0-440a-89c2-536cd248cb2b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:31.299175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882e6df-a8b0-440a-89c2-536cd248cb2b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:31.299463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882e6df-a8b0-440a-89c2-536cd248cb2b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:31.299738 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7882e6df-a8b0-440a-89c2-536cd248cb2b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:31.313990 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:31.343665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d916d08d-9f6e-4184-bcd1-1929182c1ba7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:31.377357 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882e6df-a8b0-440a-89c2-536cd248cb2b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:31.379060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7882e6df-a8b0-440a-89c2-536cd248cb2b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:31.381833 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cafe756e-5415-4fb0-9813-06ed1957686e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:31.382838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe756e-5415-4fb0-9813-06ed1957686e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:31.383168 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe756e-5415-4fb0-9813-06ed1957686e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:31.383450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cafe756e-5415-4fb0-9813-06ed1957686e None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:31.395440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cafe756e-5415-4fb0-9813-06ed1957686e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-cafe756e-5415-4fb0-9813-06ed1957686e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:31.403852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:31.404862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:31.405645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:31.405645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:31.405645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:31.405645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:31.405645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:31.405645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:31.405645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:31.405645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:31.405645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:31.405645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:31.405645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:31.405645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:31.405645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 129/246] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:31 2022] GET /identity/v3/roles/member => generated 84 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:31.406746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c2ee4-7e66-47a2-a26c-c7515c6e131d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:31.406746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c2ee4-7e66-47a2-a26c-c7515c6e131d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:31.407020 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e1c2ee4-7e66-47a2-a26c-c7515c6e131d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:31.408713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 130/247] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:31.417210 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65896f2-8518-4c0d-9c6b-5fa69322cd72 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:31.417628 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65896f2-8518-4c0d-9c6b-5fa69322cd72 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:31.418013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f65896f2-8518-4c0d-9c6b-5fa69322cd72 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:31.438471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f65896f2-8518-4c0d-9c6b-5fa69322cd72 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:31.439832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f65896f2-8518-4c0d-9c6b-5fa69322cd72 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:31.516199 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 118/248] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 441 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:31.517398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882e6df-a8b0-440a-89c2-536cd248cb2b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:31.533205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 131/249] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:31 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:31.536650 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65896f2-8518-4c0d-9c6b-5fa69322cd72 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:31.572723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:31.593389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:31.661880 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7882e6df-a8b0-440a-89c2-536cd248cb2b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:31.665101 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f65896f2-8518-4c0d-9c6b-5fa69322cd72 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:31.715306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09caf68f-c2ab-4589-837f-eedee5bd2b14 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:31.716270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caf68f-c2ab-4589-837f-eedee5bd2b14 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:31.716553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caf68f-c2ab-4589-837f-eedee5bd2b14 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:31.716826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09caf68f-c2ab-4589-837f-eedee5bd2b14 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:31.718134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d0eab-8f64-4659-9b24-367c5cd3e139 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:31.718254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09caf68f-c2ab-4589-837f-eedee5bd2b14 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:31.719110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0eab-8f64-4659-9b24-367c5cd3e139 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:31.719605 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0eab-8f64-4659-9b24-367c5cd3e139 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:31.719705 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09caf68f-c2ab-4589-837f-eedee5bd2b14 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:31.720189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11d0eab-8f64-4659-9b24-367c5cd3e139 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:31.721910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 132/250] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:31 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:31.722128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09caf68f-c2ab-4589-837f-eedee5bd2b14 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:31.722522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0eab-8f64-4659-9b24-367c5cd3e139 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:31.723034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0eab-8f64-4659-9b24-367c5cd3e139 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:31.724633 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11d0eab-8f64-4659-9b24-367c5cd3e139 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:31.734881 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 119/251] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:31 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:31.740453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d0eab-8f64-4659-9b24-367c5cd3e139 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:31.845982 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09caf68f-c2ab-4589-837f-eedee5bd2b14 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:31.866204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:31.887372 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b8400-0e37-4275-9bdb-c234bbf762d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:31.888436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b8400-0e37-4275-9bdb-c234bbf762d3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:31.888860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b8400-0e37-4275-9bdb-c234bbf762d3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:31.889366 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d57b8400-0e37-4275-9bdb-c234bbf762d3 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:31.902616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d57b8400-0e37-4275-9bdb-c234bbf762d3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d57b8400-0e37-4275-9bdb-c234bbf762d3 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:31.911110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:31.912079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:31.912836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:31.912836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:31.912836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:31.912836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:31.912836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:31.912836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:31.912836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:31.912836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:31.912836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:31.912836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:31.912836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:31.912836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:31.916261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 133/252] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:07:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:31.917286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b8400-0e37-4275-9bdb-c234bbf762d3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:31.984808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11d0eab-8f64-4659-9b24-367c5cd3e139 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:31.990857 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:32.040145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c1ac9-8c25-4c28-b013-e8679c89c611 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:32.041609 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c1ac9-8c25-4c28-b013-e8679c89c611 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:32.042192 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c1ac9-8c25-4c28-b013-e8679c89c611 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:32.042654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666c1ac9-8c25-4c28-b013-e8679c89c611 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:32.043661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c1ac9-8c25-4c28-b013-e8679c89c611 None admin] RBAC: Adding query filter params (role.id=9918eec87e3345c2ad6ca136d1e94dd3, scope.project.id=a9a90082c4c1407981192ee9bb7a8e19, user.id=b7cbbff2598145ed9fea5c5922389984) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:32.043789 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d57b8400-0e37-4275-9bdb-c234bbf762d3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:32.044266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c1ac9-8c25-4c28-b013-e8679c89c611 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:32.046102 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666c1ac9-8c25-4c28-b013-e8679c89c611 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:32.058083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 120/253] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:31 2022] GET /identity/v3/role_assignments?user.id=b7cbbff2598145ed9fea5c5922389984&scope.project.id=a9a90082c4c1407981192ee9bb7a8e19&role.id=9918eec87e3345c2ad6ca136d1e94dd3 => generated 259 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:32.059319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c1ac9-8c25-4c28-b013-e8679c89c611 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:32.081528 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a4103fd-87f6-4df1-ab5e-a9ab3f7c1532 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:32.082518 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4103fd-87f6-4df1-ab5e-a9ab3f7c1532 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:32.082870 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4103fd-87f6-4df1-ab5e-a9ab3f7c1532 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:32.083218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a4103fd-87f6-4df1-ab5e-a9ab3f7c1532 None admin] PATH_INFO: `/v3/users/8d89f735e58042a5b2fddb37f8df5260` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:32.084617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4103fd-87f6-4df1-ab5e-a9ab3f7c1532 None admin] RBAC: Authorizing `identity:get_user(user_id=8d89f735e58042a5b2fddb37f8df5260)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:32.086798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a4103fd-87f6-4df1-ab5e-a9ab3f7c1532 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:32.088699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 134/254] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:31 2022] GET /identity/v3/users/8d89f735e58042a5b2fddb37f8df5260 => generated 297 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:32.090330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66150e-4c49-4203-b3fc-925113f34ef2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:32.090460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66150e-4c49-4203-b3fc-925113f34ef2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:32.090751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f66150e-4c49-4203-b3fc-925113f34ef2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:32.092520 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 135/255] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:32.097727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66150e-4c49-4203-b3fc-925113f34ef2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:32.152635 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:32.200370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666c1ac9-8c25-4c28-b013-e8679c89c611 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:32.224573 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f66150e-4c49-4203-b3fc-925113f34ef2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:32.240168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d8dd08-6116-4b48-bfe4-7be6d94e1513 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:32.240839 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8dd08-6116-4b48-bfe4-7be6d94e1513 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:32.241149 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8dd08-6116-4b48-bfe4-7be6d94e1513 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:32.241424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d8dd08-6116-4b48-bfe4-7be6d94e1513 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:32.242279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8dd08-6116-4b48-bfe4-7be6d94e1513 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:32.242625 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8dd08-6116-4b48-bfe4-7be6d94e1513 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:32.243999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d8dd08-6116-4b48-bfe4-7be6d94e1513 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:32.253767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 121/256] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:32.255218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d26d6-96e5-4957-b8cf-e0081df7aaed None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:32.255511 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d26d6-96e5-4957-b8cf-e0081df7aaed None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:32.255786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8d26d6-96e5-4957-b8cf-e0081df7aaed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:32.266758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0a586-281a-4270-a1ed-7cb0203ea113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:32.268005 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0a586-281a-4270-a1ed-7cb0203ea113 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:32.268512 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0a586-281a-4270-a1ed-7cb0203ea113 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:32.269017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bff0a586-281a-4270-a1ed-7cb0203ea113 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:32.270501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0a586-281a-4270-a1ed-7cb0203ea113 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:32.272180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bff0a586-281a-4270-a1ed-7cb0203ea113 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:32.273531 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9c8d26d6-96e5-4957-b8cf-e0081df7aaed None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:32.275376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9c8d26d6-96e5-4957-b8cf-e0081df7aaed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:32.275604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 136/257] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:32 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:32.276603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0a586-281a-4270-a1ed-7cb0203ea113 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:32.302642 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:32.352819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 122/258] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:32.353672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d26d6-96e5-4957-b8cf-e0081df7aaed None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:32.387409 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bff0a586-281a-4270-a1ed-7cb0203ea113 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:32.402277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:32.424808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a28c76-796f-4c71-8ae6-8444b0f7fc6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:32.426089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a28c76-796f-4c71-8ae6-8444b0f7fc6c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:32.426574 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a28c76-796f-4c71-8ae6-8444b0f7fc6c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:32.427040 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83a28c76-796f-4c71-8ae6-8444b0f7fc6c None admin] PATH_INFO: `/v3/users/c3786097d445466ab7b081892e150e4a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:32.428524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a28c76-796f-4c71-8ae6-8444b0f7fc6c None admin] RBAC: Authorizing `identity:get_user(user_id=c3786097d445466ab7b081892e150e4a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:32.430828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83a28c76-796f-4c71-8ae6-8444b0f7fc6c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:32.432739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 137/259] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:32 2022] GET /identity/v3/users/c3786097d445466ab7b081892e150e4a => generated 283 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:32.433767 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a28c76-796f-4c71-8ae6-8444b0f7fc6c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:32.465884 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8d26d6-96e5-4957-b8cf-e0081df7aaed None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:32.507143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ff2cc-9aae-4969-bacb-5963d708eb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:32.508042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ff2cc-9aae-4969-bacb-5963d708eb8a None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:32.508349 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ff2cc-9aae-4969-bacb-5963d708eb8a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:32.508620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-077ff2cc-9aae-4969-bacb-5963d708eb8a None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19/users/8d89f735e58042a5b2fddb37f8df5260/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:32.512012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ff2cc-9aae-4969-bacb-5963d708eb8a None admin] RBAC: Authorizing `identity:create_grant(project_id=a9a90082c4c1407981192ee9bb7a8e19, user_id=8d89f735e58042a5b2fddb37f8df5260, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:32.513543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-077ff2cc-9aae-4969-bacb-5963d708eb8a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:32.531136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 123/260] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:07:32 2022] PUT /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19/users/8d89f735e58042a5b2fddb37f8df5260/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:32.531521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ff2cc-9aae-4969-bacb-5963d708eb8a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:32.552093 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83a28c76-796f-4c71-8ae6-8444b0f7fc6c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:32.559191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:32.591457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ba4ad-1505-460e-9eb3-e19f09499a16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:32.592697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ba4ad-1505-460e-9eb3-e19f09499a16 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:32.593244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ba4ad-1505-460e-9eb3-e19f09499a16 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:32.593712 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f45ba4ad-1505-460e-9eb3-e19f09499a16 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:32.606359 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f45ba4ad-1505-460e-9eb3-e19f09499a16 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f45ba4ad-1505-460e-9eb3-e19f09499a16 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:32.615157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:32.616136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:32.616915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:32.616915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:32.616915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:32.616915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:32.616915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:32.616915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:32.616915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:32.616915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:32.616915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:32.616915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:32.616915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:32.616915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:32.619507 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 138/261] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:07:32 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:32.625305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ba4ad-1505-460e-9eb3-e19f09499a16 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:32.657906 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-077ff2cc-9aae-4969-bacb-5963d708eb8a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:32.672353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:32.699199 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8182468-e9d8-4b9c-8034-5be66e46b735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:32.700299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8182468-e9d8-4b9c-8034-5be66e46b735 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:32.700299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8182468-e9d8-4b9c-8034-5be66e46b735 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:32.700550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8182468-e9d8-4b9c-8034-5be66e46b735 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:32.736738 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f45ba4ad-1505-460e-9eb3-e19f09499a16 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:32.773611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d50f-e180-45c9-8d28-efc0814216f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:32.775310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d50f-e180-45c9-8d28-efc0814216f9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:32.775790 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d50f-e180-45c9-8d28-efc0814216f9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:32.776291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef3d50f-e180-45c9-8d28-efc0814216f9 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:32.777315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3d50f-e180-45c9-8d28-efc0814216f9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:32.777498 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8182468-e9d8-4b9c-8034-5be66e46b735 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:32.777994 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3d50f-e180-45c9-8d28-efc0814216f9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:32.778972 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8182468-e9d8-4b9c-8034-5be66e46b735 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:32.779813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef3d50f-e180-45c9-8d28-efc0814216f9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:32.789732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 139/262] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:07:32 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:32.798036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d50f-e180-45c9-8d28-efc0814216f9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:32.801947 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:32.900372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 124/263] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:32 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:32.909453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8182468-e9d8-4b9c-8034-5be66e46b735 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:32.967166 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef3d50f-e180-45c9-8d28-efc0814216f9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:32.970888 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:33.031759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e852fd-7c31-419a-a2a2-be61e7c25fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:33.033029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e852fd-7c31-419a-a2a2-be61e7c25fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:33.033521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e852fd-7c31-419a-a2a2-be61e7c25fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:33.034000 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e852fd-7c31-419a-a2a2-be61e7c25fa4 None admin] PATH_INFO: `/v3/users/c3786097d445466ab7b081892e150e4a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:33.038075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e852fd-7c31-419a-a2a2-be61e7c25fa4 None admin] RBAC: Authorizing `identity:get_user(user_id=c3786097d445466ab7b081892e150e4a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:33.041827 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e852fd-7c31-419a-a2a2-be61e7c25fa4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:33.044119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 140/264] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:32 2022] GET /identity/v3/users/c3786097d445466ab7b081892e150e4a => generated 283 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:33.050105 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e852fd-7c31-419a-a2a2-be61e7c25fa4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:33.096246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8182468-e9d8-4b9c-8034-5be66e46b735 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:33.139239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:33.172204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27936c2e-8363-4378-a08e-03181a5bc36b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:33.173098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27936c2e-8363-4378-a08e-03181a5bc36b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:33.173385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27936c2e-8363-4378-a08e-03181a5bc36b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:33.173663 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27936c2e-8363-4378-a08e-03181a5bc36b None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:33.175003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27936c2e-8363-4378-a08e-03181a5bc36b None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:33.176484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27936c2e-8363-4378-a08e-03181a5bc36b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:33.187055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 125/265] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:32 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:33.188216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27936c2e-8363-4378-a08e-03181a5bc36b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:33.262465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e852fd-7c31-419a-a2a2-be61e7c25fa4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:33.305663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f2f74-af43-4e16-a724-6965b6462dc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:33.306323 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f2f74-af43-4e16-a724-6965b6462dc7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:33.306610 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f2f74-af43-4e16-a724-6965b6462dc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:33.306887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc3f2f74-af43-4e16-a724-6965b6462dc7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:33.345673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27936c2e-8363-4378-a08e-03181a5bc36b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:33.350185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:33.402570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f2f74-af43-4e16-a724-6965b6462dc7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:33.404027 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc3f2f74-af43-4e16-a724-6965b6462dc7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:33.406772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd06b4-82f7-44c1-8136-b75e0c1697b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:33.407425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd06b4-82f7-44c1-8136-b75e0c1697b8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:33.407704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd06b4-82f7-44c1-8136-b75e0c1697b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:33.407980 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cbd06b4-82f7-44c1-8136-b75e0c1697b8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:33.408811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd06b4-82f7-44c1-8136-b75e0c1697b8 None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=a9a90082c4c1407981192ee9bb7a8e19, user.id=c3786097d445466ab7b081892e150e4a) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:33.409174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd06b4-82f7-44c1-8136-b75e0c1697b8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:33.410600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cbd06b4-82f7-44c1-8136-b75e0c1697b8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:33.424768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 126/266] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:33 2022] GET /identity/v3/role_assignments?user.id=c3786097d445466ab7b081892e150e4a&scope.project.id=a9a90082c4c1407981192ee9bb7a8e19&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 608 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:33.545099 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 141/267] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:33.546658 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd06b4-82f7-44c1-8136-b75e0c1697b8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:33.617253 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:33.680804 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cbd06b4-82f7-44c1-8136-b75e0c1697b8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:33.727533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be165170-fbe9-4be2-8f00-d4cbee829441 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:33.728411 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165170-fbe9-4be2-8f00-d4cbee829441 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:33.728696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165170-fbe9-4be2-8f00-d4cbee829441 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:33.728972 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be165170-fbe9-4be2-8f00-d4cbee829441 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:33.730193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be165170-fbe9-4be2-8f00-d4cbee829441 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:33.731646 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be165170-fbe9-4be2-8f00-d4cbee829441 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:33.734664 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 127/268] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:33 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:33.739630 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f2f74-af43-4e16-a724-6965b6462dc7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:33.816347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:33.849751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc3f2f74-af43-4e16-a724-6965b6462dc7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:33.888266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f752e92f-ac5f-4809-8054-5ac3e268d022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:33.888932 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752e92f-ac5f-4809-8054-5ac3e268d022 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:33.889243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752e92f-ac5f-4809-8054-5ac3e268d022 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:33.889519 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f752e92f-ac5f-4809-8054-5ac3e268d022 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:33.890360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752e92f-ac5f-4809-8054-5ac3e268d022 None admin] RBAC: Adding query filter params (role.id=1b7e8aa514f04cef9c1da777642b34a8, scope.project.id=a9a90082c4c1407981192ee9bb7a8e19, user.id=c3786097d445466ab7b081892e150e4a) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:33.890677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752e92f-ac5f-4809-8054-5ac3e268d022 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:33.892312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f752e92f-ac5f-4809-8054-5ac3e268d022 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:33.898485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 142/269] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:33 2022] GET /identity/v3/role_assignments?user.id=c3786097d445466ab7b081892e150e4a&scope.project.id=a9a90082c4c1407981192ee9bb7a8e19&role.id=1b7e8aa514f04cef9c1da777642b34a8 => generated 608 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:34.597841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412910c-a46f-4cb1-925f-946947913609 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:34.598332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412910c-a46f-4cb1-925f-946947913609 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:34.598332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8412910c-a46f-4cb1-925f-946947913609 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:34.599943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 128/270] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:34.605801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281537f-eab3-4bb7-9a24-9ce4e66dcc5f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:34.606651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281537f-eab3-4bb7-9a24-9ce4e66dcc5f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:34.607125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e281537f-eab3-4bb7-9a24-9ce4e66dcc5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:34.625412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e281537f-eab3-4bb7-9a24-9ce4e66dcc5f None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:34.626927 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e281537f-eab3-4bb7-9a24-9ce4e66dcc5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:34.647130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec0c2-c354-447b-aff0-19b8862777a6 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:34.647423 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec0c2-c354-447b-aff0-19b8862777a6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:34.647694 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91aec0c2-c354-447b-aff0-19b8862777a6 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:34.649251 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 129/271] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:07:34.654403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb603f56-de0f-417e-bad2-416e3569a5c8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:34.654695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb603f56-de0f-417e-bad2-416e3569a5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:34.654976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb603f56-de0f-417e-bad2-416e3569a5c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:34.681753 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fb603f56-de0f-417e-bad2-416e3569a5c8 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:34.683647 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fb603f56-de0f-417e-bad2-416e3569a5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:34.717042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 143/272] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:34.758183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281537f-eab3-4bb7-9a24-9ce4e66dcc5f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:34.780814 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 130/273] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:34.806793 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb603f56-de0f-417e-bad2-416e3569a5c8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:34.843142 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:34.908270 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:34.915047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e281537f-eab3-4bb7-9a24-9ce4e66dcc5f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:34.969106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095d3a9-ed1a-48f7-bc15-30455cb29254 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:34.970596 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095d3a9-ed1a-48f7-bc15-30455cb29254 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:34.971079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095d3a9-ed1a-48f7-bc15-30455cb29254 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:34.971903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0095d3a9-ed1a-48f7-bc15-30455cb29254 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:34.974204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095d3a9-ed1a-48f7-bc15-30455cb29254 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:34.976294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0095d3a9-ed1a-48f7-bc15-30455cb29254 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:34.984844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 144/274] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:07:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:34.987107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095d3a9-ed1a-48f7-bc15-30455cb29254 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:35.010661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb603f56-de0f-417e-bad2-416e3569a5c8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:35.056418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d0777-575d-4fa7-807d-ca71c7d291de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:35.058239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d0777-575d-4fa7-807d-ca71c7d291de None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:35.058846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d0777-575d-4fa7-807d-ca71c7d291de None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:35.059398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a47d0777-575d-4fa7-807d-ca71c7d291de None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:35.073817 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a47d0777-575d-4fa7-807d-ca71c7d291de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-a47d0777-575d-4fa7-807d-ca71c7d291de None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:35.084769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:35.085667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:35.086439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:35.086439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:35.086439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:35.086439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:35.086439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:35.086439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:35.086439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:35.086439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:35.086439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:35.086439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:35.086439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:35.086439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:35.089414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 131/275] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:34 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:07:35.096294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d0777-575d-4fa7-807d-ca71c7d291de None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:35.109948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0095d3a9-ed1a-48f7-bc15-30455cb29254 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:35.148321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:35.154231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e55ef530-2c0a-43a8-bb7b-013b4532ec3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:35.154914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ef530-2c0a-43a8-bb7b-013b4532ec3e None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:35.155200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ef530-2c0a-43a8-bb7b-013b4532ec3e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:35.155479 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e55ef530-2c0a-43a8-bb7b-013b4532ec3e None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:35.156198 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ef530-2c0a-43a8-bb7b-013b4532ec3e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:35.157796 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e55ef530-2c0a-43a8-bb7b-013b4532ec3e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:35.185125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 145/276] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:07:34 2022] POST /identity/v3/users => generated 293 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:35.190589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc03f-4970-443e-b300-db908521cbd0 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:35.191265 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc03f-4970-443e-b300-db908521cbd0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:35.191748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a16fc03f-4970-443e-b300-db908521cbd0 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:35.198182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 146/277] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:35.200066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606bf90-9a1f-47b6-badb-6e5471978aaf None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:35.200587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606bf90-9a1f-47b6-badb-6e5471978aaf None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:35.201170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e606bf90-9a1f-47b6-badb-6e5471978aaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:35.218810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a47d0777-575d-4fa7-807d-ca71c7d291de None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:35.220829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e606bf90-9a1f-47b6-badb-6e5471978aaf None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:35.222523 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e606bf90-9a1f-47b6-badb-6e5471978aaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:35.232660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:35.266543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea4005-1f74-467d-bd75-92f7d566b861 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:35.267236 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4005-1f74-467d-bd75-92f7d566b861 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:35.267581 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4005-1f74-467d-bd75-92f7d566b861 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:35.267906 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aea4005-1f74-467d-bd75-92f7d566b861 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:35.269166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea4005-1f74-467d-bd75-92f7d566b861 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:35.269489 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea4005-1f74-467d-bd75-92f7d566b861 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:35.271933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aea4005-1f74-467d-bd75-92f7d566b861 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:35.283047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 132/278] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:35 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:35.288692 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea4005-1f74-467d-bd75-92f7d566b861 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:35.317231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 147/279] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:35.337106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606bf90-9a1f-47b6-badb-6e5471978aaf None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:35.398140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aea4005-1f74-467d-bd75-92f7d566b861 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:35.439656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d4fdd-ce1c-4aaf-bf62-3301942bf22c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:35.440463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d4fdd-ce1c-4aaf-bf62-3301942bf22c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:35.440749 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d4fdd-ce1c-4aaf-bf62-3301942bf22c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:35.441061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581d4fdd-ce1c-4aaf-bf62-3301942bf22c None admin] PATH_INFO: `/v3/users/83ea9963b5114c49bf5399d817b8317b` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:35.455219 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e606bf90-9a1f-47b6-badb-6e5471978aaf None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:35.457351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d4fdd-ce1c-4aaf-bf62-3301942bf22c None admin] RBAC: Authorizing `identity:get_user(user_id=83ea9963b5114c49bf5399d817b8317b)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:35.458942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581d4fdd-ce1c-4aaf-bf62-3301942bf22c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:35.460848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 133/280] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:35 2022] GET /identity/v3/users/83ea9963b5114c49bf5399d817b8317b => generated 293 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:35.466986 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d4fdd-ce1c-4aaf-bf62-3301942bf22c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:35.474676 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:35.500366 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44561b5-2b56-4c9f-8186-46ab371fc788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:35.500804 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44561b5-2b56-4c9f-8186-46ab371fc788 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:35.501122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44561b5-2b56-4c9f-8186-46ab371fc788 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:35.501409 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f44561b5-2b56-4c9f-8186-46ab371fc788 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:35.507205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:35.514313 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f44561b5-2b56-4c9f-8186-46ab371fc788 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f44561b5-2b56-4c9f-8186-46ab371fc788 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:35.522102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:35.522970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:35.523736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:35.523736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:35.523736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:35.523736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:35.523736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:35.523736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:35.523736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:35.523736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:35.523736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:35.523736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:35.523736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:35.523736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:35.528731 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 148/281] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:35 2022] GET /identity/v3/roles/reader => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:07:35.530317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44561b5-2b56-4c9f-8186-46ab371fc788 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:35.598491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581d4fdd-ce1c-4aaf-bf62-3301942bf22c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:35.642813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63e28eb8-ae39-404d-b914-97fd19b963cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:35.643468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e28eb8-ae39-404d-b914-97fd19b963cc None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:35.643750 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e28eb8-ae39-404d-b914-97fd19b963cc None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:35.644021 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63e28eb8-ae39-404d-b914-97fd19b963cc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:35.644846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e28eb8-ae39-404d-b914-97fd19b963cc None admin] RBAC: Adding query filter params (role.id=f4ccd6ca72d7486d85d90f7585de12c9, user.id=83ea9963b5114c49bf5399d817b8317b, scope.system=all) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:35.645197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e28eb8-ae39-404d-b914-97fd19b963cc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:35.646618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63e28eb8-ae39-404d-b914-97fd19b963cc None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:35.652475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 134/282] 10.222.0.64 () {56 vars in 1308 bytes} [Thu May 26 18:07:35 2022] GET /identity/v3/role_assignments?user.id=83ea9963b5114c49bf5399d817b8317b&scope.system=all&role.id=f4ccd6ca72d7486d85d90f7585de12c9 => generated 226 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:35.654774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984c46f-1ea7-4e29-b969-9e31ec954088 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:35.654774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984c46f-1ea7-4e29-b969-9e31ec954088 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:35.654774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c984c46f-1ea7-4e29-b969-9e31ec954088 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:35.655497 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 135/283] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:35 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:35.661280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a862a4-a456-4cbd-82b7-5fc6ff5d4aef None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:35.661280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a862a4-a456-4cbd-82b7-5fc6ff5d4aef None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:35.661527 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a862a4-a456-4cbd-82b7-5fc6ff5d4aef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:35.681388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e0a862a4-a456-4cbd-82b7-5fc6ff5d4aef None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:35.682917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e0a862a4-a456-4cbd-82b7-5fc6ff5d4aef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:35.687505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f44561b5-2b56-4c9f-8186-46ab371fc788 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:35.741043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da4987-7126-4d64-bce6-2c5373607804 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:35.742362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da4987-7126-4d64-bce6-2c5373607804 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:35.742910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da4987-7126-4d64-bce6-2c5373607804 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:35.743582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9da4987-7126-4d64-bce6-2c5373607804 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:35.745037 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da4987-7126-4d64-bce6-2c5373607804 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:35.745603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da4987-7126-4d64-bce6-2c5373607804 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:35.747238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9da4987-7126-4d64-bce6-2c5373607804 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:35.762451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 149/284] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:35 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:35.768946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da4987-7126-4d64-bce6-2c5373607804 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:35.771930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 136/285] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:07:35.801944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a862a4-a456-4cbd-82b7-5fc6ff5d4aef None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:35.831332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:35.838299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:35.944095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9da4987-7126-4d64-bce6-2c5373607804 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:35.981154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a862a4-a456-4cbd-82b7-5fc6ff5d4aef None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:36.007719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27913c9e-9cb9-46ef-84e3-2317f08a3e87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:36.010399 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27913c9e-9cb9-46ef-84e3-2317f08a3e87 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:36.011649 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27913c9e-9cb9-46ef-84e3-2317f08a3e87 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:36.012153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27913c9e-9cb9-46ef-84e3-2317f08a3e87 None admin] PATH_INFO: `/v3/users/b7cbbff2598145ed9fea5c5922389984` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:36.014314 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27913c9e-9cb9-46ef-84e3-2317f08a3e87 None admin] RBAC: Authorizing `identity:get_user(user_id=b7cbbff2598145ed9fea5c5922389984)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:36.019249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27913c9e-9cb9-46ef-84e3-2317f08a3e87 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:36.028942 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 150/286] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:35 2022] GET /identity/v3/users/b7cbbff2598145ed9fea5c5922389984 => generated 297 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:36.030776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27913c9e-9cb9-46ef-84e3-2317f08a3e87 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:36.060930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c808593-bb01-4afb-bfe6-864d48ff697f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:36.062552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c808593-bb01-4afb-bfe6-864d48ff697f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:36.064158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c808593-bb01-4afb-bfe6-864d48ff697f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:36.065310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c808593-bb01-4afb-bfe6-864d48ff697f None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:36.087687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c808593-bb01-4afb-bfe6-864d48ff697f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5c808593-bb01-4afb-bfe6-864d48ff697f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:36.106922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:36.107848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:36.108600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:36.108600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:36.108600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:36.108600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:36.108600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:36.108600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:36.108600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:36.108600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:36.108600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:36.108600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:36.108600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:36.108600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:36.108600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 137/287] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:35 2022] GET /identity/v3/roles/member => generated 84 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:36.114130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c808593-bb01-4afb-bfe6-864d48ff697f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:36.178710 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27913c9e-9cb9-46ef-84e3-2317f08a3e87 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:36.193391 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:36.217679 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd09b8-68cd-4dc7-92a4-05146db89bc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:36.218656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd09b8-68cd-4dc7-92a4-05146db89bc9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:36.219038 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd09b8-68cd-4dc7-92a4-05146db89bc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:36.219435 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1fd09b8-68cd-4dc7-92a4-05146db89bc9 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:36.220851 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd09b8-68cd-4dc7-92a4-05146db89bc9 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:36.222433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1fd09b8-68cd-4dc7-92a4-05146db89bc9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:36.229240 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 151/288] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:36 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:36.235096 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd09b8-68cd-4dc7-92a4-05146db89bc9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:36.304227 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:36.329387 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c808593-bb01-4afb-bfe6-864d48ff697f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:36.376191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1fd09b8-68cd-4dc7-92a4-05146db89bc9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:36.412920 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43966701-b37d-4f36-a6e4-ef186b2e262a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:36.413848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43966701-b37d-4f36-a6e4-ef186b2e262a None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:36.414289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43966701-b37d-4f36-a6e4-ef186b2e262a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:36.414576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43966701-b37d-4f36-a6e4-ef186b2e262a None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19/users/b7cbbff2598145ed9fea5c5922389984/roles/9918eec87e3345c2ad6ca136d1e94dd3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:36.417336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43966701-b37d-4f36-a6e4-ef186b2e262a None admin] RBAC: Authorizing `identity:create_grant(project_id=a9a90082c4c1407981192ee9bb7a8e19, user_id=b7cbbff2598145ed9fea5c5922389984, role_id=9918eec87e3345c2ad6ca136d1e94dd3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:36.418778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43966701-b37d-4f36-a6e4-ef186b2e262a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:36.435660 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 152/289] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:07:36 2022] PUT /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19/users/b7cbbff2598145ed9fea5c5922389984/roles/9918eec87e3345c2ad6ca136d1e94dd3 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:36.453053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d23524-4e07-4d78-b7f7-6db5863d119f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:36.453904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d23524-4e07-4d78-b7f7-6db5863d119f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:36.454196 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d23524-4e07-4d78-b7f7-6db5863d119f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:36.454478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16d23524-4e07-4d78-b7f7-6db5863d119f None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:36.455278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d23524-4e07-4d78-b7f7-6db5863d119f None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:36.455660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d23524-4e07-4d78-b7f7-6db5863d119f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:36.457250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16d23524-4e07-4d78-b7f7-6db5863d119f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:36.476420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 138/290] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:36 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:36.483252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43966701-b37d-4f36-a6e4-ef186b2e262a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:36.537360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:36.618906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43966701-b37d-4f36-a6e4-ef186b2e262a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:36.655734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5ed1d-dfe4-4a70-8145-645565c0339a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:36.656632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5ed1d-dfe4-4a70-8145-645565c0339a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:36.656910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5ed1d-dfe4-4a70-8145-645565c0339a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:36.657219 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0b5ed1d-dfe4-4a70-8145-645565c0339a None admin] PATH_INFO: `/v3/users/8d89f735e58042a5b2fddb37f8df5260` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:36.658484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5ed1d-dfe4-4a70-8145-645565c0339a None admin] RBAC: Authorizing `identity:get_user(user_id=8d89f735e58042a5b2fddb37f8df5260)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:36.659950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0b5ed1d-dfe4-4a70-8145-645565c0339a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:36.661734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 153/291] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:36 2022] GET /identity/v3/users/8d89f735e58042a5b2fddb37f8df5260 => generated 297 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:36.667497 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d23524-4e07-4d78-b7f7-6db5863d119f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:36.772114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16d23524-4e07-4d78-b7f7-6db5863d119f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:36.806739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a8c51-86f1-4f4f-a2f6-32ffc82f8fdf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:36.807410 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a8c51-86f1-4f4f-a2f6-32ffc82f8fdf None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:36.807692 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a8c51-86f1-4f4f-a2f6-32ffc82f8fdf None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:36.807969 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b9a8c51-86f1-4f4f-a2f6-32ffc82f8fdf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:36.833817 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:36.884694 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a8c51-86f1-4f4f-a2f6-32ffc82f8fdf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:36.886196 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b9a8c51-86f1-4f4f-a2f6-32ffc82f8fdf None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:36.987721 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 139/292] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:36 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 321 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:36.993705 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5ed1d-dfe4-4a70-8145-645565c0339a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:37.095648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0b5ed1d-dfe4-4a70-8145-645565c0339a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:37.102799 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:37.129980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c12cfde-e08c-41e6-9ce5-2c7184a6e4a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:37.130844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12cfde-e08c-41e6-9ce5-2c7184a6e4a2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:37.131125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12cfde-e08c-41e6-9ce5-2c7184a6e4a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:37.131399 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c12cfde-e08c-41e6-9ce5-2c7184a6e4a2 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:37.132564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12cfde-e08c-41e6-9ce5-2c7184a6e4a2 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:37.134645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c12cfde-e08c-41e6-9ce5-2c7184a6e4a2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:37.136690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 154/293] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:36 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:37.142431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a8c51-86f1-4f4f-a2f6-32ffc82f8fdf None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:37.188735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:37.243841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b9a8c51-86f1-4f4f-a2f6-32ffc82f8fdf None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:37.278047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbbda440-c533-418e-a697-ba5a6a92eeb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:37.278711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbda440-c533-418e-a697-ba5a6a92eeb8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:37.278994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbda440-c533-418e-a697-ba5a6a92eeb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:37.279269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbbda440-c533-418e-a697-ba5a6a92eeb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:37.280096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbda440-c533-418e-a697-ba5a6a92eeb8 None admin] RBAC: Adding query filter params (role.id=f4ccd6ca72d7486d85d90f7585de12c9, scope.project.id=a9a90082c4c1407981192ee9bb7a8e19, user.id=8d89f735e58042a5b2fddb37f8df5260) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:37.280404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbda440-c533-418e-a697-ba5a6a92eeb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:37.281863 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbbda440-c533-418e-a697-ba5a6a92eeb8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:37.288227 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 140/294] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:37 2022] GET /identity/v3/role_assignments?user.id=8d89f735e58042a5b2fddb37f8df5260&scope.project.id=a9a90082c4c1407981192ee9bb7a8e19&role.id=f4ccd6ca72d7486d85d90f7585de12c9 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:38.000669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0a92c-79fd-4362-bb44-61e47518f584 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:38.001208 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0a92c-79fd-4362-bb44-61e47518f584 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:38.001284 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83c0a92c-79fd-4362-bb44-61e47518f584 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:38.002847 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 155/295] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:38.008154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8b656-c1aa-493b-a9f7-51c874dc205e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:38.009534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8b656-c1aa-493b-a9f7-51c874dc205e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:38.010002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8b656-c1aa-493b-a9f7-51c874dc205e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:38.028877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8fd8b656-c1aa-493b-a9f7-51c874dc205e None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:38.030512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8fd8b656-c1aa-493b-a9f7-51c874dc205e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:38.111280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 141/296] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:38.124795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8747889-bc18-4874-a581-c651a746607f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:38.125108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8747889-bc18-4874-a581-c651a746607f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:38.125394 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8747889-bc18-4874-a581-c651a746607f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:38.126884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 156/297] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:38.132250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe78ed4-3006-4e22-b216-d47511dbf5cf None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:38.132769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe78ed4-3006-4e22-b216-d47511dbf5cf None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:38.133297 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe78ed4-3006-4e22-b216-d47511dbf5cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:38.138495 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8747889-bc18-4874-a581-c651a746607f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:38.153089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7fe78ed4-3006-4e22-b216-d47511dbf5cf None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:38.154055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7fe78ed4-3006-4e22-b216-d47511dbf5cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:38.191013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:38.232043 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 142/298] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:38.244459 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd93e97-2d36-4052-9b8b-d364a52b8040 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:38.244724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd93e97-2d36-4052-9b8b-d364a52b8040 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:38.245042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdd93e97-2d36-4052-9b8b-d364a52b8040 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:38.250429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 143/299] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:07:38.252118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94432c11-49a9-4455-9b6a-969172a76230 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:38.252355 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94432c11-49a9-4455-9b6a-969172a76230 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:38.252639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94432c11-49a9-4455-9b6a-969172a76230 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:38.270197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-94432c11-49a9-4455-9b6a-969172a76230 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:38.271374 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-94432c11-49a9-4455-9b6a-969172a76230 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:38.277491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8747889-bc18-4874-a581-c651a746607f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:38.312414 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99da5-d551-47b3-88fb-53f8116e7d96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:38.313292 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99da5-d551-47b3-88fb-53f8116e7d96 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:38.313577 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99da5-d551-47b3-88fb-53f8116e7d96 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:38.313863 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeb99da5-d551-47b3-88fb-53f8116e7d96 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:38.315023 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb99da5-d551-47b3-88fb-53f8116e7d96 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:38.316467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeb99da5-d551-47b3-88fb-53f8116e7d96 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:38.318264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 157/300] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:07:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:38.318860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99da5-d551-47b3-88fb-53f8116e7d96 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:38.360605 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 144/301] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:38.365496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94432c11-49a9-4455-9b6a-969172a76230 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:38.365914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:38.431881 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeb99da5-d551-47b3-88fb-53f8116e7d96 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:38.465313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:38.466430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46269a7-2429-4bba-a000-89e84912b122 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:38.467234 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46269a7-2429-4bba-a000-89e84912b122 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:38.467580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46269a7-2429-4bba-a000-89e84912b122 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:38.467776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d46269a7-2429-4bba-a000-89e84912b122 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:38.469220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94432c11-49a9-4455-9b6a-969172a76230 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:38.479203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d46269a7-2429-4bba-a000-89e84912b122 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d46269a7-2429-4bba-a000-89e84912b122 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:38.486999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:38.487853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:38.492769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:38.492769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:38.492769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:38.492769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:38.492769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:38.492769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:38.492769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:38.492769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:38.492769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:38.492769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:38.492769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:38.492769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:38.492769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 158/302] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:38 2022] GET /identity/v3/roles/member => generated 84 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:38.492769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46269a7-2429-4bba-a000-89e84912b122 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:38.515010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc594a-892b-4393-b0cf-7fcc330755f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:38.515621 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc594a-892b-4393-b0cf-7fcc330755f8 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:38.515910 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc594a-892b-4393-b0cf-7fcc330755f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:38.516189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dbc594a-892b-4393-b0cf-7fcc330755f8 None admin] PATH_INFO: `/v3/groups` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:38.516876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc594a-892b-4393-b0cf-7fcc330755f8 None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:38.518345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dbc594a-892b-4393-b0cf-7fcc330755f8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:38.533230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 145/303] 10.222.0.64 () {60 vars in 1134 bytes} [Thu May 26 18:07:38 2022] POST /identity/v3/groups => generated 229 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:07:38.534041 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc594a-892b-4393-b0cf-7fcc330755f8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:38.607634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:38.611556 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d46269a7-2429-4bba-a000-89e84912b122 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:38.652768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dae0a-2091-471b-a038-4274ce25ab42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:38.653659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dae0a-2091-471b-a038-4274ce25ab42 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:38.653941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dae0a-2091-471b-a038-4274ce25ab42 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:38.654275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d2dae0a-2091-471b-a038-4274ce25ab42 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:38.668453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d2dae0a-2091-471b-a038-4274ce25ab42 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6d2dae0a-2091-471b-a038-4274ce25ab42 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:38.676683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:38.677664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:38.678433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:38.678433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:38.678433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:38.678433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:38.678433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:38.678433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:38.678433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:38.678433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:38.678433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:38.678433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:38.678433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:38.678433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:38.683088 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 159/304] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:38 2022] GET /identity/v3/roles/reader => generated 84 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:38.684595 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dae0a-2091-471b-a038-4274ce25ab42 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:38.701449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dbc594a-892b-4393-b0cf-7fcc330755f8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:38.751161 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b5e4-a2f0-493c-820a-0d6ab81f6554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:38.752401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b5e4-a2f0-493c-820a-0d6ab81f6554 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:38.752696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b5e4-a2f0-493c-820a-0d6ab81f6554 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:38.752977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a11b5e4-a2f0-493c-820a-0d6ab81f6554 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:38.755539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11b5e4-a2f0-493c-820a-0d6ab81f6554 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:38.755539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11b5e4-a2f0-493c-820a-0d6ab81f6554 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:38.757189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a11b5e4-a2f0-493c-820a-0d6ab81f6554 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:38.770622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 146/305] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:38.778232 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b5e4-a2f0-493c-820a-0d6ab81f6554 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:38.810636 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:38.810959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d2dae0a-2091-471b-a038-4274ce25ab42 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:38.857416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593098e-040e-4295-bf22-c6426cd434a7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:38.858521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593098e-040e-4295-bf22-c6426cd434a7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:38.858976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593098e-040e-4295-bf22-c6426cd434a7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:38.859428 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9593098e-040e-4295-bf22-c6426cd434a7 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:38.860342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593098e-040e-4295-bf22-c6426cd434a7 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:38.860822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593098e-040e-4295-bf22-c6426cd434a7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:38.862621 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9593098e-040e-4295-bf22-c6426cd434a7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:38.871822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 160/306] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:38 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:38.878132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593098e-040e-4295-bf22-c6426cd434a7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:38.900436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a11b5e4-a2f0-493c-820a-0d6ab81f6554 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:38.908615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:38.947722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646907fb-5490-4c9f-9284-43614fc0cf28 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:38.950009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646907fb-5490-4c9f-9284-43614fc0cf28 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:38.951160 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646907fb-5490-4c9f-9284-43614fc0cf28 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:38.952233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-646907fb-5490-4c9f-9284-43614fc0cf28 None admin] PATH_INFO: `/v3/users/83ea9963b5114c49bf5399d817b8317b` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:38.955111 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646907fb-5490-4c9f-9284-43614fc0cf28 None admin] RBAC: Authorizing `identity:get_user(user_id=83ea9963b5114c49bf5399d817b8317b)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:38.957715 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-646907fb-5490-4c9f-9284-43614fc0cf28 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:38.960057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 147/307] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:38 2022] GET /identity/v3/users/83ea9963b5114c49bf5399d817b8317b => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:38.970309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646907fb-5490-4c9f-9284-43614fc0cf28 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:39.009371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9593098e-040e-4295-bf22-c6426cd434a7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:39.053098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52facb2e-4876-45be-8317-e502c880e274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:39.054375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52facb2e-4876-45be-8317-e502c880e274 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:39.054740 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52facb2e-4876-45be-8317-e502c880e274 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:39.055094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52facb2e-4876-45be-8317-e502c880e274 None admin] PATH_INFO: `/v3/users/6a6430b18c024c4d815174eda4ab0d66` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:39.073203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52facb2e-4876-45be-8317-e502c880e274 None admin] RBAC: Authorizing `identity:get_user(user_id=6a6430b18c024c4d815174eda4ab0d66)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:39.073772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:39.074931 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52facb2e-4876-45be-8317-e502c880e274 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:39.081072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 161/308] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:38 2022] GET /identity/v3/users/6a6430b18c024c4d815174eda4ab0d66 => generated 293 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:39.081892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-646907fb-5490-4c9f-9284-43614fc0cf28 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:39.084161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52facb2e-4876-45be-8317-e502c880e274 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:39.120620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e24eb950-cd8e-4db1-8d49-7c6296ac46f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:39.121682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eb950-cd8e-4db1-8d49-7c6296ac46f2 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:39.121974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eb950-cd8e-4db1-8d49-7c6296ac46f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:39.122258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e24eb950-cd8e-4db1-8d49-7c6296ac46f2 None admin] PATH_INFO: `/v3/system/users/83ea9963b5114c49bf5399d817b8317b/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:39.123925 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eb950-cd8e-4db1-8d49-7c6296ac46f2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=83ea9963b5114c49bf5399d817b8317b, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:39.125565 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e24eb950-cd8e-4db1-8d49-7c6296ac46f2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:39.141526 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 148/309] 10.222.0.64 () {58 vars in 1334 bytes} [Thu May 26 18:07:38 2022] PUT /identity/v3/system/users/83ea9963b5114c49bf5399d817b8317b/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:39.172890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59454937-0723-4789-9136-7186e19834e8 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:39.173230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59454937-0723-4789-9136-7186e19834e8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:39.173484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59454937-0723-4789-9136-7186e19834e8 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:39.175036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 149/310] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:39.190636 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de02418-6e29-488f-8f00-330092d29eeb None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:39.191878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:39.192327 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de02418-6e29-488f-8f00-330092d29eeb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:39.192837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de02418-6e29-488f-8f00-330092d29eeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:39.206692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52facb2e-4876-45be-8317-e502c880e274 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:39.215766 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9de02418-6e29-488f-8f00-330092d29eeb None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:39.217937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9de02418-6e29-488f-8f00-330092d29eeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:39.250257 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6634d89-58de-4486-8be2-56e0b949375a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:39.251375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6634d89-58de-4486-8be2-56e0b949375a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:39.251666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6634d89-58de-4486-8be2-56e0b949375a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:39.251949 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6634d89-58de-4486-8be2-56e0b949375a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:39.252801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6634d89-58de-4486-8be2-56e0b949375a None admin] RBAC: Adding query filter params (role.id=9918eec87e3345c2ad6ca136d1e94dd3, user.id=6a6430b18c024c4d815174eda4ab0d66, scope.system=all) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:39.253193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6634d89-58de-4486-8be2-56e0b949375a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:39.254807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6634d89-58de-4486-8be2-56e0b949375a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:39.265071 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 162/311] 10.222.0.64 () {56 vars in 1308 bytes} [Thu May 26 18:07:39 2022] GET /identity/v3/role_assignments?user.id=6a6430b18c024c4d815174eda4ab0d66&scope.system=all&role.id=9918eec87e3345c2ad6ca136d1e94dd3 => generated 226 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:39.313176 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 150/312] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:39.336754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6634d89-58de-4486-8be2-56e0b949375a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:39.452488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6634d89-58de-4486-8be2-56e0b949375a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:39.490544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2ec04-6cbb-48c3-9979-58207117cc46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:39.491916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2ec04-6cbb-48c3-9979-58207117cc46 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:39.492421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2ec04-6cbb-48c3-9979-58207117cc46 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:39.492907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a2ec04-6cbb-48c3-9979-58207117cc46 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:39.503608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a2ec04-6cbb-48c3-9979-58207117cc46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-36a2ec04-6cbb-48c3-9979-58207117cc46 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:39.512312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:39.513225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:39.513984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:39.513984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:39.513984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:39.513984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:39.513984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:39.513984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:39.513984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:39.513984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:39.513984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:39.513984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:39.513984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:39.513984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:39.516665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 163/313] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:39 2022] GET /identity/v3/roles/reader => generated 84 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:39.522063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de02418-6e29-488f-8f00-330092d29eeb None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:39.611956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:39.628608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de02418-6e29-488f-8f00-330092d29eeb None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:39.664781 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb986515-3a2e-4a25-b975-55eac88ca591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:39.665520 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb986515-3a2e-4a25-b975-55eac88ca591 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:39.665807 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb986515-3a2e-4a25-b975-55eac88ca591 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:39.666089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb986515-3a2e-4a25-b975-55eac88ca591 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:39.666839 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb986515-3a2e-4a25-b975-55eac88ca591 None admin] RBAC: Adding query filter params (name=reader) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:39.667152 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb986515-3a2e-4a25-b975-55eac88ca591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:39.668538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb986515-3a2e-4a25-b975-55eac88ca591 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:39.677365 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 151/314] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:39 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:39.682615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2ec04-6cbb-48c3-9979-58207117cc46 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:39.686501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:39.792447 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a2ec04-6cbb-48c3-9979-58207117cc46 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:39.827473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8066606-3a1d-41ab-b0da-6ee6a3f7236c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:39.828354 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8066606-3a1d-41ab-b0da-6ee6a3f7236c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:39.828637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8066606-3a1d-41ab-b0da-6ee6a3f7236c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:39.828916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8066606-3a1d-41ab-b0da-6ee6a3f7236c None admin] PATH_INFO: `/v3/users/b7cbbff2598145ed9fea5c5922389984` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:39.830163 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8066606-3a1d-41ab-b0da-6ee6a3f7236c None admin] RBAC: Authorizing `identity:get_user(user_id=b7cbbff2598145ed9fea5c5922389984)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:39.831627 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8066606-3a1d-41ab-b0da-6ee6a3f7236c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:39.833619 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 164/315] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:39 2022] GET /identity/v3/users/b7cbbff2598145ed9fea5c5922389984 => generated 297 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:39.839528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb986515-3a2e-4a25-b975-55eac88ca591 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:39.941335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb986515-3a2e-4a25-b975-55eac88ca591 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:39.981289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525776e-66d3-412f-8d9a-dbfdf905d900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:39.981931 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525776e-66d3-412f-8d9a-dbfdf905d900 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:39.982217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525776e-66d3-412f-8d9a-dbfdf905d900 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:39.982502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9525776e-66d3-412f-8d9a-dbfdf905d900 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:39.999755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:40.054087 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525776e-66d3-412f-8d9a-dbfdf905d900 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:40.055557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9525776e-66d3-412f-8d9a-dbfdf905d900 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:40.157860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 152/316] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:40.163693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8066606-3a1d-41ab-b0da-6ee6a3f7236c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:40.241568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:40.270769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8066606-3a1d-41ab-b0da-6ee6a3f7236c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:40.304933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0124dc67-bc76-4f56-92cd-4f1fa33ced6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:40.306725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124dc67-bc76-4f56-92cd-4f1fa33ced6d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:40.307223 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124dc67-bc76-4f56-92cd-4f1fa33ced6d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:40.307699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0124dc67-bc76-4f56-92cd-4f1fa33ced6d None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:40.309194 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124dc67-bc76-4f56-92cd-4f1fa33ced6d None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:40.310906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0124dc67-bc76-4f56-92cd-4f1fa33ced6d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:40.313150 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 165/317] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:40 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:40.319103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525776e-66d3-412f-8d9a-dbfdf905d900 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:40.366521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:40.423472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9525776e-66d3-412f-8d9a-dbfdf905d900 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:40.458703 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ed8929-961f-415e-b924-23c76b63f56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:40.459735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed8929-961f-415e-b924-23c76b63f56c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:40.460218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed8929-961f-415e-b924-23c76b63f56c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:40.460691 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ed8929-961f-415e-b924-23c76b63f56c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:40.461773 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed8929-961f-415e-b924-23c76b63f56c None admin] RBAC: Adding query filter params (role.id=9918eec87e3345c2ad6ca136d1e94dd3, scope.project.id=a9a90082c4c1407981192ee9bb7a8e19, user.id=b7cbbff2598145ed9fea5c5922389984) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:40.462335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed8929-961f-415e-b924-23c76b63f56c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:40.463987 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ed8929-961f-415e-b924-23c76b63f56c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:40.470595 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 153/318] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:07:40 2022] GET /identity/v3/role_assignments?user.id=b7cbbff2598145ed9fea5c5922389984&scope.project.id=a9a90082c4c1407981192ee9bb7a8e19&role.id=9918eec87e3345c2ad6ca136d1e94dd3 => generated 608 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:40.889309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18c715-0915-4914-b812-b74e8c009c66 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:40.889685 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18c715-0915-4914-b812-b74e8c009c66 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:40.889860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf18c715-0915-4914-b812-b74e8c009c66 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:40.891366 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 166/319] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:40.896302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a3a7c-8dbc-4a91-abf9-d7bd15b61637 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:40.896670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a3a7c-8dbc-4a91-abf9-d7bd15b61637 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:40.897074 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e06a3a7c-8dbc-4a91-abf9-d7bd15b61637 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:40.914129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e06a3a7c-8dbc-4a91-abf9-d7bd15b61637 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:40.915928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e06a3a7c-8dbc-4a91-abf9-d7bd15b61637 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:40.985417 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 154/320] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:41.008465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18c715-0915-4914-b812-b74e8c009c66 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:41.112848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf18c715-0915-4914-b812-b74e8c009c66 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:41.151907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4e16380-fda7-49a6-80b0-5c9424edd6b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:41.152715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16380-fda7-49a6-80b0-5c9424edd6b7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:41.153021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16380-fda7-49a6-80b0-5c9424edd6b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:41.153305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4e16380-fda7-49a6-80b0-5c9424edd6b7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:41.154471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e16380-fda7-49a6-80b0-5c9424edd6b7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:41.155913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4e16380-fda7-49a6-80b0-5c9424edd6b7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:41.162362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 167/321] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:07:41 2022] GET /identity/v3/domains/default => generated 199 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:41.163297 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a3a7c-8dbc-4a91-abf9-d7bd15b61637 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:41.211944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:41.273029 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e06a3a7c-8dbc-4a91-abf9-d7bd15b61637 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:41.309083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c96906d-2f25-4e5d-b404-1e0f62c3aaaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:41.309774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96906d-2f25-4e5d-b404-1e0f62c3aaaa None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:41.310062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96906d-2f25-4e5d-b404-1e0f62c3aaaa None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:41.310339 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c96906d-2f25-4e5d-b404-1e0f62c3aaaa None admin] PATH_INFO: `/v3/groups` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:41.311056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96906d-2f25-4e5d-b404-1e0f62c3aaaa None admin] RBAC: Authorizing `identity:create_group()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:41.312578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c96906d-2f25-4e5d-b404-1e0f62c3aaaa None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:41.337067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 155/322] 10.222.0.64 () {60 vars in 1134 bytes} [Thu May 26 18:07:41 2022] POST /identity/v3/groups => generated 226 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:07:41.510308 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb39bf3-d8a8-4e95-94f4-c7f068211893 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:41.510795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb39bf3-d8a8-4e95-94f4-c7f068211893 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:41.510795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddb39bf3-d8a8-4e95-94f4-c7f068211893 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:41.512161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 168/323] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:41.517784 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d11cd2-f119-41cf-ab65-8600bac2e574 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:41.518074 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d11cd2-f119-41cf-ab65-8600bac2e574 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:41.518352 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d11cd2-f119-41cf-ab65-8600bac2e574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:41.535883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-71d11cd2-f119-41cf-ab65-8600bac2e574 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:41.537392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-71d11cd2-f119-41cf-ab65-8600bac2e574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:41.609231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1103ec3-975f-4c04-bf8a-99430d6e27f5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:41.609857 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1103ec3-975f-4c04-bf8a-99430d6e27f5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:41.610311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 156/324] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:41.610500 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1103ec3-975f-4c04-bf8a-99430d6e27f5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:41.614578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 169/325] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:41 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:41.620178 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80b11-25e6-4450-bb33-c0ea0cd9fac0 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:41.620475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80b11-25e6-4450-bb33-c0ea0cd9fac0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:41.620812 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd80b11-25e6-4450-bb33-c0ea0cd9fac0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:41.633983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1103ec3-975f-4c04-bf8a-99430d6e27f5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:41.638055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7cd80b11-25e6-4450-bb33-c0ea0cd9fac0 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:41.639247 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7cd80b11-25e6-4450-bb33-c0ea0cd9fac0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:41.651123 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:41.664823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:41.725067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 157/326] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:41.742377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd80b11-25e6-4450-bb33-c0ea0cd9fac0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:41.775707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1103ec3-975f-4c04-bf8a-99430d6e27f5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:41.816365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f56d5-786b-4774-bf64-3a58114df838 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:41.817981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f56d5-786b-4774-bf64-3a58114df838 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:41.817981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f56d5-786b-4774-bf64-3a58114df838 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:41.817981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c59f56d5-786b-4774-bf64-3a58114df838 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:41.831947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c59f56d5-786b-4774-bf64-3a58114df838 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c59f56d5-786b-4774-bf64-3a58114df838 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:41.841158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:41.842035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:41.842808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:41.842808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:41.842808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:41.842808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:41.842808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:41.842808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:41.842808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:41.842808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:41.842808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:41.842808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:41.842808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:41.842808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:41.842808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 170/327] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:41.851614 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f56d5-786b-4774-bf64-3a58114df838 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:41.873912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd80b11-25e6-4450-bb33-c0ea0cd9fac0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:41.921292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec49a0-a527-4498-8ad1-4170e9590fc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:41.922106 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec49a0-a527-4498-8ad1-4170e9590fc7 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:41.922586 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec49a0-a527-4498-8ad1-4170e9590fc7 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:41.922886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fec49a0-a527-4498-8ad1-4170e9590fc7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:41.938069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fec49a0-a527-4498-8ad1-4170e9590fc7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:41.943858 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5fec49a0-a527-4498-8ad1-4170e9590fc7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:41.946083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:41.947472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:41.948403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:41.948403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:41.948403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:41.948403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:41.948403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:41.948403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:41.948403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:41.948403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:41.948403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:41.948403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:41.948403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:41.948403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:41.948403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 158/328] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:41 2022] GET /identity/v3/roles/reader => generated 84 bytes in 206 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:41.954025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec49a0-a527-4498-8ad1-4170e9590fc7 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:41.984311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:41.992688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c59f56d5-786b-4774-bf64-3a58114df838 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:42.037798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44c7c4-6df3-47df-8362-1e1c82667f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:42.039000 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44c7c4-6df3-47df-8362-1e1c82667f06 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:42.039842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44c7c4-6df3-47df-8362-1e1c82667f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:42.041128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc44c7c4-6df3-47df-8362-1e1c82667f06 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:42.042049 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44c7c4-6df3-47df-8362-1e1c82667f06 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:42.042501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44c7c4-6df3-47df-8362-1e1c82667f06 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:42.044065 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc44c7c4-6df3-47df-8362-1e1c82667f06 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:42.057751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 171/329] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:41 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:42.066384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44c7c4-6df3-47df-8362-1e1c82667f06 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:42.098632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fec49a0-a527-4498-8ad1-4170e9590fc7 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:42.149613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb158f-b7e2-4e7e-87c4-a0902b31e29f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:42.151218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb158f-b7e2-4e7e-87c4-a0902b31e29f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:42.152020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb158f-b7e2-4e7e-87c4-a0902b31e29f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:42.152762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb158f-b7e2-4e7e-87c4-a0902b31e29f None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:42.153930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb158f-b7e2-4e7e-87c4-a0902b31e29f None admin] RBAC: Adding query filter params (name=reader) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:42.154767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb158f-b7e2-4e7e-87c4-a0902b31e29f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:42.156633 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb158f-b7e2-4e7e-87c4-a0902b31e29f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:42.168719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 159/330] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:41 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:42.178073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb158f-b7e2-4e7e-87c4-a0902b31e29f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:42.222115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc44c7c4-6df3-47df-8362-1e1c82667f06 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:42.277346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:42.289041 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bf234-3b2b-4c18-8803-3ba44f229617 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:42.289860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bf234-3b2b-4c18-8803-3ba44f229617 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:42.290146 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bf234-3b2b-4c18-8803-3ba44f229617 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:42.290471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-405bf234-3b2b-4c18-8803-3ba44f229617 None admin] PATH_INFO: `/v3/users/83ea9963b5114c49bf5399d817b8317b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:42.294039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bf234-3b2b-4c18-8803-3ba44f229617 None admin] RBAC: Authorizing `identity:get_user(user_id=83ea9963b5114c49bf5399d817b8317b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:42.301578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-405bf234-3b2b-4c18-8803-3ba44f229617 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:42.303675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 172/331] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:42 2022] GET /identity/v3/users/83ea9963b5114c49bf5399d817b8317b => generated 293 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:42.309895 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bf234-3b2b-4c18-8803-3ba44f229617 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:42.321330 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:42.347289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb158f-b7e2-4e7e-87c4-a0902b31e29f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:42.387033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1d750-d209-4883-9822-9b9d35db5c86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:42.388580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1d750-d209-4883-9822-9b9d35db5c86 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:42.388872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1d750-d209-4883-9822-9b9d35db5c86 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:42.389470 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4c1d750-d209-4883-9822-9b9d35db5c86 None admin] PATH_INFO: `/v3/users/6a6430b18c024c4d815174eda4ab0d66` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:42.390684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1d750-d209-4883-9822-9b9d35db5c86 None admin] RBAC: Authorizing `identity:get_user(user_id=6a6430b18c024c4d815174eda4ab0d66)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:42.393307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4c1d750-d209-4883-9822-9b9d35db5c86 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:42.395307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 160/332] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:42 2022] GET /identity/v3/users/6a6430b18c024c4d815174eda4ab0d66 => generated 293 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:42.401273 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1d750-d209-4883-9822-9b9d35db5c86 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:42.436708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-405bf234-3b2b-4c18-8803-3ba44f229617 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:42.495235 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93043a2-bb51-47fb-bd67-7aca724757bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:42.496013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93043a2-bb51-47fb-bd67-7aca724757bb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:42.496364 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93043a2-bb51-47fb-bd67-7aca724757bb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:42.496707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93043a2-bb51-47fb-bd67-7aca724757bb None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:42.497925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93043a2-bb51-47fb-bd67-7aca724757bb None admin] RBAC: Adding query filter params (role.id=f4ccd6ca72d7486d85d90f7585de12c9, user.id=83ea9963b5114c49bf5399d817b8317b, scope.system=all) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:42.498303 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93043a2-bb51-47fb-bd67-7aca724757bb None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:42.500468 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a93043a2-bb51-47fb-bd67-7aca724757bb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:42.516261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 173/333] 10.222.0.64 () {56 vars in 1308 bytes} [Thu May 26 18:07:42 2022] GET /identity/v3/role_assignments?user.id=83ea9963b5114c49bf5399d817b8317b&scope.system=all&role.id=f4ccd6ca72d7486d85d90f7585de12c9 => generated 510 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:42.555353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4c1d750-d209-4883-9822-9b9d35db5c86 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:42.596913 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10c1abc1-2f75-429d-b94f-0f577b667b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:42.597889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1abc1-2f75-429d-b94f-0f577b667b3f None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:42.598181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1abc1-2f75-429d-b94f-0f577b667b3f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:42.598460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10c1abc1-2f75-429d-b94f-0f577b667b3f None admin] PATH_INFO: `/v3/system/users/6a6430b18c024c4d815174eda4ab0d66/roles/9918eec87e3345c2ad6ca136d1e94dd3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:42.601558 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1abc1-2f75-429d-b94f-0f577b667b3f None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=6a6430b18c024c4d815174eda4ab0d66, role_id=9918eec87e3345c2ad6ca136d1e94dd3)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:42.603411 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10c1abc1-2f75-429d-b94f-0f577b667b3f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:42.626713 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 161/334] 10.222.0.64 () {58 vars in 1334 bytes} [Thu May 26 18:07:42 2022] PUT /identity/v3/system/users/6a6430b18c024c4d815174eda4ab0d66/roles/9918eec87e3345c2ad6ca136d1e94dd3 => generated 0 bytes in 226 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:07:43.935847 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fd9ea-a117-4782-88e8-9016eaa288e8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:43.936367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fd9ea-a117-4782-88e8-9016eaa288e8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:43.936475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b31fd9ea-a117-4782-88e8-9016eaa288e8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:43.937914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 174/335] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:43.943290 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d008-bc5f-4f93-90dc-eca44eebfc11 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:43.943698 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d008-bc5f-4f93-90dc-eca44eebfc11 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:43.943858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e116d008-bc5f-4f93-90dc-eca44eebfc11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:43.966045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e116d008-bc5f-4f93-90dc-eca44eebfc11 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:43.967243 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e116d008-bc5f-4f93-90dc-eca44eebfc11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:43.977566 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:44.052599 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 162/336] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:44.095734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fd9ea-a117-4782-88e8-9016eaa288e8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:44.175607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:44.230749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b31fd9ea-a117-4782-88e8-9016eaa288e8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:44.277292 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c8afb-afd2-435a-aa5d-5e79a8612880 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:44.278108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c8afb-afd2-435a-aa5d-5e79a8612880 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:44.278396 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c8afb-afd2-435a-aa5d-5e79a8612880 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:44.278676 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78c8afb-afd2-435a-aa5d-5e79a8612880 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:44.290367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78c8afb-afd2-435a-aa5d-5e79a8612880 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a78c8afb-afd2-435a-aa5d-5e79a8612880 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:44.302494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:44.303395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:44.304183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:44.304183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:44.304183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:44.304183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:44.304183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:44.304183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:44.304183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:44.304183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:44.304183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:44.304183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:44.304183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:44.304183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:44.304183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 175/337] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:44 2022] GET /identity/v3/roles/member => generated 84 bytes in 209 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:44.309997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116d008-bc5f-4f93-90dc-eca44eebfc11 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:44.463075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e116d008-bc5f-4f93-90dc-eca44eebfc11 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:44.506044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd120b-ec3a-4536-90c5-42ce1c7856c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:44.507050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd120b-ec3a-4536-90c5-42ce1c7856c1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:44.507534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd120b-ec3a-4536-90c5-42ce1c7856c1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:44.508026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40cd120b-ec3a-4536-90c5-42ce1c7856c1 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:44.508969 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd120b-ec3a-4536-90c5-42ce1c7856c1 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:44.509542 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd120b-ec3a-4536-90c5-42ce1c7856c1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:44.511117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40cd120b-ec3a-4536-90c5-42ce1c7856c1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:44.520382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 163/338] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:44.525524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c8afb-afd2-435a-aa5d-5e79a8612880 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:44.652583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78c8afb-afd2-435a-aa5d-5e79a8612880 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:44.682636 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:44.700447 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800cc60a-17c0-42d1-9b81-ccc74005a680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:44.701147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cc60a-17c0-42d1-9b81-ccc74005a680 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:44.701819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cc60a-17c0-42d1-9b81-ccc74005a680 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:44.702111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800cc60a-17c0-42d1-9b81-ccc74005a680 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:44.778084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cc60a-17c0-42d1-9b81-ccc74005a680 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:44.779473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-800cc60a-17c0-42d1-9b81-ccc74005a680 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:44.899913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 176/339] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:44 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 375 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:44.906908 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd120b-ec3a-4536-90c5-42ce1c7856c1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:44.920560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:45.039090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507ad8c-8929-4a9f-a7e2-b81cf8df09d3 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:45.039577 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507ad8c-8929-4a9f-a7e2-b81cf8df09d3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:45.039577 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f507ad8c-8929-4a9f-a7e2-b81cf8df09d3 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:45.044665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 177/340] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:45.050405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb6017-c79b-4830-8935-651da0748640 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:45.050698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb6017-c79b-4830-8935-651da0748640 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:45.050991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79fb6017-c79b-4830-8935-651da0748640 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:45.067708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40cd120b-ec3a-4536-90c5-42ce1c7856c1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:45.077470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-79fb6017-c79b-4830-8935-651da0748640 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:45.078674 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-79fb6017-c79b-4830-8935-651da0748640 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:45.091666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:45.127106 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53426e52-0e9e-4b4a-9d51-44cca23f744e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:45.128330 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53426e52-0e9e-4b4a-9d51-44cca23f744e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:45.128805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53426e52-0e9e-4b4a-9d51-44cca23f744e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:45.130742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53426e52-0e9e-4b4a-9d51-44cca23f744e None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:45.133129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53426e52-0e9e-4b4a-9d51-44cca23f744e None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:45.140567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53426e52-0e9e-4b4a-9d51-44cca23f744e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:45.143202 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 164/341] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:44 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:45.149434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53426e52-0e9e-4b4a-9d51-44cca23f744e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:45.226742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 178/342] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:45.235259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:45.262484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53426e52-0e9e-4b4a-9d51-44cca23f744e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:45.270419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb6017-c79b-4830-8935-651da0748640 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:45.301594 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc4cd5-d4fb-4310-b99f-b968101a18db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:45.302814 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc4cd5-d4fb-4310-b99f-b968101a18db None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:45.303287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc4cd5-d4fb-4310-b99f-b968101a18db None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:45.303748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1efc4cd5-d4fb-4310-b99f-b968101a18db None admin] PATH_INFO: `/v3/groups/1ca7eeaace04437a81da6f9b9d341782` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:45.311390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc4cd5-d4fb-4310-b99f-b968101a18db None admin] RBAC: Authorizing `identity:get_group(group_id=1ca7eeaace04437a81da6f9b9d341782)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:45.313491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1efc4cd5-d4fb-4310-b99f-b968101a18db None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:45.316278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 165/343] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:45 2022] GET /identity/v3/groups/1ca7eeaace04437a81da6f9b9d341782 => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:45.322911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc4cd5-d4fb-4310-b99f-b968101a18db None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:45.436793 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1efc4cd5-d4fb-4310-b99f-b968101a18db None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:45.456447 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79fb6017-c79b-4830-8935-651da0748640 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:45.478310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4d34a92-6933-44db-9c19-cf23ce6f88a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:45.479642 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34a92-6933-44db-9c19-cf23ce6f88a3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:45.480286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34a92-6933-44db-9c19-cf23ce6f88a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:45.482103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4d34a92-6933-44db-9c19-cf23ce6f88a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:45.484118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d34a92-6933-44db-9c19-cf23ce6f88a3 None admin] RBAC: Adding query filter params (group.id=1ca7eeaace04437a81da6f9b9d341782, role.id=f4ccd6ca72d7486d85d90f7585de12c9, scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:45.484845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d34a92-6933-44db-9c19-cf23ce6f88a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:45.487279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4d34a92-6933-44db-9c19-cf23ce6f88a3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:45.499417 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 166/344] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 26 18:07:45 2022] GET /identity/v3/role_assignments?group.id=1ca7eeaace04437a81da6f9b9d341782&scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14&role.id=f4ccd6ca72d7486d85d90f7585de12c9 => generated 260 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:45.502325 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669faa-1692-4211-b322-6343e9d10148 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:45.504251 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669faa-1692-4211-b322-6343e9d10148 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:45.505590 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2669faa-1692-4211-b322-6343e9d10148 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:45.508010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 167/345] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:45.515536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e940ac-4788-40cc-95fa-085f11a75e11 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:45.516132 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e940ac-4788-40cc-95fa-085f11a75e11 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:45.516694 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5e940ac-4788-40cc-95fa-085f11a75e11 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:45.525412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:45.530842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ec833-c6e9-484a-9f48-e283b161d26d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:45.533077 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ec833-c6e9-484a-9f48-e283b161d26d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:45.533077 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ec833-c6e9-484a-9f48-e283b161d26d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:45.533077 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-157ec833-c6e9-484a-9f48-e283b161d26d None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:45.547093 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b5e940ac-4788-40cc-95fa-085f11a75e11 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:45.551829 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b5e940ac-4788-40cc-95fa-085f11a75e11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:45.559820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-157ec833-c6e9-484a-9f48-e283b161d26d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-157ec833-c6e9-484a-9f48-e283b161d26d None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:45.577662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:45.578613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:45.579398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:45.579398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:45.579398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:45.579398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:45.579398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:45.579398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:45.579398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:45.579398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:45.579398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:45.579398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:45.579398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:45.579398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:45.582261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 179/346] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:07:45 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 312 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:07:45.584894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ec833-c6e9-484a-9f48-e283b161d26d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:45.605201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:45.699388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 168/347] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:45 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:07:45.733939 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e940ac-4788-40cc-95fa-085f11a75e11 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:45.803479 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-157ec833-c6e9-484a-9f48-e283b161d26d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:45.881026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5e940ac-4788-40cc-95fa-085f11a75e11 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:45.895118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57968c8b-350d-49b7-817b-e1f90c607166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:45.895801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57968c8b-350d-49b7-817b-e1f90c607166 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:45.896084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57968c8b-350d-49b7-817b-e1f90c607166 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:45.896361 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57968c8b-350d-49b7-817b-e1f90c607166 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:45.897134 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57968c8b-350d-49b7-817b-e1f90c607166 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:45.897441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57968c8b-350d-49b7-817b-e1f90c607166 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:45.898826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57968c8b-350d-49b7-817b-e1f90c607166 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:45.914092 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 180/348] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:07:45 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 329 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:45.919761 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:45.923415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57968c8b-350d-49b7-817b-e1f90c607166 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:45.926301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481e095-e544-49f6-8b9b-fb144805674b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:45.927120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481e095-e544-49f6-8b9b-fb144805674b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:45.927404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481e095-e544-49f6-8b9b-fb144805674b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:45.927687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8481e095-e544-49f6-8b9b-fb144805674b None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:45.943830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8481e095-e544-49f6-8b9b-fb144805674b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-8481e095-e544-49f6-8b9b-fb144805674b None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:45.956108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:45.957188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:45.958010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:45.958010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:45.958010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:45.958010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:45.958010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:45.958010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:45.958010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:45.958010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:45.958010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:45.958010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:45.958010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:45.958010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:45.961581 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 169/349] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:45 2022] GET /identity/v3/roles/member => generated 84 bytes in 228 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:07:45.966687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481e095-e544-49f6-8b9b-fb144805674b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:46.069924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:46.100292 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57968c8b-350d-49b7-817b-e1f90c607166 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:46.115583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8481e095-e544-49f6-8b9b-fb144805674b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:46.167788 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f389fe2d-8040-4696-ae18-9e817f9101e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:46.168846 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389fe2d-8040-4696-ae18-9e817f9101e8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:46.169363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389fe2d-8040-4696-ae18-9e817f9101e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:46.169859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f389fe2d-8040-4696-ae18-9e817f9101e8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:46.189031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57ba698-027a-4eca-ab05-30628ec23315 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:46.189031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ba698-027a-4eca-ab05-30628ec23315 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:46.189031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ba698-027a-4eca-ab05-30628ec23315 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:46.189031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57ba698-027a-4eca-ab05-30628ec23315 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:46.189443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ba698-027a-4eca-ab05-30628ec23315 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:46.189443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ba698-027a-4eca-ab05-30628ec23315 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:46.189443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57ba698-027a-4eca-ab05-30628ec23315 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:46.201777 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 170/350] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:45 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:46.203477 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b7aea-e0a8-4c66-8fa8-a7e999d9e256 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:46.203774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b7aea-e0a8-4c66-8fa8-a7e999d9e256 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:46.204056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-395b7aea-e0a8-4c66-8fa8-a7e999d9e256 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:46.207563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 171/351] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:46.212608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b7aea-e0a8-4c66-8fa8-a7e999d9e256 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:46.288296 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389fe2d-8040-4696-ae18-9e817f9101e8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:46.289779 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f389fe2d-8040-4696-ae18-9e817f9101e8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:46.302783 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:46.369305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:46.378362 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-395b7aea-e0a8-4c66-8fa8-a7e999d9e256 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:46.408243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 181/352] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 485 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 18:07:46.409771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d910e-e7a6-4484-9fcf-a215c8d609ac None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:46.410053 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d910e-e7a6-4484-9fcf-a215c8d609ac None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:46.410326 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2d910e-e7a6-4484-9fcf-a215c8d609ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:46.432334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fc2d910e-e7a6-4484-9fcf-a215c8d609ac None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:46.433765 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fc2d910e-e7a6-4484-9fcf-a215c8d609ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:46.454829 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ede784-b1ef-438f-80d5-3b416ee86316 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:46.455503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ede784-b1ef-438f-80d5-3b416ee86316 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:46.455789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ede784-b1ef-438f-80d5-3b416ee86316 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:46.456070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ede784-b1ef-438f-80d5-3b416ee86316 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:46.535604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 182/353] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:46.536535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d910e-e7a6-4484-9fcf-a215c8d609ac None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:46.588186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ede784-b1ef-438f-80d5-3b416ee86316 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:46.590252 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ede784-b1ef-438f-80d5-3b416ee86316 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:46.656544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:46.667213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:46.671594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2d910e-e7a6-4484-9fcf-a215c8d609ac None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:46.705204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 172/354] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:46 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 493 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:46.708083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847928-6395-412f-bcd4-7ec0972d8cec None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:46.708448 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847928-6395-412f-bcd4-7ec0972d8cec None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:46.708820 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06847928-6395-412f-bcd4-7ec0972d8cec None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:46.710493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 173/355] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:46.711513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06847928-6395-412f-bcd4-7ec0972d8cec None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:46.717723 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0964f4b1-296c-482e-ab93-e0b40af81634 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:46.718590 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964f4b1-296c-482e-ab93-e0b40af81634 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:46.718873 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964f4b1-296c-482e-ab93-e0b40af81634 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:46.719155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0964f4b1-296c-482e-ab93-e0b40af81634 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:46.720368 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964f4b1-296c-482e-ab93-e0b40af81634 None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:46.721962 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0964f4b1-296c-482e-ab93-e0b40af81634 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:46.723791 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 183/356] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:46 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:46.725028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680e92d-4fe6-43d1-b4c0-bd4654d5914b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:46.725336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680e92d-4fe6-43d1-b4c0-bd4654d5914b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:46.725611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f680e92d-4fe6-43d1-b4c0-bd4654d5914b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:46.726848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 184/357] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:46.727538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680e92d-4fe6-43d1-b4c0-bd4654d5914b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:46.845323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06847928-6395-412f-bcd4-7ec0972d8cec None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:46.858443 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f680e92d-4fe6-43d1-b4c0-bd4654d5914b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:46.886890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d7a64-d517-414c-9de7-82c2190fd61a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:46.887736 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d7a64-d517-414c-9de7-82c2190fd61a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:46.888020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d7a64-d517-414c-9de7-82c2190fd61a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:46.888299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-642d7a64-d517-414c-9de7-82c2190fd61a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:46.897673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37d52d4c-9d48-4354-bd94-ee63887cfdd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:46.898852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d52d4c-9d48-4354-bd94-ee63887cfdd6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:46.899330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d52d4c-9d48-4354-bd94-ee63887cfdd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:46.899793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37d52d4c-9d48-4354-bd94-ee63887cfdd6 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:46.900696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-642d7a64-d517-414c-9de7-82c2190fd61a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:46.901420 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d52d4c-9d48-4354-bd94-ee63887cfdd6 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:46.903044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37d52d4c-9d48-4354-bd94-ee63887cfdd6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:46.905267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 185/358] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:46 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:46.906708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec68a-58cd-4607-8559-636592f9e6f3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:46.907185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec68a-58cd-4607-8559-636592f9e6f3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:46.907654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ccec68a-58cd-4607-8559-636592f9e6f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-642d7a64-d517-414c-9de7-82c2190fd61a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:46.909983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:46.910850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:46.911618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:46.911618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:46.911618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:46.911618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:46.911618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:46.911618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:46.911618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:46.911618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:46.911618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:46.911618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:46.911618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:46.911618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:46.911618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 174/359] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:07:46 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:46.912260 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d7a64-d517-414c-9de7-82c2190fd61a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:46.930109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:46.930436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6ccec68a-58cd-4607-8559-636592f9e6f3 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:46.932465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6ccec68a-58cd-4607-8559-636592f9e6f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:46.968046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:47.020749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 186/360] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:47.022076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cd33b-08cb-4217-b3f7-aad3d85fcb54 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:47.022369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cd33b-08cb-4217-b3f7-aad3d85fcb54 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:47.022652 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34cd33b-08cb-4217-b3f7-aad3d85fcb54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:47.042082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a34cd33b-08cb-4217-b3f7-aad3d85fcb54 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:47.043278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a34cd33b-08cb-4217-b3f7-aad3d85fcb54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:47.059519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-642d7a64-d517-414c-9de7-82c2190fd61a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:47.101819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c12be-980f-4269-b05a-5fd8854c3003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:47.103051 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c12be-980f-4269-b05a-5fd8854c3003 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:47.104146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c12be-980f-4269-b05a-5fd8854c3003 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:47.104555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-168c12be-980f-4269-b05a-5fd8854c3003 None admin] PATH_INFO: `/v3/groups/1ca7eeaace04437a81da6f9b9d341782` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:47.105786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c12be-980f-4269-b05a-5fd8854c3003 None admin] RBAC: Authorizing `identity:get_group(group_id=1ca7eeaace04437a81da6f9b9d341782)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:47.107303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-168c12be-980f-4269-b05a-5fd8854c3003 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:47.109425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 175/361] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:46 2022] GET /identity/v3/groups/1ca7eeaace04437a81da6f9b9d341782 => generated 226 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:47.110265 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c12be-980f-4269-b05a-5fd8854c3003 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:47.126421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 187/362] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:47.127815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cd33b-08cb-4217-b3f7-aad3d85fcb54 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:47.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:47.253213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:47.262404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a34cd33b-08cb-4217-b3f7-aad3d85fcb54 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:47.269401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-168c12be-980f-4269-b05a-5fd8854c3003 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:47.311871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a066100-ba1e-4d91-a613-a654eec7961a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:47.312923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a066100-ba1e-4d91-a613-a654eec7961a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:47.313349 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48200833-3ae8-41a0-85be-db436f271106 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:47.313748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a066100-ba1e-4d91-a613-a654eec7961a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:47.315012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48200833-3ae8-41a0-85be-db436f271106 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:47.315012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48200833-3ae8-41a0-85be-db436f271106 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:47.315012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48200833-3ae8-41a0-85be-db436f271106 None admin] PATH_INFO: `/v3/groups/1ca7eeaace04437a81da6f9b9d341782` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:47.315381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a066100-ba1e-4d91-a613-a654eec7961a None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:47.316055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48200833-3ae8-41a0-85be-db436f271106 None admin] RBAC: Authorizing `identity:get_group(group_id=1ca7eeaace04437a81da6f9b9d341782)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:47.316510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a066100-ba1e-4d91-a613-a654eec7961a None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:47.317014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a066100-ba1e-4d91-a613-a654eec7961a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:47.317790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48200833-3ae8-41a0-85be-db436f271106 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:47.318594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a066100-ba1e-4d91-a613-a654eec7961a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:47.319712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 176/363] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:47 2022] GET /identity/v3/groups/1ca7eeaace04437a81da6f9b9d341782 => generated 226 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:47.320478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48200833-3ae8-41a0-85be-db436f271106 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:47.329341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 188/364] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:07:47 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:47.330536 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a066100-ba1e-4d91-a613-a654eec7961a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:47.445303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48200833-3ae8-41a0-85be-db436f271106 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:47.462573 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a066100-ba1e-4d91-a613-a654eec7961a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:47.489903 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac87586-c260-488b-bb2d-8c54e07d3394 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:47.490698 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac87586-c260-488b-bb2d-8c54e07d3394 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:47.490976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac87586-c260-488b-bb2d-8c54e07d3394 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:47.491252 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fac87586-c260-488b-bb2d-8c54e07d3394 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:47.504562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fac87586-c260-488b-bb2d-8c54e07d3394 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:47.506946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e3417-8311-4e30-9f14-e0c86ff5b73f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:47.507287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e3417-8311-4e30-9f14-e0c86ff5b73f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:47.507570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e3417-8311-4e30-9f14-e0c86ff5b73f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:47.509474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae2e3417-8311-4e30-9f14-e0c86ff5b73f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:47.509474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e3417-8311-4e30-9f14-e0c86ff5b73f None admin] RBAC: Adding query filter params (group.id=1ca7eeaace04437a81da6f9b9d341782, role.id=1b7e8aa514f04cef9c1da777642b34a8, scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:47.509474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e3417-8311-4e30-9f14-e0c86ff5b73f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:47.511904 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae2e3417-8311-4e30-9f14-e0c86ff5b73f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-fac87586-c260-488b-bb2d-8c54e07d3394 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:47.515630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:47.516488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:47.517285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:47.517285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:47.517285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:47.517285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:47.517285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:47.517285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:47.517285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:47.517285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:47.517285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:47.517285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:47.517285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. May 26 18:07:47.517285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:47.517285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 177/365] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:47 2022] GET /identity/v3/roles/reader => generated 84 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:47.517285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac87586-c260-488b-bb2d-8c54e07d3394 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:47.526493 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 189/366] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 26 18:07:47 2022] GET /identity/v3/role_assignments?group.id=1ca7eeaace04437a81da6f9b9d341782&scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14&role.id=1b7e8aa514f04cef9c1da777642b34a8 => generated 260 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:47.526493 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e3417-8311-4e30-9f14-e0c86ff5b73f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:47.543189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:47.558060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:47.665602 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae2e3417-8311-4e30-9f14-e0c86ff5b73f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:47.675542 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fac87586-c260-488b-bb2d-8c54e07d3394 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:47.711939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa578f2-e13c-4e33-9953-941af6445303 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:47.712610 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa578f2-e13c-4e33-9953-941af6445303 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:47.713489 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa578f2-e13c-4e33-9953-941af6445303 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:47.713770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa578f2-e13c-4e33-9953-941af6445303 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:47.714618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa578f2-e13c-4e33-9953-941af6445303 None admin] RBAC: Adding query filter params (group.id=1ca7eeaace04437a81da6f9b9d341782, role.id=f4ccd6ca72d7486d85d90f7585de12c9, scope.project.id=a9a90082c4c1407981192ee9bb7a8e19) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:47.714940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa578f2-e13c-4e33-9953-941af6445303 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:47.716397 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa578f2-e13c-4e33-9953-941af6445303 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:47.717724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6d64b-f0fe-4565-8b31-9dd4d2ea2028 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:47.718538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6d64b-f0fe-4565-8b31-9dd4d2ea2028 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:47.718827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6d64b-f0fe-4565-8b31-9dd4d2ea2028 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:47.719104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74f6d64b-f0fe-4565-8b31-9dd4d2ea2028 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:47.722894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 190/367] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 26 18:07:47 2022] GET /identity/v3/role_assignments?group.id=1ca7eeaace04437a81da6f9b9d341782&scope.project.id=a9a90082c4c1407981192ee9bb7a8e19&role.id=f4ccd6ca72d7486d85d90f7585de12c9 => generated 260 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:47.723949 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa578f2-e13c-4e33-9953-941af6445303 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:47.732244 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74f6d64b-f0fe-4565-8b31-9dd4d2ea2028 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-74f6d64b-f0fe-4565-8b31-9dd4d2ea2028 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:47.742510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:47.745277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:47.747278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:47.747278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:47.747278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:47.747278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:47.747278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:47.747278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:47.747278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:47.747278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:47.747278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:47.747278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:47.747278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:47.747278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:47.747278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 178/368] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:07:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:47.747278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6d64b-f0fe-4565-8b31-9dd4d2ea2028 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:47.826812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:47.827502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:47.853160 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa578f2-e13c-4e33-9953-941af6445303 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:47.866231 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74f6d64b-f0fe-4565-8b31-9dd4d2ea2028 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:47.900475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeba25-0403-453a-b86d-0574bd16246d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:47.901428 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeba25-0403-453a-b86d-0574bd16246d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:47.901718 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeba25-0403-453a-b86d-0574bd16246d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:47.902243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ecfeba25-0403-453a-b86d-0574bd16246d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:47.908327 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78590d46-2402-4810-ad0c-55f4f2ee845d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:47.909017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78590d46-2402-4810-ad0c-55f4f2ee845d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:47.909324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78590d46-2402-4810-ad0c-55f4f2ee845d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:47.909601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78590d46-2402-4810-ad0c-55f4f2ee845d None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:47.910357 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78590d46-2402-4810-ad0c-55f4f2ee845d None admin] RBAC: Adding query filter params (name=reader) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:47.910667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78590d46-2402-4810-ad0c-55f4f2ee845d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:47.912155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78590d46-2402-4810-ad0c-55f4f2ee845d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:47.924156 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 179/369] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:47 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:47.925034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78590d46-2402-4810-ad0c-55f4f2ee845d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:47.992542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfeba25-0403-453a-b86d-0574bd16246d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:47.994748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ecfeba25-0403-453a-b86d-0574bd16246d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:48.053573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78590d46-2402-4810-ad0c-55f4f2ee845d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:48.090018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:48.100270 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ef963-3ebd-44f7-b703-e46c4feb3dfd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:48.101014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ef963-3ebd-44f7-b703-e46c4feb3dfd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:48.101307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ef963-3ebd-44f7-b703-e46c4feb3dfd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:48.101586 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6ef963-3ebd-44f7-b703-e46c4feb3dfd None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:48.102345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ef963-3ebd-44f7-b703-e46c4feb3dfd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:48.102656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ef963-3ebd-44f7-b703-e46c4feb3dfd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:48.104823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6ef963-3ebd-44f7-b703-e46c4feb3dfd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:48.107720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:48.114362 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 180/370] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:48.116248 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ef963-3ebd-44f7-b703-e46c4feb3dfd None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:48.128789 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 191/371] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:47 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:48.130250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeba25-0403-453a-b86d-0574bd16246d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:48.254781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ecfeba25-0403-453a-b86d-0574bd16246d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:48.260789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6ef963-3ebd-44f7-b703-e46c4feb3dfd None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:48.303059 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e3db0-46db-4f12-b547-072daa6890b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:48.304152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e3db0-46db-4f12-b547-072daa6890b9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:48.304706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e3db0-46db-4f12-b547-072daa6890b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:48.305288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-471e3db0-46db-4f12-b547-072daa6890b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:48.312490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63e137-ad78-4eb0-9a40-100ebc61513a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:48.314831 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63e137-ad78-4eb0-9a40-100ebc61513a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:48.315125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63e137-ad78-4eb0-9a40-100ebc61513a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:48.315413 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b63e137-ad78-4eb0-9a40-100ebc61513a None admin] PATH_INFO: `/v3/users/6a6430b18c024c4d815174eda4ab0d66` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:48.316665 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63e137-ad78-4eb0-9a40-100ebc61513a None admin] RBAC: Authorizing `identity:get_user(user_id=6a6430b18c024c4d815174eda4ab0d66)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:48.318173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b63e137-ad78-4eb0-9a40-100ebc61513a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:48.319871 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 181/372] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:07:48 2022] GET /identity/v3/users/6a6430b18c024c4d815174eda4ab0d66 => generated 293 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:48.320789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63e137-ad78-4eb0-9a40-100ebc61513a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:48.387899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:48.404356 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e3db0-46db-4f12-b547-072daa6890b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:48.404534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:48.406324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-471e3db0-46db-4f12-b547-072daa6890b9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:48.454246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b63e137-ad78-4eb0-9a40-100ebc61513a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:48.508784 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be0c48-e79a-40a4-b0eb-580468ffc4e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:48.510080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be0c48-e79a-40a4-b0eb-580468ffc4e3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:48.510525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be0c48-e79a-40a4-b0eb-580468ffc4e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:48.510953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65be0c48-e79a-40a4-b0eb-580468ffc4e3 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:48.512432 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be0c48-e79a-40a4-b0eb-580468ffc4e3 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:48.514139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65be0c48-e79a-40a4-b0eb-580468ffc4e3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:48.516126 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 182/373] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:48 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:48.517231 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be0c48-e79a-40a4-b0eb-580468ffc4e3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:48.535842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 192/374] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:48 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:48.537036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e3db0-46db-4f12-b547-072daa6890b9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:48.626365 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65be0c48-e79a-40a4-b0eb-580468ffc4e3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:48.633219 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:48.642629 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-471e3db0-46db-4f12-b547-072daa6890b9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:48.657931 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:48.664638 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd439c-e161-4874-b079-4bb37b8d438a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:48.665375 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd439c-e161-4874-b079-4bb37b8d438a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:48.665911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd439c-e161-4874-b079-4bb37b8d438a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:48.667681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82dd439c-e161-4874-b079-4bb37b8d438a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:48.668720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd439c-e161-4874-b079-4bb37b8d438a None admin] RBAC: Adding query filter params (role.id=9918eec87e3345c2ad6ca136d1e94dd3, user.id=6a6430b18c024c4d815174eda4ab0d66, scope.system=all) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:48.669260 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd439c-e161-4874-b079-4bb37b8d438a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:48.670930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82dd439c-e161-4874-b079-4bb37b8d438a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:48.679828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443c6b3-88b5-4669-97d3-886a42066698 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:48.680911 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443c6b3-88b5-4669-97d3-886a42066698 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:48.681381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443c6b3-88b5-4669-97d3-886a42066698 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:48.681844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8443c6b3-88b5-4669-97d3-886a42066698 None admin] PATH_INFO: `/v3/groups/1ca7eeaace04437a81da6f9b9d341782` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:48.683199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443c6b3-88b5-4669-97d3-886a42066698 None admin] RBAC: Authorizing `identity:get_group(group_id=1ca7eeaace04437a81da6f9b9d341782)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:48.684473 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 183/375] 10.222.0.64 () {56 vars in 1308 bytes} [Thu May 26 18:07:48 2022] GET /identity/v3/role_assignments?user.id=6a6430b18c024c4d815174eda4ab0d66&scope.system=all&role.id=9918eec87e3345c2ad6ca136d1e94dd3 => generated 510 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:48.684975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8443c6b3-88b5-4669-97d3-886a42066698 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:48.687112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 193/376] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:48 2022] GET /identity/v3/groups/1ca7eeaace04437a81da6f9b9d341782 => generated 226 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:48.688264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd439c-e161-4874-b079-4bb37b8d438a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:48.694140 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443c6b3-88b5-4669-97d3-886a42066698 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:48.858424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82dd439c-e161-4874-b079-4bb37b8d438a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:48.885269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8443c6b3-88b5-4669-97d3-886a42066698 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:48.904503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a071f5af-13fa-4865-ae55-e9bcaa8365b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:48.905351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071f5af-13fa-4865-ae55-e9bcaa8365b9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:48.905637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071f5af-13fa-4865-ae55-e9bcaa8365b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:48.905916 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a071f5af-13fa-4865-ae55-e9bcaa8365b9 None admin] PATH_INFO: `/v3/projects/04b116e5fb9e430e9155c1db8872f881` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:48.908858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071f5af-13fa-4865-ae55-e9bcaa8365b9 None admin] RBAC: Authorizing `identity:get_project(project_id=04b116e5fb9e430e9155c1db8872f881)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:48.910411 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a071f5af-13fa-4865-ae55-e9bcaa8365b9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:48.913757 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 184/377] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:48 2022] GET /identity/v3/projects/04b116e5fb9e430e9155c1db8872f881 => generated 344 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:48.917311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe37d47-eeab-45b2-a910-03806ee1da01 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:48.918100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe37d47-eeab-45b2-a910-03806ee1da01 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:48.918594 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fe37d47-eeab-45b2-a910-03806ee1da01 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:48.920448 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 185/378] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:07:48.923008 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe37d47-eeab-45b2-a910-03806ee1da01 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:48.960747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b46567-498e-48fc-9eeb-3508615359b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:48.961450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46567-498e-48fc-9eeb-3508615359b7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:48.961733 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46567-498e-48fc-9eeb-3508615359b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:48.962010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b46567-498e-48fc-9eeb-3508615359b7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:48.963850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b46567-498e-48fc-9eeb-3508615359b7 None admin] RBAC: Adding query filter params (group.id=1ca7eeaace04437a81da6f9b9d341782, role.id=1b7e8aa514f04cef9c1da777642b34a8, scope.project.id=a9a90082c4c1407981192ee9bb7a8e19) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:48.964336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b46567-498e-48fc-9eeb-3508615359b7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:48.966500 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b46567-498e-48fc-9eeb-3508615359b7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:48.980370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 194/379] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 26 18:07:48 2022] GET /identity/v3/role_assignments?group.id=1ca7eeaace04437a81da6f9b9d341782&scope.project.id=a9a90082c4c1407981192ee9bb7a8e19&role.id=1b7e8aa514f04cef9c1da777642b34a8 => generated 260 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:48.981728 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eb941-d3fa-40f3-8168-8d599e8ae6dc None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:48.982018 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eb941-d3fa-40f3-8168-8d599e8ae6dc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:48.982300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245eb941-d3fa-40f3-8168-8d599e8ae6dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:49.023222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-245eb941-d3fa-40f3-8168-8d599e8ae6dc None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:49.024478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-245eb941-d3fa-40f3-8168-8d599e8ae6dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:49.027644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:49.056045 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:49.111092 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fe37d47-eeab-45b2-a910-03806ee1da01 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:49.151781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 195/380] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:48 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:49.168442 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a204567-e27b-4b9e-a1c0-30353886ba17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:49.169786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a204567-e27b-4b9e-a1c0-30353886ba17 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:49.170392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a204567-e27b-4b9e-a1c0-30353886ba17 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:49.170896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a204567-e27b-4b9e-a1c0-30353886ba17 None admin] PATH_INFO: `/v3/groups/ff65a9085876497fbdcbcc1fc42acc63` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:49.177566 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a204567-e27b-4b9e-a1c0-30353886ba17 None admin] RBAC: Authorizing `identity:get_group(group_id=ff65a9085876497fbdcbcc1fc42acc63)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:49.179480 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a204567-e27b-4b9e-a1c0-30353886ba17 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:49.181640 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 186/381] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:48 2022] GET /identity/v3/groups/ff65a9085876497fbdcbcc1fc42acc63 => generated 229 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:49.190178 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eb941-d3fa-40f3-8168-8d599e8ae6dc None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:49.191426 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a204567-e27b-4b9e-a1c0-30353886ba17 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:49.312457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a204567-e27b-4b9e-a1c0-30353886ba17 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:49.330109 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245eb941-d3fa-40f3-8168-8d599e8ae6dc None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:49.341357 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:49.352389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cd08a-5122-41f3-a019-317041dde61d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:49.353767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd08a-5122-41f3-a019-317041dde61d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:49.354201 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd08a-5122-41f3-a019-317041dde61d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:49.354676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-975cd08a-5122-41f3-a019-317041dde61d None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:49.367579 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-975cd08a-5122-41f3-a019-317041dde61d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:49.367744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a66cf-d251-488c-ace7-b60a801c1b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:49.368347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a66cf-d251-488c-ace7-b60a801c1b8c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:49.368634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a66cf-d251-488c-ace7-b60a801c1b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:49.368913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a66cf-d251-488c-ace7-b60a801c1b8c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:49.370317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a66cf-d251-488c-ace7-b60a801c1b8c None admin] RBAC: Adding query filter params (group.id=ff65a9085876497fbdcbcc1fc42acc63, role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=04b116e5fb9e430e9155c1db8872f881) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:49.370632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a66cf-d251-488c-ace7-b60a801c1b8c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:49.372261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a66cf-d251-488c-ace7-b60a801c1b8c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-975cd08a-5122-41f3-a019-317041dde61d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:49.378648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:49.379535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:49.380300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:49.380300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:49.380300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:49.380300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:49.380300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:49.380300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:49.380300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:49.380300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:49.380300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:49.380300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:49.380300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:49.380300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:49.380882 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 196/382] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 26 18:07:49 2022] GET /identity/v3/role_assignments?group.id=ff65a9085876497fbdcbcc1fc42acc63&scope.project.id=04b116e5fb9e430e9155c1db8872f881&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 260 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:49.380957 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 187/383] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:49 2022] GET /identity/v3/roles/member => generated 84 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:07:49.394298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a66cf-d251-488c-ace7-b60a801c1b8c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:49.408623 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:49.510725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a66cf-d251-488c-ace7-b60a801c1b8c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:49.551676 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b4358-3922-4125-b695-b266787aa265 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:49.552367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b4358-3922-4125-b695-b266787aa265 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:49.552654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b4358-3922-4125-b695-b266787aa265 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:49.552933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e12b4358-3922-4125-b695-b266787aa265 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:49.553714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b4358-3922-4125-b695-b266787aa265 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:49.554025 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b4358-3922-4125-b695-b266787aa265 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:49.555407 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e12b4358-3922-4125-b695-b266787aa265 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:49.565351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 197/384] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:49 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:49.570942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cd08a-5122-41f3-a019-317041dde61d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:49.723807 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-975cd08a-5122-41f3-a019-317041dde61d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:49.784624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fae256-ebf1-4c0d-9090-7eb37b4d7d47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:49.785447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fae256-ebf1-4c0d-9090-7eb37b4d7d47 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:49.785734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fae256-ebf1-4c0d-9090-7eb37b4d7d47 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:49.786012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3fae256-ebf1-4c0d-9090-7eb37b4d7d47 None admin] PATH_INFO: `/v3/groups/1ca7eeaace04437a81da6f9b9d341782` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:49.789698 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fae256-ebf1-4c0d-9090-7eb37b4d7d47 None admin] RBAC: Authorizing `identity:get_group(group_id=1ca7eeaace04437a81da6f9b9d341782)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:49.791365 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3fae256-ebf1-4c0d-9090-7eb37b4d7d47 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:49.793390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 188/385] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:49 2022] GET /identity/v3/groups/1ca7eeaace04437a81da6f9b9d341782 => generated 226 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:49.798866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b4358-3922-4125-b695-b266787aa265 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:49.906552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:49.942782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e12b4358-3922-4125-b695-b266787aa265 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:49.992095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b43d5f0-920a-4ed1-94df-ae191b2b8930 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:49.992976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d5f0-920a-4ed1-94df-ae191b2b8930 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:49.993295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d5f0-920a-4ed1-94df-ae191b2b8930 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:49.993576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b43d5f0-920a-4ed1-94df-ae191b2b8930 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:49.995317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43d5f0-920a-4ed1-94df-ae191b2b8930 None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:49.996764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b43d5f0-920a-4ed1-94df-ae191b2b8930 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:49.998802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 198/386] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:49 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:50.006267 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fae256-ebf1-4c0d-9090-7eb37b4d7d47 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:50.113267 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:50.197028 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3fae256-ebf1-4c0d-9090-7eb37b4d7d47 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:50.265462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4574889c-6563-4783-8e2b-700e1a9566b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:50.266348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574889c-6563-4783-8e2b-700e1a9566b5 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:50.266626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574889c-6563-4783-8e2b-700e1a9566b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:50.266899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4574889c-6563-4783-8e2b-700e1a9566b5 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14/groups/1ca7eeaace04437a81da6f9b9d341782/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:50.274354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574889c-6563-4783-8e2b-700e1a9566b5 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14, group_id=1ca7eeaace04437a81da6f9b9d341782, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:50.275855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4574889c-6563-4783-8e2b-700e1a9566b5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:50.310105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 189/387] 10.222.0.64 () {58 vars in 1442 bytes} [Thu May 26 18:07:50 2022] PUT /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14/groups/1ca7eeaace04437a81da6f9b9d341782/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 304 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:50.538179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7023fe-043d-40d1-a0e8-9618b4058a13 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:50.538179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7023fe-043d-40d1-a0e8-9618b4058a13 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:50.538179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a7023fe-043d-40d1-a0e8-9618b4058a13 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:50.539373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 199/388] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:50.544165 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb334a-c97a-40c7-884f-74a0ada7be21 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:50.544574 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb334a-c97a-40c7-884f-74a0ada7be21 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:50.544744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eb334a-c97a-40c7-884f-74a0ada7be21 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:50.568551 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e2eb334a-c97a-40c7-884f-74a0ada7be21 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:50.569810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e2eb334a-c97a-40c7-884f-74a0ada7be21 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:50.660478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 190/389] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:50.683422 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7023fe-043d-40d1-a0e8-9618b4058a13 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:50.821826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a7023fe-043d-40d1-a0e8-9618b4058a13 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:50.864694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-312a6602-6648-44da-a83f-966bc8d1a915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:50.865537 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6602-6648-44da-a83f-966bc8d1a915 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:50.865824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6602-6648-44da-a83f-966bc8d1a915 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:50.866100 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-312a6602-6648-44da-a83f-966bc8d1a915 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:50.877427 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:50.884440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-312a6602-6648-44da-a83f-966bc8d1a915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-312a6602-6648-44da-a83f-966bc8d1a915 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:50.893787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:50.894725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:50.895928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:50.895928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:50.895928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:50.895928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:50.895928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:50.895928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:50.895928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:50.895928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:50.895928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:50.895928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:50.895928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:50.895928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:50.895928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 200/390] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:07:50 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:50.902171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb334a-c97a-40c7-884f-74a0ada7be21 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:50.923041 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e860-2b1d-44cd-885b-9b03d1fe4a08 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:50.923360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e860-2b1d-44cd-885b-9b03d1fe4a08 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:50.923728 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b66e860-2b1d-44cd-885b-9b03d1fe4a08 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:50.925299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 201/391] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:50.930038 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcdffc-ed87-481a-9243-3a2d76544d47 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:50.930326 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcdffc-ed87-481a-9243-3a2d76544d47 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:50.930608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8fcdffc-ed87-481a-9243-3a2d76544d47 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:50.953682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:50.955397 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f8fcdffc-ed87-481a-9243-3a2d76544d47 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:50.956616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f8fcdffc-ed87-481a-9243-3a2d76544d47 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:51.022317 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eb334a-c97a-40c7-884f-74a0ada7be21 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:51.069681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfec068-e570-4503-ac54-00ce4ce416c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:51.070707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec068-e570-4503-ac54-00ce4ce416c9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:51.071181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec068-e570-4503-ac54-00ce4ce416c9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:51.071684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfec068-e570-4503-ac54-00ce4ce416c9 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:51.073461 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfec068-e570-4503-ac54-00ce4ce416c9 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:51.073974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfec068-e570-4503-ac54-00ce4ce416c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:51.075549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfec068-e570-4503-ac54-00ce4ce416c9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:51.078643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 202/392] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:51.084840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 191/393] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:07:50 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:51.090752 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcdffc-ed87-481a-9243-3a2d76544d47 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:51.106190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfec068-e570-4503-ac54-00ce4ce416c9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:51.256273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8fcdffc-ed87-481a-9243-3a2d76544d47 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:51.289164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfec068-e570-4503-ac54-00ce4ce416c9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:51.290866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:51.305549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:51.318896 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ad19c-b18e-446a-b00b-25d9b83f27fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:51.319766 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ad19c-b18e-446a-b00b-25d9b83f27fa None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:51.320046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ad19c-b18e-446a-b00b-25d9b83f27fa None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:51.320317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de9ad19c-b18e-446a-b00b-25d9b83f27fa None admin] PATH_INFO: `/v3/groups/1ca7eeaace04437a81da6f9b9d341782` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:51.323944 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ad19c-b18e-446a-b00b-25d9b83f27fa None admin] RBAC: Authorizing `identity:get_group(group_id=1ca7eeaace04437a81da6f9b9d341782)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:51.327421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de9ad19c-b18e-446a-b00b-25d9b83f27fa None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:51.329125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 203/394] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:51 2022] GET /identity/v3/groups/1ca7eeaace04437a81da6f9b9d341782 => generated 226 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:51.335032 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ad19c-b18e-446a-b00b-25d9b83f27fa None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:51.349247 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb4a31-c2a4-4fbe-90df-fed335eed3f8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:51.350047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb4a31-c2a4-4fbe-90df-fed335eed3f8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:51.350325 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb4a31-c2a4-4fbe-90df-fed335eed3f8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:51.350593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71bb4a31-c2a4-4fbe-90df-fed335eed3f8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:51.371544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71bb4a31-c2a4-4fbe-90df-fed335eed3f8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-71bb4a31-c2a4-4fbe-90df-fed335eed3f8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:51.380424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:51.381396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:51.382389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:51.382389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:51.382389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:51.382389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:51.382389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:51.382389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:51.382389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:51.382389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:51.382389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:51.382389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:51.382389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:51.382389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:51.382389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 192/395] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:07:51.388276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb4a31-c2a4-4fbe-90df-fed335eed3f8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:51.513812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de9ad19c-b18e-446a-b00b-25d9b83f27fa None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:51.565418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da16085-60d2-46bb-a372-ce6c8b4ea425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:51.566334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da16085-60d2-46bb-a372-ce6c8b4ea425 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:51.566619 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da16085-60d2-46bb-a372-ce6c8b4ea425 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:51.566895 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da16085-60d2-46bb-a372-ce6c8b4ea425 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:51.568136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da16085-60d2-46bb-a372-ce6c8b4ea425 None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:51.569607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da16085-60d2-46bb-a372-ce6c8b4ea425 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:51.571533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 204/396] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:51 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:51.576959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da16085-60d2-46bb-a372-ce6c8b4ea425 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:51.601065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71bb4a31-c2a4-4fbe-90df-fed335eed3f8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:51.662630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08858af9-28cf-4868-98f3-7a6e5a09e289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:51.663348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08858af9-28cf-4868-98f3-7a6e5a09e289 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:51.663638 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08858af9-28cf-4868-98f3-7a6e5a09e289 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:51.663910 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08858af9-28cf-4868-98f3-7a6e5a09e289 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:51.664659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08858af9-28cf-4868-98f3-7a6e5a09e289 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:51.664964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08858af9-28cf-4868-98f3-7a6e5a09e289 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:51.668672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08858af9-28cf-4868-98f3-7a6e5a09e289 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:51.684890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 193/397] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:51.691644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08858af9-28cf-4868-98f3-7a6e5a09e289 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:51.704470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:51.741406 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:51.766138 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da16085-60d2-46bb-a372-ce6c8b4ea425 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:51.828192 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee12ff-4bd3-4733-99fa-39d18306f953 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:51.829037 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee12ff-4bd3-4733-99fa-39d18306f953 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:51.829331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee12ff-4bd3-4733-99fa-39d18306f953 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:51.829607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ee12ff-4bd3-4733-99fa-39d18306f953 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14/groups/1ca7eeaace04437a81da6f9b9d341782/roles/1b7e8aa514f04cef9c1da777642b34a8` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:51.832300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee12ff-4bd3-4733-99fa-39d18306f953 None admin] RBAC: Authorizing `identity:create_grant(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14, group_id=1ca7eeaace04437a81da6f9b9d341782, role_id=1b7e8aa514f04cef9c1da777642b34a8)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:51.833287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ee12ff-4bd3-4733-99fa-39d18306f953 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:51.856435 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 205/398] 10.222.0.64 () {58 vars in 1442 bytes} [Thu May 26 18:07:51 2022] PUT /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14/groups/1ca7eeaace04437a81da6f9b9d341782/roles/1b7e8aa514f04cef9c1da777642b34a8 => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:07:51.878207 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08858af9-28cf-4868-98f3-7a6e5a09e289 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:51.927861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dc09b3e-87fd-495e-8e8f-30339224ce0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:51.928738 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc09b3e-87fd-495e-8e8f-30339224ce0c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:51.929041 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc09b3e-87fd-495e-8e8f-30339224ce0c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:51.929372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dc09b3e-87fd-495e-8e8f-30339224ce0c None admin] PATH_INFO: `/v3/groups/1ca7eeaace04437a81da6f9b9d341782` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:51.931501 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc09b3e-87fd-495e-8e8f-30339224ce0c None admin] RBAC: Authorizing `identity:get_group(group_id=1ca7eeaace04437a81da6f9b9d341782)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:51.933074 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dc09b3e-87fd-495e-8e8f-30339224ce0c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:51.935082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 194/399] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:51 2022] GET /identity/v3/groups/1ca7eeaace04437a81da6f9b9d341782 => generated 226 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:51.940786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee12ff-4bd3-4733-99fa-39d18306f953 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:51.965978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf5d1b-190f-4c4f-9354-a631ff87771e None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:51.966637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf5d1b-190f-4c4f-9354-a631ff87771e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:51.967116 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86cf5d1b-190f-4c4f-9354-a631ff87771e None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:51.970014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 195/400] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:07:51.974648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af7d0a-9a2e-46eb-a1bf-e279d875d21d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:51.975167 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af7d0a-9a2e-46eb-a1bf-e279d875d21d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:51.975671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24af7d0a-9a2e-46eb-a1bf-e279d875d21d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:51.993800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-24af7d0a-9a2e-46eb-a1bf-e279d875d21d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:51.995572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-24af7d0a-9a2e-46eb-a1bf-e279d875d21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:52.084952 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ee12ff-4bd3-4733-99fa-39d18306f953 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:52.132765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 196/401] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:07:52.143768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:52.163845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5484fe1-c4f7-4710-8a91-2fdd64ea7549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:52.165080 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5484fe1-c4f7-4710-8a91-2fdd64ea7549 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:52.165568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5484fe1-c4f7-4710-8a91-2fdd64ea7549 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:52.166021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5484fe1-c4f7-4710-8a91-2fdd64ea7549 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:52.167509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5484fe1-c4f7-4710-8a91-2fdd64ea7549 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:52.169217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5484fe1-c4f7-4710-8a91-2fdd64ea7549 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:52.171525 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 206/402] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:51 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:52.177708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af7d0a-9a2e-46eb-a1bf-e279d875d21d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:52.181424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5484fe1-c4f7-4710-8a91-2fdd64ea7549 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:52.203257 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:52.301732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5484fe1-c4f7-4710-8a91-2fdd64ea7549 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:52.311150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24af7d0a-9a2e-46eb-a1bf-e279d875d21d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:52.338616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7788d37d-6004-4bca-b03d-64142fe0d3e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:52.339762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788d37d-6004-4bca-b03d-64142fe0d3e1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:52.340348 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788d37d-6004-4bca-b03d-64142fe0d3e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:52.340822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7788d37d-6004-4bca-b03d-64142fe0d3e1 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:52.351982 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7788d37d-6004-4bca-b03d-64142fe0d3e1 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:52.353294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d6f017-0e5f-4c45-acf9-6ed1d2ab37e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:52.355013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6f017-0e5f-4c45-acf9-6ed1d2ab37e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:52.355295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6f017-0e5f-4c45-acf9-6ed1d2ab37e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:52.355569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d6f017-0e5f-4c45-acf9-6ed1d2ab37e6 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19/groups/1ca7eeaace04437a81da6f9b9d341782/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:52.357549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6f017-0e5f-4c45-acf9-6ed1d2ab37e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9a90082c4c1407981192ee9bb7a8e19, group_id=1ca7eeaace04437a81da6f9b9d341782, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:52.358996 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d6f017-0e5f-4c45-acf9-6ed1d2ab37e6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7788d37d-6004-4bca-b03d-64142fe0d3e1 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:52.363369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:52.364689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:52.365532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:52.365532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:52.365532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:52.365532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:52.365532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:52.365532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:52.365532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:52.365532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:52.365532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:52.365532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:52.365532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:52.365532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:52.365532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 207/403] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:07:52 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:52.372080 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adfbee-d4ee-4aba-8fdc-54ccfa17bede None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:52.372384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adfbee-d4ee-4aba-8fdc-54ccfa17bede None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:52.372769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0adfbee-d4ee-4aba-8fdc-54ccfa17bede None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:52.374808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 208/404] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:52 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:52.376899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adfbee-d4ee-4aba-8fdc-54ccfa17bede None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:52.383392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 197/405] 10.222.0.64 () {58 vars in 1442 bytes} [Thu May 26 18:07:52 2022] PUT /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19/groups/1ca7eeaace04437a81da6f9b9d341782/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:52.383392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677f22b-b921-4a1e-886d-74b1a8803e18 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:52.383392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677f22b-b921-4a1e-886d-74b1a8803e18 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:52.385426 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a677f22b-b921-4a1e-886d-74b1a8803e18 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:52.420394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a677f22b-b921-4a1e-886d-74b1a8803e18 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:52.421621 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a677f22b-b921-4a1e-886d-74b1a8803e18 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:52.493382 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:52.569123 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 198/406] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:52.580879 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0adfbee-d4ee-4aba-8fdc-54ccfa17bede None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:52.605728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677f22b-b921-4a1e-886d-74b1a8803e18 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:52.621524 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:52.632549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee57b0a-c3c7-4d9f-a0dd-a40b5d0b5758 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:52.633993 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee57b0a-c3c7-4d9f-a0dd-a40b5d0b5758 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:52.634523 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee57b0a-c3c7-4d9f-a0dd-a40b5d0b5758 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:52.635499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee57b0a-c3c7-4d9f-a0dd-a40b5d0b5758 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:52.636444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee57b0a-c3c7-4d9f-a0dd-a40b5d0b5758 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:52.637521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee57b0a-c3c7-4d9f-a0dd-a40b5d0b5758 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:52.639488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee57b0a-c3c7-4d9f-a0dd-a40b5d0b5758 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:52.651528 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 209/407] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:07:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:52.662573 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee57b0a-c3c7-4d9f-a0dd-a40b5d0b5758 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:52.764166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a677f22b-b921-4a1e-886d-74b1a8803e18 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:52.800715 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9e33b-1a04-482e-b76d-e8b10743f7d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:52.801896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9e33b-1a04-482e-b76d-e8b10743f7d7 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:52.802378 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9e33b-1a04-482e-b76d-e8b10743f7d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:52.802846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b9e33b-1a04-482e-b76d-e8b10743f7d7 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:52.813890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b9e33b-1a04-482e-b76d-e8b10743f7d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-f2b9e33b-1a04-482e-b76d-e8b10743f7d7 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:52.821870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:52.823249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:52.824147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:52.824147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:52.824147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:52.824147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:52.824147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:52.824147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:52.824147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:52.824147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:52.824147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:52.824147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:52.824147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:52.824147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:52.826794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 199/408] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:07:52 2022] GET /identity/v3/roles/admin => generated 83 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:52.832970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9e33b-1a04-482e-b76d-e8b10743f7d7 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:52.903497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee57b0a-c3c7-4d9f-a0dd-a40b5d0b5758 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:52.913132 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:52.935855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:52.963843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a97de5-b23d-4158-87b2-cad634804a00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:52.967264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a97de5-b23d-4158-87b2-cad634804a00 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:52.968404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a97de5-b23d-4158-87b2-cad634804a00 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:52.969874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a97de5-b23d-4158-87b2-cad634804a00 None admin] PATH_INFO: `/v3/groups/1ca7eeaace04437a81da6f9b9d341782` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:52.973471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a97de5-b23d-4158-87b2-cad634804a00 None admin] RBAC: Authorizing `identity:get_group(group_id=1ca7eeaace04437a81da6f9b9d341782)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:52.974319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b9e33b-1a04-482e-b76d-e8b10743f7d7 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:52.975961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a97de5-b23d-4158-87b2-cad634804a00 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:52.984153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 210/409] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:52 2022] GET /identity/v3/groups/1ca7eeaace04437a81da6f9b9d341782 => generated 226 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:52.985287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a97de5-b23d-4158-87b2-cad634804a00 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.048204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-090e5ec5-e4bc-4c04-8a30-74b232f55889 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.049264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5ec5-e4bc-4c04-8a30-74b232f55889 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.049842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5ec5-e4bc-4c04-8a30-74b232f55889 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.050311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-090e5ec5-e4bc-4c04-8a30-74b232f55889 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.051352 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e5ec5-e4bc-4c04-8a30-74b232f55889 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:53.051897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e5ec5-e4bc-4c04-8a30-74b232f55889 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:53.053651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-090e5ec5-e4bc-4c04-8a30-74b232f55889 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.079046 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 200/410] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:53.081954 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4099-32a9-4d05-9b6d-b8965c452c4e None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.082464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4099-32a9-4d05-9b6d-b8965c452c4e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.082966 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c81a4099-32a9-4d05-9b6d-b8965c452c4e None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.084488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 201/411] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:53 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:07:53.085487 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a4099-32a9-4d05-9b6d-b8965c452c4e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.114516 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a97de5-b23d-4158-87b2-cad634804a00 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:53.153892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-731db0dc-7405-425d-a995-58147acbc60f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.154850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731db0dc-7405-425d-a995-58147acbc60f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.155218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731db0dc-7405-425d-a995-58147acbc60f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.155589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-731db0dc-7405-425d-a995-58147acbc60f None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.156874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731db0dc-7405-425d-a995-58147acbc60f None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:53.158424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-731db0dc-7405-425d-a995-58147acbc60f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.160509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 211/412] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:52 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:53.161857 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24423e47-195d-4c21-920d-4c5cee95e5c5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.162245 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24423e47-195d-4c21-920d-4c5cee95e5c5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.162634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24423e47-195d-4c21-920d-4c5cee95e5c5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.179196 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-24423e47-195d-4c21-920d-4c5cee95e5c5 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:53.180577 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-24423e47-195d-4c21-920d-4c5cee95e5c5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:53.218522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c81a4099-32a9-4d05-9b6d-b8965c452c4e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:53.247634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:53.254148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:53.259981 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c142ff-facf-4c9d-ad62-d352d53c1f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.261899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c142ff-facf-4c9d-ad62-d352d53c1f00 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.262274 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c142ff-facf-4c9d-ad62-d352d53c1f00 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.263001 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c142ff-facf-4c9d-ad62-d352d53c1f00 None admin] PATH_INFO: `/v3/groups/ff65a9085876497fbdcbcc1fc42acc63` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.264731 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c142ff-facf-4c9d-ad62-d352d53c1f00 None admin] RBAC: Authorizing `identity:get_group(group_id=ff65a9085876497fbdcbcc1fc42acc63)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:53.266614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c142ff-facf-4c9d-ad62-d352d53c1f00 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.269079 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 202/413] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:53 2022] GET /identity/v3/groups/ff65a9085876497fbdcbcc1fc42acc63 => generated 229 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:53.270063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c142ff-facf-4c9d-ad62-d352d53c1f00 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.281437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 212/414] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:53 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:53.282799 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24423e47-195d-4c21-920d-4c5cee95e5c5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.405950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24423e47-195d-4c21-920d-4c5cee95e5c5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:53.413256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c142ff-facf-4c9d-ad62-d352d53c1f00 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:53.443963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba831e73-d8ea-4a37-aa76-db88bd9de18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.444779 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba831e73-d8ea-4a37-aa76-db88bd9de18e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.445101 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba831e73-d8ea-4a37-aa76-db88bd9de18e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.445375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba831e73-d8ea-4a37-aa76-db88bd9de18e None admin] PATH_INFO: `/v3/projects/04b116e5fb9e430e9155c1db8872f881` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.446587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba831e73-d8ea-4a37-aa76-db88bd9de18e None admin] RBAC: Authorizing `identity:get_project(project_id=04b116e5fb9e430e9155c1db8872f881)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:53.448108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba831e73-d8ea-4a37-aa76-db88bd9de18e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.450501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 213/415] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:53 2022] GET /identity/v3/projects/04b116e5fb9e430e9155c1db8872f881 => generated 344 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:53.451260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba831e73-d8ea-4a37-aa76-db88bd9de18e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.451602 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c391950-ae79-42b3-863c-06f13c9823d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.452724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c391950-ae79-42b3-863c-06f13c9823d9 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.453239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c391950-ae79-42b3-863c-06f13c9823d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.453716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c391950-ae79-42b3-863c-06f13c9823d9 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19/groups/1ca7eeaace04437a81da6f9b9d341782/roles/1b7e8aa514f04cef9c1da777642b34a8` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.457392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c391950-ae79-42b3-863c-06f13c9823d9 None admin] RBAC: Authorizing `identity:create_grant(project_id=a9a90082c4c1407981192ee9bb7a8e19, group_id=1ca7eeaace04437a81da6f9b9d341782, role_id=1b7e8aa514f04cef9c1da777642b34a8)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:53.459095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c391950-ae79-42b3-863c-06f13c9823d9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.476028 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 203/416] 10.222.0.64 () {58 vars in 1442 bytes} [Thu May 26 18:07:53 2022] PUT /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19/groups/1ca7eeaace04437a81da6f9b9d341782/roles/1b7e8aa514f04cef9c1da777642b34a8 => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:53.477587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c391950-ae79-42b3-863c-06f13c9823d9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.536155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:53.551312 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:53.601098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c391950-ae79-42b3-863c-06f13c9823d9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:53.627682 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba831e73-d8ea-4a37-aa76-db88bd9de18e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:53.641517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441e787-1acd-4e7a-b47d-c39f05f52ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.643331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441e787-1acd-4e7a-b47d-c39f05f52ea3 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.643840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441e787-1acd-4e7a-b47d-c39f05f52ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.644441 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5441e787-1acd-4e7a-b47d-c39f05f52ea3 None admin] PATH_INFO: `/v3/projects/04b116e5fb9e430e9155c1db8872f881/groups/ff65a9085876497fbdcbcc1fc42acc63/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.646777 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441e787-1acd-4e7a-b47d-c39f05f52ea3 None admin] RBAC: Authorizing `identity:create_grant(project_id=04b116e5fb9e430e9155c1db8872f881, group_id=ff65a9085876497fbdcbcc1fc42acc63, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:53.648567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5441e787-1acd-4e7a-b47d-c39f05f52ea3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.678436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 204/417] 10.222.0.64 () {58 vars in 1442 bytes} [Thu May 26 18:07:53 2022] PUT /identity/v3/projects/04b116e5fb9e430e9155c1db8872f881/groups/ff65a9085876497fbdcbcc1fc42acc63/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:07:53.683445 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ff835-01fa-468f-828b-6cb96c989ea8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.683445 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ff835-01fa-468f-828b-6cb96c989ea8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.683705 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ff835-01fa-468f-828b-6cb96c989ea8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.683953 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-826ff835-01fa-468f-828b-6cb96c989ea8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.698047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-826ff835-01fa-468f-828b-6cb96c989ea8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-826ff835-01fa-468f-828b-6cb96c989ea8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:53.706859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:53.707837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:53.708967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:53.708967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:53.708967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:53.708967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:53.708967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:53.708967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:53.708967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:53.708967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:53.708967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:53.708967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:53.708967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:53.708967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:53.708967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 214/418] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:53 2022] GET /identity/v3/roles/member => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:53.714926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441e787-1acd-4e7a-b47d-c39f05f52ea3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:53.863356 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5441e787-1acd-4e7a-b47d-c39f05f52ea3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:53.885406 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:53.906009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bb5b0-6a3f-4a4b-be58-94ba05efbcd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:53.906689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bb5b0-6a3f-4a4b-be58-94ba05efbcd6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:53.906971 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bb5b0-6a3f-4a4b-be58-94ba05efbcd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:53.907247 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9bb5b0-6a3f-4a4b-be58-94ba05efbcd6 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:53.908111 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bb5b0-6a3f-4a4b-be58-94ba05efbcd6 None admin] RBAC: Adding query filter params (name=member) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:53.908418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bb5b0-6a3f-4a4b-be58-94ba05efbcd6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:53.909811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9bb5b0-6a3f-4a4b-be58-94ba05efbcd6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:53.919785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 205/419] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:53.925623 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ff835-01fa-468f-828b-6cb96c989ea8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:54.060879 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-826ff835-01fa-468f-828b-6cb96c989ea8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:54.081386 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:54.110329 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed8a686a-0165-4b1b-956b-a7455b5ae251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:54.111340 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a686a-0165-4b1b-956b-a7455b5ae251 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.111848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a686a-0165-4b1b-956b-a7455b5ae251 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.112324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed8a686a-0165-4b1b-956b-a7455b5ae251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.220090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a686a-0165-4b1b-956b-a7455b5ae251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:54.221905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed8a686a-0165-4b1b-956b-a7455b5ae251 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:54.364782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 215/420] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 439 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:54.369913 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bb5b0-6a3f-4a4b-be58-94ba05efbcd6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:54.467270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ba3a3-1c0d-44a6-8562-3c07aab56632 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.467559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ba3a3-1c0d-44a6-8562-3c07aab56632 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.467855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd2ba3a3-1c0d-44a6-8562-3c07aab56632 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.469525 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 216/421] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:07:54.475241 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e653bc-a9a3-4dee-9f0e-2ef710abe767 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.475625 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e653bc-a9a3-4dee-9f0e-2ef710abe767 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.475778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43e653bc-a9a3-4dee-9f0e-2ef710abe767 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.489476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9bb5b0-6a3f-4a4b-be58-94ba05efbcd6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:54.509131 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-43e653bc-a9a3-4dee-9f0e-2ef710abe767 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:54.510879 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-43e653bc-a9a3-4dee-9f0e-2ef710abe767 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:54.522051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:54.525935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221bd15-7cb3-44eb-b53d-f1ba70f2dc63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:54.526936 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221bd15-7cb3-44eb-b53d-f1ba70f2dc63 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.527274 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221bd15-7cb3-44eb-b53d-f1ba70f2dc63 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.527555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7221bd15-7cb3-44eb-b53d-f1ba70f2dc63 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.529343 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221bd15-7cb3-44eb-b53d-f1ba70f2dc63 None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:54.530808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7221bd15-7cb3-44eb-b53d-f1ba70f2dc63 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:54.532815 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 206/422] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:54 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:54.538471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221bd15-7cb3-44eb-b53d-f1ba70f2dc63 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:54.600008 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:54.642931 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 217/423] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:07:54.659382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7221bd15-7cb3-44eb-b53d-f1ba70f2dc63 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:54.677337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e653bc-a9a3-4dee-9f0e-2ef710abe767 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:54.695864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc6c46-d494-4a62-a74b-5acbca8b5b86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:54.697156 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc6c46-d494-4a62-a74b-5acbca8b5b86 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.697447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc6c46-d494-4a62-a74b-5acbca8b5b86 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.698321 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31dc6c46-d494-4a62-a74b-5acbca8b5b86 None admin] PATH_INFO: `/v3/groups/1ca7eeaace04437a81da6f9b9d341782` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.699558 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc6c46-d494-4a62-a74b-5acbca8b5b86 None admin] RBAC: Authorizing `identity:get_group(group_id=1ca7eeaace04437a81da6f9b9d341782)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:54.701594 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31dc6c46-d494-4a62-a74b-5acbca8b5b86 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:54.703613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 207/424] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:54 2022] GET /identity/v3/groups/1ca7eeaace04437a81da6f9b9d341782 => generated 226 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:54.710711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc6c46-d494-4a62-a74b-5acbca8b5b86 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:54.860939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43e653bc-a9a3-4dee-9f0e-2ef710abe767 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:54.904335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31dc6c46-d494-4a62-a74b-5acbca8b5b86 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:54.910001 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149dad4-d6dc-49dd-897c-7b0736d953a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:54.910807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149dad4-d6dc-49dd-897c-7b0736d953a0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.911086 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149dad4-d6dc-49dd-897c-7b0736d953a0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.911360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5149dad4-d6dc-49dd-897c-7b0736d953a0 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.925774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:54.932809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5149dad4-d6dc-49dd-897c-7b0736d953a0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:54.944025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5149dad4-d6dc-49dd-897c-7b0736d953a0 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:54.950693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:54.951583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:54.952772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:54.952772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:54.952772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:54.952772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:54.952772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:54.952772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:54.952772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:54.952772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:54.952772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:54.952772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:54.952772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:54.952772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:54.952772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 218/425] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:07:54 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 275 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:54.957567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149dad4-d6dc-49dd-897c-7b0736d953a0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:54.976640 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333a5cf-5ce3-45c0-9f81-acd019d5c9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:54.977381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333a5cf-5ce3-45c0-9f81-acd019d5c9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:54.977665 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333a5cf-5ce3-45c0-9f81-acd019d5c9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:54.977936 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9333a5cf-5ce3-45c0-9f81-acd019d5c9c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:54.978809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333a5cf-5ce3-45c0-9f81-acd019d5c9c5 None admin] RBAC: Adding query filter params (group.id=1ca7eeaace04437a81da6f9b9d341782, role.id=f4ccd6ca72d7486d85d90f7585de12c9, scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:54.979407 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333a5cf-5ce3-45c0-9f81-acd019d5c9c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:54.981065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9333a5cf-5ce3-45c0-9f81-acd019d5c9c5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:54.995299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 208/426] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 26 18:07:54 2022] GET /identity/v3/role_assignments?group.id=1ca7eeaace04437a81da6f9b9d341782&scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14&role.id=f4ccd6ca72d7486d85d90f7585de12c9 => generated 611 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:55.121130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5149dad4-d6dc-49dd-897c-7b0736d953a0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:55.182004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd663ecb-6c92-4259-b3ad-6d553caba591 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:55.182663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd663ecb-6c92-4259-b3ad-6d553caba591 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:55.182943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd663ecb-6c92-4259-b3ad-6d553caba591 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:55.183213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd663ecb-6c92-4259-b3ad-6d553caba591 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:55.183968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd663ecb-6c92-4259-b3ad-6d553caba591 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:55.184272 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd663ecb-6c92-4259-b3ad-6d553caba591 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:55.185668 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd663ecb-6c92-4259-b3ad-6d553caba591 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:55.201669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 219/427] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:07:54 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:55.207555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333a5cf-5ce3-45c0-9f81-acd019d5c9c5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:55.288485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcee6a-dbfc-4088-9ae0-1ef7a4343617 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:55.288817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcee6a-dbfc-4088-9ae0-1ef7a4343617 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:55.289042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bcee6a-dbfc-4088-9ae0-1ef7a4343617 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:55.290847 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 220/428] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:55.296377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6e0a0-9c69-4e9d-ad16-71fba4811249 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:55.296678 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6e0a0-9c69-4e9d-ad16-71fba4811249 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:55.296937 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95c6e0a0-9c69-4e9d-ad16-71fba4811249 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:55.331383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-95c6e0a0-9c69-4e9d-ad16-71fba4811249 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:55.332591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-95c6e0a0-9c69-4e9d-ad16-71fba4811249 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:55.348743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9333a5cf-5ce3-45c0-9f81-acd019d5c9c5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:55.394353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb717b-7025-4501-b96b-193e99ba30f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:55.395363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb717b-7025-4501-b96b-193e99ba30f1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:55.395853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb717b-7025-4501-b96b-193e99ba30f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:55.396355 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2fb717b-7025-4501-b96b-193e99ba30f1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:55.422294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:55.429681 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 221/429] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:55 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:55.459206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6e0a0-9c69-4e9d-ad16-71fba4811249 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:55.464861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:55.492810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb717b-7025-4501-b96b-193e99ba30f1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:55.495185 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2fb717b-7025-4501-b96b-193e99ba30f1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:55.590862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95c6e0a0-9c69-4e9d-ad16-71fba4811249 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:55.613234 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 209/430] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 406 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:55.626408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb717b-7025-4501-b96b-193e99ba30f1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:55.639498 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2f5aa-6a41-427f-a0bc-436c8adb57fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:55.640705 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2f5aa-6a41-427f-a0bc-436c8adb57fe None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:55.641216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2f5aa-6a41-427f-a0bc-436c8adb57fe None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:55.641731 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f2f5aa-6a41-427f-a0bc-436c8adb57fe None admin] PATH_INFO: `/v3/roles/member` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:55.654378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f2f5aa-6a41-427f-a0bc-436c8adb57fe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f4f2f5aa-6a41-427f-a0bc-436c8adb57fe None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:55.663576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:55.664433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:55.665216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:55.665216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:55.665216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:55.665216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:55.665216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:55.665216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:55.665216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:55.665216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:55.665216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:55.665216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:55.665216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. May 26 18:07:55.665216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:07:55.668430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 222/431] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:07:55.675117 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2f5aa-6a41-427f-a0bc-436c8adb57fe None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:55.732250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:55.756727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2fb717b-7025-4501-b96b-193e99ba30f1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:55.757926 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:55.796704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d2ec6-802f-4cb5-8a79-36f0f29d3e92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:55.797939 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2ec6-802f-4cb5-8a79-36f0f29d3e92 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:55.798388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2ec6-802f-4cb5-8a79-36f0f29d3e92 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:55.798825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-481d2ec6-802f-4cb5-8a79-36f0f29d3e92 None admin] PATH_INFO: `/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:55.800305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d2ec6-802f-4cb5-8a79-36f0f29d3e92 None admin] RBAC: Authorizing `identity:get_project(project_id=5bbaf1adf6b54861a8c4040c1ccf2d14)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:55.802063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-481d2ec6-802f-4cb5-8a79-36f0f29d3e92 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:55.804348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 210/432] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:55 2022] GET /identity/v3/projects/5bbaf1adf6b54861a8c4040c1ccf2d14 => generated 298 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:55.813008 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d2ec6-802f-4cb5-8a79-36f0f29d3e92 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:55.822111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f2f5aa-6a41-427f-a0bc-436c8adb57fe None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:55.863334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7879c-987d-4c7b-a8e8-cc1fc00955b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:55.864018 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7879c-987d-4c7b-a8e8-cc1fc00955b0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:55.864310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7879c-987d-4c7b-a8e8-cc1fc00955b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:55.864589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d7879c-987d-4c7b-a8e8-cc1fc00955b0 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:55.865505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7879c-987d-4c7b-a8e8-cc1fc00955b0 None admin] RBAC: Adding query filter params (name=member) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:55.865814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7879c-987d-4c7b-a8e8-cc1fc00955b0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:55.867248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d7879c-987d-4c7b-a8e8-cc1fc00955b0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:55.878742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 223/433] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:07:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:55.884241 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7879c-987d-4c7b-a8e8-cc1fc00955b0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:55.947254 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-481d2ec6-802f-4cb5-8a79-36f0f29d3e92 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:55.994078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342841e0-ed0a-4e42-b9fe-803efeac6a70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:55.995401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342841e0-ed0a-4e42-b9fe-803efeac6a70 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:55.995686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342841e0-ed0a-4e42-b9fe-803efeac6a70 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:55.995960 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342841e0-ed0a-4e42-b9fe-803efeac6a70 None admin] PATH_INFO: `/v3/groups/1ca7eeaace04437a81da6f9b9d341782` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:55.997887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342841e0-ed0a-4e42-b9fe-803efeac6a70 None admin] RBAC: Authorizing `identity:get_group(group_id=1ca7eeaace04437a81da6f9b9d341782)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:55.999512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342841e0-ed0a-4e42-b9fe-803efeac6a70 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:56.001741 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 211/434] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:55 2022] GET /identity/v3/groups/1ca7eeaace04437a81da6f9b9d341782 => generated 226 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:56.008083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342841e0-ed0a-4e42-b9fe-803efeac6a70 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:56.021752 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d7879c-987d-4c7b-a8e8-cc1fc00955b0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:56.031454 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:56.041236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:56.069705 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c3c8bd-e73f-4aea-af7c-b4ed454b9e35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:56.070634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3c8bd-e73f-4aea-af7c-b4ed454b9e35 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.070918 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3c8bd-e73f-4aea-af7c-b4ed454b9e35 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.071435 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c3c8bd-e73f-4aea-af7c-b4ed454b9e35 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.128013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342841e0-ed0a-4e42-b9fe-803efeac6a70 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:56.172714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3c8bd-e73f-4aea-af7c-b4ed454b9e35 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:56.174300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c3c8bd-e73f-4aea-af7c-b4ed454b9e35 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:56.177323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd92321-b136-47ac-8767-18ca6fa4e6d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:56.179086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd92321-b136-47ac-8767-18ca6fa4e6d9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.179544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd92321-b136-47ac-8767-18ca6fa4e6d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.179953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd92321-b136-47ac-8767-18ca6fa4e6d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.181101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd92321-b136-47ac-8767-18ca6fa4e6d9 None admin] RBAC: Adding query filter params (group.id=1ca7eeaace04437a81da6f9b9d341782, role.id=1b7e8aa514f04cef9c1da777642b34a8, scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:56.181574 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd92321-b136-47ac-8767-18ca6fa4e6d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:56.183759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd92321-b136-47ac-8767-18ca6fa4e6d9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:56.193376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 212/435] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 26 18:07:56 2022] GET /identity/v3/role_assignments?group.id=1ca7eeaace04437a81da6f9b9d341782&scope.project.id=5bbaf1adf6b54861a8c4040c1ccf2d14&role.id=1b7e8aa514f04cef9c1da777642b34a8 => generated 611 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:56.311046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 224/436] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 427 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:56.316766 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd92321-b136-47ac-8767-18ca6fa4e6d9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:56.329966 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fbba2-3dcf-48cf-9d72-3bac8d02ea40 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.330277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fbba2-3dcf-48cf-9d72-3bac8d02ea40 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.330521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fbba2-3dcf-48cf-9d72-3bac8d02ea40 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.332015 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 225/437] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:07:56.337771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2323467-de10-476b-8c7e-29a48142663d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.338074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2323467-de10-476b-8c7e-29a48142663d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.338328 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2323467-de10-476b-8c7e-29a48142663d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.357291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f2323467-de10-476b-8c7e-29a48142663d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:56.358506 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f2323467-de10-476b-8c7e-29a48142663d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:56.369596 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:56.424523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:56.433078 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 226/438] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:07:56.434903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0ac3e-7445-4b1e-a6f0-1b48f249e881 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.435712 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0ac3e-7445-4b1e-a6f0-1b48f249e881 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.436380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fe0ac3e-7445-4b1e-a6f0-1b48f249e881 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.437975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 227/439] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:07:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:07:56.444731 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19134e-7a78-43e7-856d-96cf65e483ff None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.445231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19134e-7a78-43e7-856d-96cf65e483ff None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.445647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce19134e-7a78-43e7-856d-96cf65e483ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.445817 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd92321-b136-47ac-8767-18ca6fa4e6d9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:56.465884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ce19134e-7a78-43e7-856d-96cf65e483ff None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:07:56.467184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ce19134e-7a78-43e7-856d-96cf65e483ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:07:56.497198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ccd14-5277-4030-84f4-07f6ba5b174b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:56.498068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ccd14-5277-4030-84f4-07f6ba5b174b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.498353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ccd14-5277-4030-84f4-07f6ba5b174b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.498631 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-722ccd14-5277-4030-84f4-07f6ba5b174b None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.499921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ccd14-5277-4030-84f4-07f6ba5b174b None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:56.501545 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-722ccd14-5277-4030-84f4-07f6ba5b174b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:56.503237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 213/440] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:56 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:56.504001 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ccd14-5277-4030-84f4-07f6ba5b174b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:56.548250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 228/441] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:07:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:07:56.549494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19134e-7a78-43e7-856d-96cf65e483ff None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:56.621634 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-722ccd14-5277-4030-84f4-07f6ba5b174b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:56.639217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:56.656964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ced9a-6da3-4913-aa02-5647fd7cf1e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:56.657883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ced9a-6da3-4913-aa02-5647fd7cf1e4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.658182 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ced9a-6da3-4913-aa02-5647fd7cf1e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.658462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165ced9a-6da3-4913-aa02-5647fd7cf1e4 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.664515 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce19134e-7a78-43e7-856d-96cf65e483ff None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:56.668597 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165ced9a-6da3-4913-aa02-5647fd7cf1e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-165ced9a-6da3-4913-aa02-5647fd7cf1e4 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:56.676671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:56.677576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:56.678383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:56.678383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:56.678383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:56.678383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:56.678383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:56.678383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:56.678383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:56.678383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:56.678383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:56.678383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:56.678383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:07:56.678383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:56.678383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 214/442] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:07:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:56.679014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ced9a-6da3-4913-aa02-5647fd7cf1e4 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:56.690585 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:56.704081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8129efe-63fd-49f0-b600-52d9ed21f32c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:56.704943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129efe-63fd-49f0-b600-52d9ed21f32c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.705255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129efe-63fd-49f0-b600-52d9ed21f32c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.705535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8129efe-63fd-49f0-b600-52d9ed21f32c None admin] PATH_INFO: `/v3/groups/1ca7eeaace04437a81da6f9b9d341782` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.706698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8129efe-63fd-49f0-b600-52d9ed21f32c None admin] RBAC: Authorizing `identity:get_group(group_id=1ca7eeaace04437a81da6f9b9d341782)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:56.708151 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8129efe-63fd-49f0-b600-52d9ed21f32c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:56.709797 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 229/443] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:56 2022] GET /identity/v3/groups/1ca7eeaace04437a81da6f9b9d341782 => generated 226 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:56.710541 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8129efe-63fd-49f0-b600-52d9ed21f32c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:56.778213 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165ced9a-6da3-4913-aa02-5647fd7cf1e4 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:56.811202 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b660ba5-eb75-428a-b119-10e5ba616f3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:56.811988 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b660ba5-eb75-428a-b119-10e5ba616f3b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.812201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8129efe-63fd-49f0-b600-52d9ed21f32c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:56.812318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b660ba5-eb75-428a-b119-10e5ba616f3b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.812537 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b660ba5-eb75-428a-b119-10e5ba616f3b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.822510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b660ba5-eb75-428a-b119-10e5ba616f3b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-1b660ba5-eb75-428a-b119-10e5ba616f3b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:07:56.830717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:07:56.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:07:56.832345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:07:56.832345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:07:56.832345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:07:56.832345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:07:56.832345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:07:56.832345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:07:56.832345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:07:56.832345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:07:56.832345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:07:56.832345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:07:56.832345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:07:56.832345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:07:56.832345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 215/444] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:07:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:07:56.832979 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b660ba5-eb75-428a-b119-10e5ba616f3b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:56.847035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08bb1d-acb9-4197-bd98-58365287662c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:56.847701 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08bb1d-acb9-4197-bd98-58365287662c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.847984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08bb1d-acb9-4197-bd98-58365287662c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.848258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd08bb1d-acb9-4197-bd98-58365287662c None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.849040 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08bb1d-acb9-4197-bd98-58365287662c None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:56.849338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08bb1d-acb9-4197-bd98-58365287662c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:56.850689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd08bb1d-acb9-4197-bd98-58365287662c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:56.858838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 230/445] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:07:56 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:56.859632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08bb1d-acb9-4197-bd98-58365287662c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:56.864161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:56.902949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:56.934881 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b660ba5-eb75-428a-b119-10e5ba616f3b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:56.960552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd08bb1d-acb9-4197-bd98-58365287662c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:56.967314 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ad09c-949a-47c3-8644-14cff94d26fa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:56.967956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ad09c-949a-47c3-8644-14cff94d26fa None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.968239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ad09c-949a-47c3-8644-14cff94d26fa None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.968517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296ad09c-949a-47c3-8644-14cff94d26fa None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.969371 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ad09c-949a-47c3-8644-14cff94d26fa None admin] RBAC: Adding query filter params (group.id=1ca7eeaace04437a81da6f9b9d341782, role.id=f4ccd6ca72d7486d85d90f7585de12c9, scope.project.id=a9a90082c4c1407981192ee9bb7a8e19) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:56.969685 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ad09c-949a-47c3-8644-14cff94d26fa None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:56.971114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296ad09c-949a-47c3-8644-14cff94d26fa None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:56.976763 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 216/446] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 26 18:07:56 2022] GET /identity/v3/role_assignments?group.id=1ca7eeaace04437a81da6f9b9d341782&scope.project.id=a9a90082c4c1407981192ee9bb7a8e19&role.id=f4ccd6ca72d7486d85d90f7585de12c9 => generated 611 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:56.977557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ad09c-949a-47c3-8644-14cff94d26fa None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:56.995757 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065453b-05c5-459d-8976-767debfbf020 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:56.996441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065453b-05c5-459d-8976-767debfbf020 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:56.996725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065453b-05c5-459d-8976-767debfbf020 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:56.997009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9065453b-05c5-459d-8976-767debfbf020 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:56.997785 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065453b-05c5-459d-8976-767debfbf020 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:56.998093 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065453b-05c5-459d-8976-767debfbf020 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:56.999510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9065453b-05c5-459d-8976-767debfbf020 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.008901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 231/447] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:07:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:07:57.014986 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065453b-05c5-459d-8976-767debfbf020 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.086195 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:57.088175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296ad09c-949a-47c3-8644-14cff94d26fa None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.124524 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef02cec-f633-4655-a925-35055f838f01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.125210 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02cec-f633-4655-a925-35055f838f01 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.125494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02cec-f633-4655-a925-35055f838f01 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.125770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ef02cec-f633-4655-a925-35055f838f01 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.128680 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:57.131165 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9065453b-05c5-459d-8976-767debfbf020 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.179726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956b4bc-4c7e-4514-8438-706e5362a5d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.180308 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956b4bc-4c7e-4514-8438-706e5362a5d7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.180624 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956b4bc-4c7e-4514-8438-706e5362a5d7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.181035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5956b4bc-4c7e-4514-8438-706e5362a5d7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.207155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef02cec-f633-4655-a925-35055f838f01 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.208764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ef02cec-f633-4655-a925-35055f838f01 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.264215 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956b4bc-4c7e-4514-8438-706e5362a5d7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.265734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5956b4bc-4c7e-4514-8438-706e5362a5d7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.329101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 217/448] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:56 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:07:57.330751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef02cec-f633-4655-a925-35055f838f01 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.343604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:57.370823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:57.381585 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 232/449] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:07:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 367 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) May 26 18:07:57.387059 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956b4bc-4c7e-4514-8438-706e5362a5d7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.435903 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ef02cec-f633-4655-a925-35055f838f01 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.468194 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a1c85-dd5d-40c2-b572-0697b26e6c95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.469068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a1c85-dd5d-40c2-b572-0697b26e6c95 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.469357 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a1c85-dd5d-40c2-b572-0697b26e6c95 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.469638 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc9a1c85-dd5d-40c2-b572-0697b26e6c95 None admin] PATH_INFO: `/v3/projects/a9a90082c4c1407981192ee9bb7a8e19` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.470814 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a1c85-dd5d-40c2-b572-0697b26e6c95 None admin] RBAC: Authorizing `identity:get_project(project_id=a9a90082c4c1407981192ee9bb7a8e19)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.472256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc9a1c85-dd5d-40c2-b572-0697b26e6c95 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.473983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 218/450] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:57 2022] GET /identity/v3/projects/a9a90082c4c1407981192ee9bb7a8e19 => generated 302 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:57.479827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a1c85-dd5d-40c2-b572-0697b26e6c95 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.482773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5956b4bc-4c7e-4514-8438-706e5362a5d7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.516618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fae2ff-b475-4dc0-8abb-1aceb18ad862 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.517506 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fae2ff-b475-4dc0-8abb-1aceb18ad862 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.517790 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fae2ff-b475-4dc0-8abb-1aceb18ad862 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.518087 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95fae2ff-b475-4dc0-8abb-1aceb18ad862 None admin] PATH_INFO: `/v3/projects/04b116e5fb9e430e9155c1db8872f881` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.519246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fae2ff-b475-4dc0-8abb-1aceb18ad862 None admin] RBAC: Authorizing `identity:get_project(project_id=04b116e5fb9e430e9155c1db8872f881)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.520690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95fae2ff-b475-4dc0-8abb-1aceb18ad862 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.522395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 233/451] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:07:57 2022] GET /identity/v3/projects/04b116e5fb9e430e9155c1db8872f881 => generated 344 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:57.528024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fae2ff-b475-4dc0-8abb-1aceb18ad862 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.560470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:57.576892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc9a1c85-dd5d-40c2-b572-0697b26e6c95 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.578436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:57.612010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d97522-c0eb-4417-be69-f682b0ad03ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.612852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d97522-c0eb-4417-be69-f682b0ad03ad None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.613167 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d97522-c0eb-4417-be69-f682b0ad03ad None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.613444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66d97522-c0eb-4417-be69-f682b0ad03ad None admin] PATH_INFO: `/v3/groups/1ca7eeaace04437a81da6f9b9d341782` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.614598 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d97522-c0eb-4417-be69-f682b0ad03ad None admin] RBAC: Authorizing `identity:get_group(group_id=1ca7eeaace04437a81da6f9b9d341782)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.616023 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66d97522-c0eb-4417-be69-f682b0ad03ad None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.617646 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 219/452] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:57 2022] GET /identity/v3/groups/1ca7eeaace04437a81da6f9b9d341782 => generated 226 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:57.623186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d97522-c0eb-4417-be69-f682b0ad03ad None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.630019 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95fae2ff-b475-4dc0-8abb-1aceb18ad862 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.662981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee307c-3196-4c3b-a388-c408e1e440ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.663829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee307c-3196-4c3b-a388-c408e1e440ba None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.664111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee307c-3196-4c3b-a388-c408e1e440ba None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.664390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcee307c-3196-4c3b-a388-c408e1e440ba None admin] PATH_INFO: `/v3/groups/ff65a9085876497fbdcbcc1fc42acc63` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.665589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee307c-3196-4c3b-a388-c408e1e440ba None admin] RBAC: Authorizing `identity:get_group(group_id=ff65a9085876497fbdcbcc1fc42acc63)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.667571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcee307c-3196-4c3b-a388-c408e1e440ba None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.669196 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 234/453] 10.222.0.64 () {56 vars in 1180 bytes} [Thu May 26 18:07:57 2022] GET /identity/v3/groups/ff65a9085876497fbdcbcc1fc42acc63 => generated 229 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:57.674746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee307c-3196-4c3b-a388-c408e1e440ba None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:07:57.720518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66d97522-c0eb-4417-be69-f682b0ad03ad None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.753376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9afbad1d-1e75-41b3-863a-fbff5c20f42a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.754014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbad1d-1e75-41b3-863a-fbff5c20f42a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.754293 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbad1d-1e75-41b3-863a-fbff5c20f42a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.754568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9afbad1d-1e75-41b3-863a-fbff5c20f42a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.755378 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbad1d-1e75-41b3-863a-fbff5c20f42a None admin] RBAC: Adding query filter params (group.id=1ca7eeaace04437a81da6f9b9d341782, role.id=1b7e8aa514f04cef9c1da777642b34a8, scope.project.id=a9a90082c4c1407981192ee9bb7a8e19) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:57.755693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbad1d-1e75-41b3-863a-fbff5c20f42a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.757131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9afbad1d-1e75-41b3-863a-fbff5c20f42a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.762813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 220/454] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 26 18:07:57 2022] GET /identity/v3/role_assignments?group.id=1ca7eeaace04437a81da6f9b9d341782&scope.project.id=a9a90082c4c1407981192ee9bb7a8e19&role.id=1b7e8aa514f04cef9c1da777642b34a8 => generated 611 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:07:57.772328 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcee307c-3196-4c3b-a388-c408e1e440ba None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:07:57.774084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:07:57.810617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c840856-7a1a-4c63-a0ee-9359aed3e6b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:07:57.811284 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840856-7a1a-4c63-a0ee-9359aed3e6b1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:07:57.811566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840856-7a1a-4c63-a0ee-9359aed3e6b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:07:57.811843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c840856-7a1a-4c63-a0ee-9359aed3e6b1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:07:57.812681 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c840856-7a1a-4c63-a0ee-9359aed3e6b1 None admin] RBAC: Adding query filter params (group.id=ff65a9085876497fbdcbcc1fc42acc63, role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=04b116e5fb9e430e9155c1db8872f881) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:07:57.813020 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c840856-7a1a-4c63-a0ee-9359aed3e6b1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:07:57.814483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c840856-7a1a-4c63-a0ee-9359aed3e6b1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:07:57.821222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 235/455] 10.222.0.64 () {56 vars in 1376 bytes} [Thu May 26 18:07:57 2022] GET /identity/v3/role_assignments?group.id=ff65a9085876497fbdcbcc1fc42acc63&scope.project.id=04b116e5fb9e430e9155c1db8872f881&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 611 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:00.578154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fd9a6-65b0-4a72-890a-357b221ea048 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:00.578640 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fd9a6-65b0-4a72-890a-357b221ea048 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:00.578640 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fd9a6-65b0-4a72-890a-357b221ea048 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:00.580223 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 221/456] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:00.585543 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4fcb2-ce1b-4e15-a824-55ad6fdf9d2f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:00.586340 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4fcb2-ce1b-4e15-a824-55ad6fdf9d2f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:00.586821 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a4fcb2-ce1b-4e15-a824-55ad6fdf9d2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:00.611168 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-33a4fcb2-ce1b-4e15-a824-55ad6fdf9d2f None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:00.612742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-33a4fcb2-ce1b-4e15-a824-55ad6fdf9d2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:00.704074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 236/457] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:00.735597 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fd9a6-65b0-4a72-890a-357b221ea048 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:00.785115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:00.806156 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc6af3-858c-456f-b238-1d4897b53bf4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:00.806794 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc6af3-858c-456f-b238-1d4897b53bf4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:00.807274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00fc6af3-858c-456f-b238-1d4897b53bf4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:00.809652 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 237/458] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:00.822844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997a01c-0347-44fb-9539-96d71eb3d9eb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:00.823997 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997a01c-0347-44fb-9539-96d71eb3d9eb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:00.824501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5997a01c-0347-44fb-9539-96d71eb3d9eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:00.854973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5997a01c-0347-44fb-9539-96d71eb3d9eb None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:00.856473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5997a01c-0347-44fb-9539-96d71eb3d9eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:00.872419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fd9a6-65b0-4a72-890a-357b221ea048 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:00.912921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb59f0f-103f-4e4f-a00f-bc62db7bc3cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:00.913737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb59f0f-103f-4e4f-a00f-bc62db7bc3cc None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:00.914019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb59f0f-103f-4e4f-a00f-bc62db7bc3cc None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:00.914294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edb59f0f-103f-4e4f-a00f-bc62db7bc3cc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:00.925462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb59f0f-103f-4e4f-a00f-bc62db7bc3cc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:00.927033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-edb59f0f-103f-4e4f-a00f-bc62db7bc3cc None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:00.942913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 238/459] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:08:00.944506 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737faae-4905-400a-bd8a-3ed88d3b26a0 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:00.945019 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737faae-4905-400a-bd8a-3ed88d3b26a0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:00.945500 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d737faae-4905-400a-bd8a-3ed88d3b26a0 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-edb59f0f-103f-4e4f-a00f-bc62db7bc3cc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:00.947184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:00.948009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:00.948934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:00.948934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:00.948934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:00.948934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:00.949608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 239/460] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:00.952436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 222/461] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:00.958202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3165151-cf80-4719-beff-a51fa2c51cf2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:00.958489 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3165151-cf80-4719-beff-a51fa2c51cf2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:00.958768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3165151-cf80-4719-beff-a51fa2c51cf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:00.959695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb59f0f-103f-4e4f-a00f-bc62db7bc3cc None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:00.990178 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a3165151-cf80-4719-beff-a51fa2c51cf2 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:00.992408 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a3165151-cf80-4719-beff-a51fa2c51cf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:01.021896 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:01.060238 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:01.077364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edb59f0f-103f-4e4f-a00f-bc62db7bc3cc None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:01.089036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 240/462] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:01.090203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3165151-cf80-4719-beff-a51fa2c51cf2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:01.135201 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50449994-b916-439f-bdd0-2942fbf86e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:01.136151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50449994-b916-439f-bdd0-2942fbf86e40 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:01.136639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50449994-b916-439f-bdd0-2942fbf86e40 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:01.137108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50449994-b916-439f-bdd0-2942fbf86e40 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:01.138097 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50449994-b916-439f-bdd0-2942fbf86e40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:01.138557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50449994-b916-439f-bdd0-2942fbf86e40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:01.140068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50449994-b916-439f-bdd0-2942fbf86e40 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:01.157846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 223/463] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:01.158933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50449994-b916-439f-bdd0-2942fbf86e40 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:01.226231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3165151-cf80-4719-beff-a51fa2c51cf2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:01.270626 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d286d-35bd-417f-a503-7d957ee38d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:01.271541 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d286d-35bd-417f-a503-7d957ee38d90 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:01.272263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d286d-35bd-417f-a503-7d957ee38d90 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:01.273135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-490d286d-35bd-417f-a503-7d957ee38d90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:01.282719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50449994-b916-439f-bdd0-2942fbf86e40 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:01.287546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d286d-35bd-417f-a503-7d957ee38d90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:01.289031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-490d286d-35bd-417f-a503-7d957ee38d90 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-490d286d-35bd-417f-a503-7d957ee38d90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:01.313384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:01.314307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:01.317545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:01.317545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:01.317545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:01.317545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:01.317545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 241/464] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:01.317545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d286d-35bd-417f-a503-7d957ee38d90 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:01.330210 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd364-6dab-4f4d-a4c6-90bdeda8315e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:01.331123 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd364-6dab-4f4d-a4c6-90bdeda8315e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:01.331528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd364-6dab-4f4d-a4c6-90bdeda8315e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:01.331898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a89fd364-6dab-4f4d-a4c6-90bdeda8315e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:01.332383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:01.346219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fd364-6dab-4f4d-a4c6-90bdeda8315e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:01.348049 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a89fd364-6dab-4f4d-a4c6-90bdeda8315e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:01.356319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-a89fd364-6dab-4f4d-a4c6-90bdeda8315e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:01.368174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:01.369072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:01.369890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:01.369890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:01.369890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:01.369890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:01.372162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 224/465] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:01.373326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd364-6dab-4f4d-a4c6-90bdeda8315e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:01.446420 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-490d286d-35bd-417f-a503-7d957ee38d90 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:01.477248 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a89fd364-6dab-4f4d-a4c6-90bdeda8315e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:01.484433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b778198-b601-4cb7-bb52-d30d1c7d0990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:01.485148 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b778198-b601-4cb7-bb52-d30d1c7d0990 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:01.485486 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b778198-b601-4cb7-bb52-d30d1c7d0990 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:01.485770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b778198-b601-4cb7-bb52-d30d1c7d0990 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:01.486482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b778198-b601-4cb7-bb52-d30d1c7d0990 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:01.488021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b778198-b601-4cb7-bb52-d30d1c7d0990 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:01.514104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 242/466] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:08:01 2022] POST /identity/v3/users => generated 246 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:01.515812 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69b26860-6621-43a5-807f-f87bc558ac55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:01.516481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b26860-6621-43a5-807f-f87bc558ac55 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:01.516768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b26860-6621-43a5-807f-f87bc558ac55 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:01.517080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69b26860-6621-43a5-807f-f87bc558ac55 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:01.517815 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b26860-6621-43a5-807f-f87bc558ac55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:01.518126 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b26860-6621-43a5-807f-f87bc558ac55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:01.519573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69b26860-6621-43a5-807f-f87bc558ac55 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:01.522033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b778198-b601-4cb7-bb52-d30d1c7d0990 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:01.538595 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 225/467] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:01.540247 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11502650-e3e0-4613-9409-80424f98070b None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:01.540484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11502650-e3e0-4613-9409-80424f98070b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:01.540770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11502650-e3e0-4613-9409-80424f98070b None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:01.547231 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 226/468] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:01.547231 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11502650-e3e0-4613-9409-80424f98070b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:01.604419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:01.643483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:01.661096 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b778198-b601-4cb7-bb52-d30d1c7d0990 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:01.699221 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11502650-e3e0-4613-9409-80424f98070b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:01.709237 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-978807de-b285-419a-b382-393538249016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:01.710237 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978807de-b285-419a-b382-393538249016 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:01.710528 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978807de-b285-419a-b382-393538249016 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:01.710806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-978807de-b285-419a-b382-393538249016 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:01.711594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978807de-b285-419a-b382-393538249016 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:01.711911 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978807de-b285-419a-b382-393538249016 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:01.713747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-978807de-b285-419a-b382-393538249016 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:01.736236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 243/469] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:01.737732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9ee50-7347-4d0a-911f-41030d8a247a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:01.737999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9ee50-7347-4d0a-911f-41030d8a247a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:01.738288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd9ee50-7347-4d0a-911f-41030d8a247a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:01.740384 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12647141-b960-431c-997c-5c67b48057d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:01.741209 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12647141-b960-431c-997c-5c67b48057d1 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:01.741496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12647141-b960-431c-997c-5c67b48057d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:01.741775 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12647141-b960-431c-997c-5c67b48057d1 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:01.742593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12647141-b960-431c-997c-5c67b48057d1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:01.744246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12647141-b960-431c-997c-5c67b48057d1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:01.759829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-abd9ee50-7347-4d0a-911f-41030d8a247a None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:01.761927 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-abd9ee50-7347-4d0a-911f-41030d8a247a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:01.765788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 227/470] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:08:01 2022] POST /identity/v3/users => generated 248 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:08:01.767041 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12647141-b960-431c-997c-5c67b48057d1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:01.868046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 244/471] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:01.895096 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9ee50-7347-4d0a-911f-41030d8a247a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:01.902180 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12647141-b960-431c-997c-5c67b48057d1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:01.925446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:01.964503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28cc2b-4797-476c-8920-68756483a1df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:01.965187 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28cc2b-4797-476c-8920-68756483a1df None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:01.965479 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28cc2b-4797-476c-8920-68756483a1df None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:01.966147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28cc2b-4797-476c-8920-68756483a1df None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:01.966877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28cc2b-4797-476c-8920-68756483a1df None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:01.969019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba28cc2b-4797-476c-8920-68756483a1df None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:01.981153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:01.998532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 228/472] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:08:01 2022] POST /identity/v3/users => generated 248 bytes in 232 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:01.999987 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e2f48-30b5-42e2-a24f-bcd98d1a73b4 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:02.000283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e2f48-30b5-42e2-a24f-bcd98d1a73b4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:02.000566 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789e2f48-30b5-42e2-a24f-bcd98d1a73b4 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:02.002173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 229/473] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:02.019675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f6cf5-aa48-4fd5-95df-35371285b1a9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:02.020259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f6cf5-aa48-4fd5-95df-35371285b1a9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:02.020888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-002f6cf5-aa48-4fd5-95df-35371285b1a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:02.041807 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-002f6cf5-aa48-4fd5-95df-35371285b1a9 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:02.042375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd9ee50-7347-4d0a-911f-41030d8a247a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:02.043697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-002f6cf5-aa48-4fd5-95df-35371285b1a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:02.083256 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b03024-854f-4d15-b59e-0fa419838cbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:02.084166 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b03024-854f-4d15-b59e-0fa419838cbe None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:02.084393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b03024-854f-4d15-b59e-0fa419838cbe None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:02.084629 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61b03024-854f-4d15-b59e-0fa419838cbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:02.098172 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b03024-854f-4d15-b59e-0fa419838cbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:02.100471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61b03024-854f-4d15-b59e-0fa419838cbe None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-61b03024-854f-4d15-b59e-0fa419838cbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:02.122171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:02.123103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:02.123915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:02.123915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:02.123915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:02.123915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:02.128299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 245/474] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:02.129686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b03024-854f-4d15-b59e-0fa419838cbe None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:02.135453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 230/475] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:08:02.162947 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f6cf5-aa48-4fd5-95df-35371285b1a9 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:02.263580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61b03024-854f-4d15-b59e-0fa419838cbe None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:02.273330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:02.281494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:02.284233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-002f6cf5-aa48-4fd5-95df-35371285b1a9 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:02.311372 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ce42f-d64c-4a11-904e-03b68e50cea7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:02.312202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ce42f-d64c-4a11-904e-03b68e50cea7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:02.312484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ce42f-d64c-4a11-904e-03b68e50cea7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:02.313272 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223ce42f-d64c-4a11-904e-03b68e50cea7 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:02.314281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ce42f-d64c-4a11-904e-03b68e50cea7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:02.314591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ce42f-d64c-4a11-904e-03b68e50cea7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:02.316126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223ce42f-d64c-4a11-904e-03b68e50cea7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:02.327620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c6f2c-a92e-4f57-bf02-acb2cd2bd0ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:02.328284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c6f2c-a92e-4f57-bf02-acb2cd2bd0ed None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:02.329330 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c6f2c-a92e-4f57-bf02-acb2cd2bd0ed None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:02.329686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c67c6f2c-a92e-4f57-bf02-acb2cd2bd0ed None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:02.330529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c6f2c-a92e-4f57-bf02-acb2cd2bd0ed None admin] RBAC: Authorizing `identity:create_role()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:02.332068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c67c6f2c-a92e-4f57-bf02-acb2cd2bd0ed None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:02.332198 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 246/476] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:02.339851 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ce42f-d64c-4a11-904e-03b68e50cea7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:02.347740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.sql.core [None req-c67c6f2c-a92e-4f57-bf02-acb2cd2bd0ed None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 18:08:02.347740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 18:08:02.347740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [parameters: {'id': 'e3c4e0e5571c49b5aae35bf7c4ffb163', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 18:08:02.347740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80230) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-c67c6f2c-a92e-4f57-bf02-acb2cd2bd0ed None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application result = self._query(query) May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application conn.query(q) May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application result.read() May 26 18:08:02.366620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return ref.to_dict() May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 18:08:02.367708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application next(self.gen) May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application yield resource May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application next(self.gen) May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.session.rollback() May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.force_reraise() May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise self.value May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application session.commit() May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 18:08:02.368771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._prepare_impl() May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.session.flush() May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._flush(objects) May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application compat.raise_( May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application flush_context.execute() May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rec.execute(self) May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 18:08:02.369644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 18:08:02.371044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application result = self._query(query) May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application conn.query(q) May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application result.read() May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 18:08:02.371929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [parameters: {'id': 'e3c4e0e5571c49b5aae35bf7c4ffb163', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:02.372718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. May 26 18:08:02.374538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:02.388224 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 231/477] 10.222.0.64 () {60 vars in 1131 bytes} [Thu May 26 18:08:02 2022] POST /identity/v3/roles => generated 144 bytes in 208 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:02.388224 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c6f2c-a92e-4f57-bf02-acb2cd2bd0ed None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:02.506032 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223ce42f-d64c-4a11-904e-03b68e50cea7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:02.512512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c67c6f2c-a92e-4f57-bf02-acb2cd2bd0ed None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:02.550827 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-867b3b9a-a04d-4ef6-bf40-c42f59b89425 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:02.551010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446d1c1-d256-4a07-98a4-b9ea6e2699ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:02.551419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b3b9a-a04d-4ef6-bf40-c42f59b89425 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:02.551539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446d1c1-d256-4a07-98a4-b9ea6e2699ae None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:02.551707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b3b9a-a04d-4ef6-bf40-c42f59b89425 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:02.551874 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446d1c1-d256-4a07-98a4-b9ea6e2699ae None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:02.551964 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-867b3b9a-a04d-4ef6-bf40-c42f59b89425 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:02.552108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3446d1c1-d256-4a07-98a4-b9ea6e2699ae None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:02.552862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b3b9a-a04d-4ef6-bf40-c42f59b89425 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:02.555015 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-867b3b9a-a04d-4ef6-bf40-c42f59b89425 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:02.568441 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3446d1c1-d256-4a07-98a4-b9ea6e2699ae None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-3446d1c1-d256-4a07-98a4-b9ea6e2699ae None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:02.578359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:02.579261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:02.580067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:02.580067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:02.580067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:02.580067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:02.580067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:02.580067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:02.580067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:02.580067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:02.580067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:02.580067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:02.580067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. May 26 18:08:02.580067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:02.580067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 232/478] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:08:02 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:02.587144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446d1c1-d256-4a07-98a4-b9ea6e2699ae None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:02.596190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 247/479] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:08:02 2022] POST /identity/v3/users => generated 249 bytes in 257 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:08:02.642199 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:02.761677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3446d1c1-d256-4a07-98a4-b9ea6e2699ae None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:02.816036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-873bdbf5-2c33-4e9d-b542-f1389d4bd436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:02.816630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bdbf5-2c33-4e9d-b542-f1389d4bd436 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:02.816910 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bdbf5-2c33-4e9d-b542-f1389d4bd436 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:02.817214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-873bdbf5-2c33-4e9d-b542-f1389d4bd436 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:02.817959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bdbf5-2c33-4e9d-b542-f1389d4bd436 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:02.818263 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bdbf5-2c33-4e9d-b542-f1389d4bd436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:02.819629 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-873bdbf5-2c33-4e9d-b542-f1389d4bd436 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:02.830204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 233/480] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:04.615261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af385ad-0f8e-4fdd-91b9-82d61efe0b45 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:04.615751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af385ad-0f8e-4fdd-91b9-82d61efe0b45 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:04.615751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af385ad-0f8e-4fdd-91b9-82d61efe0b45 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:04.617368 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 248/481] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:04.623376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6dcaf-c415-40c8-a9bc-9f5e21aeb2af None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:04.623761 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6dcaf-c415-40c8-a9bc-9f5e21aeb2af None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:04.623923 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc6dcaf-c415-40c8-a9bc-9f5e21aeb2af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:04.643885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d71ee-36b1-4604-a02a-374de1759967 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:04.644532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d71ee-36b1-4604-a02a-374de1759967 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:04.645046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be6d71ee-36b1-4604-a02a-374de1759967 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:04.646983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 249/482] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:04 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:04.649344 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-1fc6dcaf-c415-40c8-a9bc-9f5e21aeb2af None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:04.650592 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1fc6dcaf-c415-40c8-a9bc-9f5e21aeb2af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:04.655121 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e518e58-4459-4d2b-b61d-235d1aab3d64 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:04.655742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e518e58-4459-4d2b-b61d-235d1aab3d64 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:04.656213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e518e58-4459-4d2b-b61d-235d1aab3d64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:04.689011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2e518e58-4459-4d2b-b61d-235d1aab3d64 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:04.689011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2e518e58-4459-4d2b-b61d-235d1aab3d64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:04.726677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:04.769308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 234/483] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:08:04.800428 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6dcaf-c415-40c8-a9bc-9f5e21aeb2af None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:04.812933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 250/484] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:08:04.828737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:04.854045 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e518e58-4459-4d2b-b61d-235d1aab3d64 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:04.941528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc6dcaf-c415-40c8-a9bc-9f5e21aeb2af None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:04.969608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e518e58-4459-4d2b-b61d-235d1aab3d64 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:04.993581 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d50ec8-1f39-433c-944c-d366a6c8548a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:04.994369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50ec8-1f39-433c-944c-d366a6c8548a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:04.994704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50ec8-1f39-433c-944c-d366a6c8548a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:04.994977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d50ec8-1f39-433c-944c-d366a6c8548a None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.006159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0d50ec8-1f39-433c-944c-d366a6c8548a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:05.010003 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c33de6f2-134d-4d13-9d9a-20e7c868dfaa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:05.010805 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de6f2-134d-4d13-9d9a-20e7c868dfaa None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.011126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de6f2-134d-4d13-9d9a-20e7c868dfaa None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.011404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c33de6f2-134d-4d13-9d9a-20e7c868dfaa None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-c0d50ec8-1f39-433c-944c-d366a6c8548a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:05.014359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:05.015189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:05.016389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:05.016389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:05.016389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:05.016389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:05.016389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:05.016389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:05.016389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:05.016389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:05.016389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:05.016389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:05.016389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:05.016389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:05.016389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 235/485] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 216 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:05.017809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64316d3e-4683-4153-8ec1-5a7975a82c4e None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.017809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64316d3e-4683-4153-8ec1-5a7975a82c4e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.017809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64316d3e-4683-4153-8ec1-5a7975a82c4e None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.020749 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 236/486] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:05 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:05.021563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64316d3e-4683-4153-8ec1-5a7975a82c4e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:05.029185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c33de6f2-134d-4d13-9d9a-20e7c868dfaa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c33de6f2-134d-4d13-9d9a-20e7c868dfaa None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:05.039415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:05.041229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:05.043267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:05.043267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:05.043267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:05.043267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:05.043267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:05.043267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:05.043267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:05.043267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:05.043267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:05.043267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:05.043267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:05.043267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:05.045824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 251/487] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:04 2022] GET /identity/v3/roles/service => generated 85 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:05.053003 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27972d0-11db-4812-b837-c29dea7c4242 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.053003 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27972d0-11db-4812-b837-c29dea7c4242 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.053003 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d27972d0-11db-4812-b837-c29dea7c4242 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.072509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d27972d0-11db-4812-b837-c29dea7c4242 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:05.073840 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d27972d0-11db-4812-b837-c29dea7c4242 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:05.084294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:05.117127 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:05.148223 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64316d3e-4683-4153-8ec1-5a7975a82c4e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:05.167332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 252/488] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:05.168495 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27972d0-11db-4812-b837-c29dea7c4242 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:05.184823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19ae1b-331a-4cd7-b527-c0ff45125588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:05.185719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19ae1b-331a-4cd7-b527-c0ff45125588 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.186045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19ae1b-331a-4cd7-b527-c0ff45125588 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.186408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c19ae1b-331a-4cd7-b527-c0ff45125588 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.187218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19ae1b-331a-4cd7-b527-c0ff45125588 None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:05.187526 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19ae1b-331a-4cd7-b527-c0ff45125588 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:05.189024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c19ae1b-331a-4cd7-b527-c0ff45125588 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:05.198321 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 237/489] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:05.203803 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19ae1b-331a-4cd7-b527-c0ff45125588 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:05.294838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d27972d0-11db-4812-b837-c29dea7c4242 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:05.331404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c19ae1b-331a-4cd7-b527-c0ff45125588 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:05.338225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f305394-e54d-427f-a0ea-3a5098da0347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:05.339158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f305394-e54d-427f-a0ea-3a5098da0347 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.339619 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f305394-e54d-427f-a0ea-3a5098da0347 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.340065 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f305394-e54d-427f-a0ea-3a5098da0347 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.340976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f305394-e54d-427f-a0ea-3a5098da0347 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:05.341484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f305394-e54d-427f-a0ea-3a5098da0347 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:05.343048 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f305394-e54d-427f-a0ea-3a5098da0347 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:05.351803 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 253/490] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:05.352746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f305394-e54d-427f-a0ea-3a5098da0347 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:05.360288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:05.369203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1601c50f-b839-4c72-92d7-51cf9eefabb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:05.369991 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601c50f-b839-4c72-92d7-51cf9eefabb6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.370271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601c50f-b839-4c72-92d7-51cf9eefabb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.371064 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1601c50f-b839-4c72-92d7-51cf9eefabb6 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.378292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:05.383361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1601c50f-b839-4c72-92d7-51cf9eefabb6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-1601c50f-b839-4c72-92d7-51cf9eefabb6 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:05.392009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:05.393085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:05.393919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:05.393919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:05.393919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:05.393919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:05.393919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:05.393919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:05.393919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:05.393919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:05.393919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:05.393919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:05.393919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:05.393919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:05.393919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 238/491] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:05.394828 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf08741-b044-462b-adb1-1d8871db6d5c None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.395114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf08741-b044-462b-adb1-1d8871db6d5c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.395384 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf08741-b044-462b-adb1-1d8871db6d5c None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.396775 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 239/492] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:05.401465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf08741-b044-462b-adb1-1d8871db6d5c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:05.470123 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f305394-e54d-427f-a0ea-3a5098da0347 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:05.509502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf08741-b044-462b-adb1-1d8871db6d5c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:05.513877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a35b7-fe2e-4394-8241-b397fd9ab59a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:05.514677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a35b7-fe2e-4394-8241-b397fd9ab59a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.514963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a35b7-fe2e-4394-8241-b397fd9ab59a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.515241 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a38a35b7-fe2e-4394-8241-b397fd9ab59a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.526990 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a35b7-fe2e-4394-8241-b397fd9ab59a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:05.528431 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a38a35b7-fe2e-4394-8241-b397fd9ab59a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:05.543272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa09949-aee4-4159-9fb9-5117fa2229e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:05.544049 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09949-aee4-4159-9fb9-5117fa2229e4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.544329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09949-aee4-4159-9fb9-5117fa2229e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.544601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa09949-aee4-4159-9fb9-5117fa2229e4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a38a35b7-fe2e-4394-8241-b397fd9ab59a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:05.547743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:05.548538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:05.549405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:05.549405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:05.549405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:05.549405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:05.549405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 254/493] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:05.554478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a35b7-fe2e-4394-8241-b397fd9ab59a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:05.559054 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa09949-aee4-4159-9fb9-5117fa2229e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:05.560498 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa09949-aee4-4159-9fb9-5117fa2229e4 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-afa09949-aee4-4159-9fb9-5117fa2229e4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:05.577711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:05.578563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:05.579373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:05.579373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:05.579373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:05.579373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:05.579373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 240/494] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:05.580145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52c908-28b1-4387-b0ea-964ffa21e927 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.580429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52c908-28b1-4387-b0ea-964ffa21e927 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.580699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff52c908-28b1-4387-b0ea-964ffa21e927 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.597218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ff52c908-28b1-4387-b0ea-964ffa21e927 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:05.598382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ff52c908-28b1-4387-b0ea-964ffa21e927 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:05.617939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:05.646033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:05.665538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a38a35b7-fe2e-4394-8241-b397fd9ab59a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:05.668302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 241/495] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:05.669177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52c908-28b1-4387-b0ea-964ffa21e927 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:05.702739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40316ee-7d7c-4f25-ae6b-bc0bc02796a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:05.703409 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40316ee-7d7c-4f25-ae6b-bc0bc02796a5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.703696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40316ee-7d7c-4f25-ae6b-bc0bc02796a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.703976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e40316ee-7d7c-4f25-ae6b-bc0bc02796a5 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.704721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40316ee-7d7c-4f25-ae6b-bc0bc02796a5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:05.705061 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40316ee-7d7c-4f25-ae6b-bc0bc02796a5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:05.706445 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e40316ee-7d7c-4f25-ae6b-bc0bc02796a5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:05.714336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 255/496] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:05 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:05.715107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40316ee-7d7c-4f25-ae6b-bc0bc02796a5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:05.771729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff52c908-28b1-4387-b0ea-964ffa21e927 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:05.806003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74baac8e-c413-4d69-82a2-325297767c8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:05.806652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baac8e-c413-4d69-82a2-325297767c8d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.806929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baac8e-c413-4d69-82a2-325297767c8d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.807199 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74baac8e-c413-4d69-82a2-325297767c8d None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.807924 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74baac8e-c413-4d69-82a2-325297767c8d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:05.808408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74baac8e-c413-4d69-82a2-325297767c8d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:05.809811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74baac8e-c413-4d69-82a2-325297767c8d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:05.815026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e40316ee-7d7c-4f25-ae6b-bc0bc02796a5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:05.820788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 242/497] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:05.822491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6a33-28a3-4946-8894-9d6c1f0a6577 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.822774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6a33-28a3-4946-8894-9d6c1f0a6577 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.823051 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3dc6a33-28a3-4946-8894-9d6c1f0a6577 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.825918 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 243/498] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:05.826032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc6a33-28a3-4946-8894-9d6c1f0a6577 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:05.832850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:05.850181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7998c-6bf8-45d7-be99-a7d4dcca030a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:05.850862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7998c-6bf8-45d7-be99-a7d4dcca030a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.851143 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7998c-6bf8-45d7-be99-a7d4dcca030a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.851422 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7998c-6bf8-45d7-be99-a7d4dcca030a None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.852136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7998c-6bf8-45d7-be99-a7d4dcca030a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:05.852443 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7998c-6bf8-45d7-be99-a7d4dcca030a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:05.853845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47a7998c-6bf8-45d7-be99-a7d4dcca030a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:05.866609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 256/499] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:05.867377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7998c-6bf8-45d7-be99-a7d4dcca030a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:05.873172 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:05.932195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3dc6a33-28a3-4946-8894-9d6c1f0a6577 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:05.960888 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7998c-6bf8-45d7-be99-a7d4dcca030a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:05.964010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0575a07-3609-45ae-bed1-8f761b80cdf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:05.965311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0575a07-3609-45ae-bed1-8f761b80cdf0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:05.965594 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0575a07-3609-45ae-bed1-8f761b80cdf0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:05.965869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0575a07-3609-45ae-bed1-8f761b80cdf0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:05.975732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0575a07-3609-45ae-bed1-8f761b80cdf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-c0575a07-3609-45ae-bed1-8f761b80cdf0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:05.984128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:05.985169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:05.985964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:05.985964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:05.985964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:05.985964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:05.985964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:05.985964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:05.985964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:05.985964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:05.985964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:05.985964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:05.985964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:05.985964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:05.985964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 244/500] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:05 2022] GET /identity/v3/roles/service => generated 85 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:05.986607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0575a07-3609-45ae-bed1-8f761b80cdf0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:06.000569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed98c06-740b-4114-9472-3cb210d1d967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:06.001401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed98c06-740b-4114-9472-3cb210d1d967 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:06.001687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed98c06-740b-4114-9472-3cb210d1d967 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:06.001962 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed98c06-740b-4114-9472-3cb210d1d967 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:06.012200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed98c06-740b-4114-9472-3cb210d1d967 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:06.013743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ed98c06-740b-4114-9472-3cb210d1d967 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-2ed98c06-740b-4114-9472-3cb210d1d967 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:06.031316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:06.032139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:06.032968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:06.032968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:06.032968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:06.032968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:06.032968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 257/501] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:06.033640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37810bed-b301-48be-be20-19efd204b143 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:06.033863 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37810bed-b301-48be-be20-19efd204b143 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:06.034133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37810bed-b301-48be-be20-19efd204b143 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:06.050167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-37810bed-b301-48be-be20-19efd204b143 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:06.051341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-37810bed-b301-48be-be20-19efd204b143 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:06.075305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:06.087194 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:06.090739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0575a07-3609-45ae-bed1-8f761b80cdf0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:06.118699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 258/502] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:06.119699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37810bed-b301-48be-be20-19efd204b143 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:06.125412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671a93b-258a-49d3-bccc-82e3d60bc8d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:06.126203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671a93b-258a-49d3-bccc-82e3d60bc8d8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:06.126494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671a93b-258a-49d3-bccc-82e3d60bc8d8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:06.126772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2671a93b-258a-49d3-bccc-82e3d60bc8d8 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:06.135225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671a93b-258a-49d3-bccc-82e3d60bc8d8 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:06.137210 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2671a93b-258a-49d3-bccc-82e3d60bc8d8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-2671a93b-258a-49d3-bccc-82e3d60bc8d8 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:06.154431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:06.155399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:06.156259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:06.156259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:06.156259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:06.156259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:06.156259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:06.156259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:06.156259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:06.156259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:06.156259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 18:08:06.156259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:06.156259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 245/503] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 26 18:08:05 2022] GET /identity/v3/users/nova => generated 82 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:06.156799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671a93b-258a-49d3-bccc-82e3d60bc8d8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:06.224549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37810bed-b301-48be-be20-19efd204b143 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:06.254507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2671a93b-258a-49d3-bccc-82e3d60bc8d8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:06.257047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31f88a-14c6-4061-970e-8f642e9beef4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:06.257842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f88a-14c6-4061-970e-8f642e9beef4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:06.258125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f88a-14c6-4061-970e-8f642e9beef4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:06.258400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f31f88a-14c6-4061-970e-8f642e9beef4 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:06.265785 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31f88a-14c6-4061-970e-8f642e9beef4 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:06.267216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f31f88a-14c6-4061-970e-8f642e9beef4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8f31f88a-14c6-4061-970e-8f642e9beef4 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:06.283232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:06.284081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:06.285010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:06.285010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:06.285010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:06.285010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:06.285010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:06.285010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:06.285010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:06.285010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:06.285010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 18:08:06.285010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:06.285010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 259/504] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:08:06 2022] GET /identity/v3/users/glance => generated 84 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:06.285557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31f88a-14c6-4061-970e-8f642e9beef4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:06.291700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004e6ec-e5f4-4157-8131-7aac5b4b80ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:06.292524 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004e6ec-e5f4-4157-8131-7aac5b4b80ad None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:06.292793 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004e6ec-e5f4-4157-8131-7aac5b4b80ad None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:06.293102 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e004e6ec-e5f4-4157-8131-7aac5b4b80ad None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:06.293840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004e6ec-e5f4-4157-8131-7aac5b4b80ad None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:06.294145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004e6ec-e5f4-4157-8131-7aac5b4b80ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:06.295517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e004e6ec-e5f4-4157-8131-7aac5b4b80ad None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:06.303506 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 246/505] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:06 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:06.308127 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004e6ec-e5f4-4157-8131-7aac5b4b80ad None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:06.311383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:06.328382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:06.389475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f31f88a-14c6-4061-970e-8f642e9beef4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:06.402426 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e004e6ec-e5f4-4157-8131-7aac5b4b80ad None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:06.423014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff1a1-a85f-42ba-8f4c-99d441188c41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:06.423709 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff1a1-a85f-42ba-8f4c-99d441188c41 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:06.423995 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff1a1-a85f-42ba-8f4c-99d441188c41 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:06.425299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f76ff1a1-a85f-42ba-8f4c-99d441188c41 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:06.426119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ff1a1-a85f-42ba-8f4c-99d441188c41 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:06.426437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ff1a1-a85f-42ba-8f4c-99d441188c41 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:06.427833 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f76ff1a1-a85f-42ba-8f4c-99d441188c41 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:06.435248 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e9480-2cba-45bf-ac7a-103ec7c52b90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:06.436066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e9480-2cba-45bf-ac7a-103ec7c52b90 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:06.436354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e9480-2cba-45bf-ac7a-103ec7c52b90 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:06.436631 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f0e9480-2cba-45bf-ac7a-103ec7c52b90 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:06.439363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 260/506] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:06.440148 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff1a1-a85f-42ba-8f4c-99d441188c41 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:06.447582 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e9480-2cba-45bf-ac7a-103ec7c52b90 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:06.449601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f0e9480-2cba-45bf-ac7a-103ec7c52b90 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-7f0e9480-2cba-45bf-ac7a-103ec7c52b90 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:06.467151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:06.468066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:06.468897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:06.468897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:06.468897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:06.468897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:06.468897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 247/507] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:06.469187 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e9480-2cba-45bf-ac7a-103ec7c52b90 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:06.528307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:06.543172 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:06.548109 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f76ff1a1-a85f-42ba-8f4c-99d441188c41 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:06.567801 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f0e9480-2cba-45bf-ac7a-103ec7c52b90 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:06.582168 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91225764-7615-44f3-9600-501184c6e588 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:06.582837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91225764-7615-44f3-9600-501184c6e588 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:06.583124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91225764-7615-44f3-9600-501184c6e588 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:06.583402 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91225764-7615-44f3-9600-501184c6e588 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:06.584227 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91225764-7615-44f3-9600-501184c6e588 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:06.584542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91225764-7615-44f3-9600-501184c6e588 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:06.586014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91225764-7615-44f3-9600-501184c6e588 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:06.601612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff866d8f-b7d2-4189-890f-5949d577b3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:06.602264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff866d8f-b7d2-4189-890f-5949d577b3a2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:06.602541 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff866d8f-b7d2-4189-890f-5949d577b3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:06.602816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff866d8f-b7d2-4189-890f-5949d577b3a2 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:06.603622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff866d8f-b7d2-4189-890f-5949d577b3a2 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:06.603924 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff866d8f-b7d2-4189-890f-5949d577b3a2 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:06.605624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff866d8f-b7d2-4189-890f-5949d577b3a2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:06.622042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 261/508] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 26 18:08:06 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:06.622859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91225764-7615-44f3-9600-501184c6e588 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:06.642612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 248/509] 10.222.0.64 () {56 vars in 1137 bytes} [Thu May 26 18:08:06 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:06.643438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff866d8f-b7d2-4189-890f-5949d577b3a2 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:06.721433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91225764-7615-44f3-9600-501184c6e588 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:06.740897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff866d8f-b7d2-4189-890f-5949d577b3a2 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:06.755408 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03cde0-c681-4ca1-a55c-6b212373a112 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:06.756192 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03cde0-c681-4ca1-a55c-6b212373a112 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:06.756473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03cde0-c681-4ca1-a55c-6b212373a112 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:06.756750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b03cde0-c681-4ca1-a55c-6b212373a112 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:06.764407 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:06.769404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03cde0-c681-4ca1-a55c-6b212373a112 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:06.770257 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:06.770867 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b03cde0-c681-4ca1-a55c-6b212373a112 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:06.775550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331588d5-eadc-408d-ba2e-6728077aad78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:06.776336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331588d5-eadc-408d-ba2e-6728077aad78 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:06.776644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331588d5-eadc-408d-ba2e-6728077aad78 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:06.776926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-331588d5-eadc-408d-ba2e-6728077aad78 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:06.783885 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331588d5-eadc-408d-ba2e-6728077aad78 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:06.785349 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-331588d5-eadc-408d-ba2e-6728077aad78 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0b03cde0-c681-4ca1-a55c-6b212373a112 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:06.789155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:06.790067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:06.790887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:06.790887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:06.790887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:06.790887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:06.790887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 262/510] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:06 2022] GET /identity/v3/domains/Default => generated 87 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:06.791149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03cde0-c681-4ca1-a55c-6b212373a112 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-331588d5-eadc-408d-ba2e-6728077aad78 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:06.800189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:06.801057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:06.801917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:06.801917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:06.801917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:06.801917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:06.801917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:06.801917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:06.801917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:06.801917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:06.801917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 18:08:06.801917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:06.801917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 249/511] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:08:06 2022] GET /identity/v3/users/cinder => generated 84 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:06.802461 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331588d5-eadc-408d-ba2e-6728077aad78 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:06.896167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b03cde0-c681-4ca1-a55c-6b212373a112 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:06.898602 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-331588d5-eadc-408d-ba2e-6728077aad78 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:06.930945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e222ad3-7296-4bcf-96bf-c5f00d74baba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:06.931604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e222ad3-7296-4bcf-96bf-c5f00d74baba None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:06.931889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e222ad3-7296-4bcf-96bf-c5f00d74baba None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:06.932172 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e222ad3-7296-4bcf-96bf-c5f00d74baba None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:06.932298 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6a741-f339-4e71-bdde-9d82e0d86fed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:06.932887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e222ad3-7296-4bcf-96bf-c5f00d74baba None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:06.933040 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6a741-f339-4e71-bdde-9d82e0d86fed None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:06.933767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6a741-f339-4e71-bdde-9d82e0d86fed None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:06.933854 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e222ad3-7296-4bcf-96bf-c5f00d74baba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:06.934049 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd6a741-f339-4e71-bdde-9d82e0d86fed None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:06.935317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e222ad3-7296-4bcf-96bf-c5f00d74baba None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:06.946810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 263/512] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:06.947594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e222ad3-7296-4bcf-96bf-c5f00d74baba None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:06.995072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:06.997267 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:07.007008 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6a741-f339-4e71-bdde-9d82e0d86fed None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:07.008464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd6a741-f339-4e71-bdde-9d82e0d86fed None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:07.044886 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e222ad3-7296-4bcf-96bf-c5f00d74baba None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:07.078066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39100d48-61f3-478d-aa8c-b6983b689bc4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:07.078642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39100d48-61f3-478d-aa8c-b6983b689bc4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:07.078930 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39100d48-61f3-478d-aa8c-b6983b689bc4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:07.079210 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39100d48-61f3-478d-aa8c-b6983b689bc4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:07.104367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 250/513] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 302 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:08:07.105892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6a741-f339-4e71-bdde-9d82e0d86fed None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:07.146779 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39100d48-61f3-478d-aa8c-b6983b689bc4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:07.148069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39100d48-61f3-478d-aa8c-b6983b689bc4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:07.197917 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:07.202203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:07.211483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd6a741-f339-4e71-bdde-9d82e0d86fed None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:07.246904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8e4e5-fcc0-4ffb-94df-f2ccea2c7203 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:07.247562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8e4e5-fcc0-4ffb-94df-f2ccea2c7203 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:07.247848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8e4e5-fcc0-4ffb-94df-f2ccea2c7203 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:07.248125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09f8e4e5-fcc0-4ffb-94df-f2ccea2c7203 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:07.248824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 264/514] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:06 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:08:07.248949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8e4e5-fcc0-4ffb-94df-f2ccea2c7203 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:07.249273 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8e4e5-fcc0-4ffb-94df-f2ccea2c7203 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:07.249696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39100d48-61f3-478d-aa8c-b6983b689bc4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:07.250711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09f8e4e5-fcc0-4ffb-94df-f2ccea2c7203 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:07.266663 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 251/515] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:07.266663 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8e4e5-fcc0-4ffb-94df-f2ccea2c7203 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:07.345370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39100d48-61f3-478d-aa8c-b6983b689bc4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:07.363850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09f8e4e5-fcc0-4ffb-94df-f2ccea2c7203 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:07.378266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbde454-a8d9-49f3-b053-df770154b558 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:07.378929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde454-a8d9-49f3-b053-df770154b558 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:07.379211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde454-a8d9-49f3-b053-df770154b558 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:07.379488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acbde454-a8d9-49f3-b053-df770154b558 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:07.380304 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbde454-a8d9-49f3-b053-df770154b558 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:07.380613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbde454-a8d9-49f3-b053-df770154b558 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:07.382059 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acbde454-a8d9-49f3-b053-df770154b558 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:07.396109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdca7b-6d65-4f17-9275-ae8d7ea36fb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:07.396769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdca7b-6d65-4f17-9275-ae8d7ea36fb9 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:07.397085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdca7b-6d65-4f17-9275-ae8d7ea36fb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:07.397365 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ffdca7b-6d65-4f17-9275-ae8d7ea36fb9 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:07.398059 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdca7b-6d65-4f17-9275-ae8d7ea36fb9 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:07.398874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 265/516] 10.222.0.64 () {56 vars in 1137 bytes} [Thu May 26 18:08:07 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:07.399481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ffdca7b-6d65-4f17-9275-ae8d7ea36fb9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:07.399661 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbde454-a8d9-49f3-b053-df770154b558 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:07.411480 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:07.420370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 252/517] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:08:07 2022] POST /identity/v3/users => generated 247 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:07.421210 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdca7b-6d65-4f17-9275-ae8d7ea36fb9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:07.432381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:07.525417 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acbde454-a8d9-49f3-b053-df770154b558 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:07.543883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ffdca7b-6d65-4f17-9275-ae8d7ea36fb9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:07.563195 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681cec5-52fc-4b1e-af70-4cca6f7bbc2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:07.563997 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681cec5-52fc-4b1e-af70-4cca6f7bbc2f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:07.564276 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681cec5-52fc-4b1e-af70-4cca6f7bbc2f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:07.564547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6681cec5-52fc-4b1e-af70-4cca6f7bbc2f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:07.575955 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681cec5-52fc-4b1e-af70-4cca6f7bbc2f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:07.577595 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6681cec5-52fc-4b1e-af70-4cca6f7bbc2f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:07.580331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb11b1-1b3d-4dc8-89e7-48b7077ea36f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:07.581169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb11b1-1b3d-4dc8-89e7-48b7077ea36f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:07.581451 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb11b1-1b3d-4dc8-89e7-48b7077ea36f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:07.581784 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bb11b1-1b3d-4dc8-89e7-48b7077ea36f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:07.593961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb11b1-1b3d-4dc8-89e7-48b7077ea36f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:07.595484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bb11b1-1b3d-4dc8-89e7-48b7077ea36f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6681cec5-52fc-4b1e-af70-4cca6f7bbc2f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:07.596901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:07.597722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:07.598524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:07.598524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:07.598524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:07.598524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:07.598524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 266/518] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:07.603459 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681cec5-52fc-4b1e-af70-4cca6f7bbc2f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-a0bb11b1-1b3d-4dc8-89e7-48b7077ea36f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:07.617710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:07.618555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:07.619363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:07.619363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:07.619363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:07.619363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:07.619363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 253/519] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:07 2022] GET /identity/v3/domains/Default => generated 87 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:07.619619 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb11b1-1b3d-4dc8-89e7-48b7077ea36f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:07.680143 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:07.689238 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:07.727133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6681cec5-52fc-4b1e-af70-4cca6f7bbc2f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:07.734435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bb11b1-1b3d-4dc8-89e7-48b7077ea36f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:07.763050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb9b8c-6953-4f3f-a3f9-ae0f388ab851 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:07.763963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb9b8c-6953-4f3f-a3f9-ae0f388ab851 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:07.764247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb9b8c-6953-4f3f-a3f9-ae0f388ab851 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:07.764633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78fb9b8c-6953-4f3f-a3f9-ae0f388ab851 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:07.769847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81384c-9de1-43a0-aa0b-fa671b9bbec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:07.770488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81384c-9de1-43a0-aa0b-fa671b9bbec6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:07.770769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81384c-9de1-43a0-aa0b-fa671b9bbec6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:07.771042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d81384c-9de1-43a0-aa0b-fa671b9bbec6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:07.772224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb9b8c-6953-4f3f-a3f9-ae0f388ab851 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:07.773822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78fb9b8c-6953-4f3f-a3f9-ae0f388ab851 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-78fb9b8c-6953-4f3f-a3f9-ae0f388ab851 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:07.790010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:07.790923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:07.797173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:07.797173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:07.797173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:07.797173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:07.797173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:07.797173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:07.797173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:07.797173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:07.797173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 18:08:07.797173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:07.797173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 267/520] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:07 2022] GET /identity/v3/users/neutron => generated 85 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:07.797173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb9b8c-6953-4f3f-a3f9-ae0f388ab851 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:07.843644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81384c-9de1-43a0-aa0b-fa671b9bbec6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:07.845248 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d81384c-9de1-43a0-aa0b-fa671b9bbec6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:07.902916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78fb9b8c-6953-4f3f-a3f9-ae0f388ab851 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:07.907687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:07.927144 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:07.943905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf3393-b409-4339-a365-ada5ed3a7673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:07.944568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3393-b409-4339-a365-ada5ed3a7673 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:07.944847 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3393-b409-4339-a365-ada5ed3a7673 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:07.945149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7bf3393-b409-4339-a365-ada5ed3a7673 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:07.945861 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf3393-b409-4339-a365-ada5ed3a7673 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:07.946187 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf3393-b409-4339-a365-ada5ed3a7673 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:07.947534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7bf3393-b409-4339-a365-ada5ed3a7673 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:07.959289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 268/521] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:07.960074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf3393-b409-4339-a365-ada5ed3a7673 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:07.960795 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 254/522] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:08:07.961908 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81384c-9de1-43a0-aa0b-fa671b9bbec6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:08.069040 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7bf3393-b409-4339-a365-ada5ed3a7673 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:08.071918 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d81384c-9de1-43a0-aa0b-fa671b9bbec6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:08.103770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df97ba0-76a9-4a6d-9b74-f441e98cd2fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:08.104436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df97ba0-76a9-4a6d-9b74-f441e98cd2fb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:08.104720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df97ba0-76a9-4a6d-9b74-f441e98cd2fb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:08.105812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df97ba0-76a9-4a6d-9b74-f441e98cd2fb None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:08.106536 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df97ba0-76a9-4a6d-9b74-f441e98cd2fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:08.106846 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df97ba0-76a9-4a6d-9b74-f441e98cd2fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:08.108172 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89c642-ee38-4461-8e15-90fb02970dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:08.108286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df97ba0-76a9-4a6d-9b74-f441e98cd2fb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:08.108840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89c642-ee38-4461-8e15-90fb02970dbd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:08.109160 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89c642-ee38-4461-8e15-90fb02970dbd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:08.109443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc89c642-ee38-4461-8e15-90fb02970dbd None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:08.110274 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89c642-ee38-4461-8e15-90fb02970dbd None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:08.110911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89c642-ee38-4461-8e15-90fb02970dbd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:08.112012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc89c642-ee38-4461-8e15-90fb02970dbd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:08.124708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 269/523] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:08.124708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df97ba0-76a9-4a6d-9b74-f441e98cd2fb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:08.138822 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 255/524] 10.222.0.64 () {56 vars in 1139 bytes} [Thu May 26 18:08:07 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:08.138822 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89c642-ee38-4461-8e15-90fb02970dbd None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:08.158968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:08.171506 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:08.233190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df97ba0-76a9-4a6d-9b74-f441e98cd2fb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:08.248864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc89c642-ee38-4461-8e15-90fb02970dbd None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:08.267923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74a412-d4e8-4611-8d86-b0293d3b515d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:08.268830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74a412-d4e8-4611-8d86-b0293d3b515d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:08.269153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74a412-d4e8-4611-8d86-b0293d3b515d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:08.269433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a74a412-d4e8-4611-8d86-b0293d3b515d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:08.276306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74a412-d4e8-4611-8d86-b0293d3b515d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:08.278515 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a74a412-d4e8-4611-8d86-b0293d3b515d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:08.285789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d8f12-9ec0-4abd-8043-581d98fdd91c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:08.286579 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d8f12-9ec0-4abd-8043-581d98fdd91c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:08.286867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d8f12-9ec0-4abd-8043-581d98fdd91c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:08.287147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a68d8f12-9ec0-4abd-8043-581d98fdd91c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1a74a412-d4e8-4611-8d86-b0293d3b515d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:08.293655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:08.294522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:08.295334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:08.295334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:08.295334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:08.295334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:08.295334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:08.295334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:08.295334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:08.295334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:08.295334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 270/525] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:08.296281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74a412-d4e8-4611-8d86-b0293d3b515d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:08.302944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d8f12-9ec0-4abd-8043-581d98fdd91c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:08.304397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a68d8f12-9ec0-4abd-8043-581d98fdd91c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-a68d8f12-9ec0-4abd-8043-581d98fdd91c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:08.322140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:08.322974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:08.323926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:08.323926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:08.323926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:08.323926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:08.323926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 256/526] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:08.324194 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d8f12-9ec0-4abd-8043-581d98fdd91c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:08.397463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:08.400673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:08.404395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a74a412-d4e8-4611-8d86-b0293d3b515d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:08.430680 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a68d8f12-9ec0-4abd-8043-581d98fdd91c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:08.449612 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e860992-b99d-4e18-9d72-75be012ea1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:08.450413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e860992-b99d-4e18-9d72-75be012ea1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:08.450697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e860992-b99d-4e18-9d72-75be012ea1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:08.450972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e860992-b99d-4e18-9d72-75be012ea1c4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:08.466858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdefe6-5764-41d0-ad70-b2b41d000621 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:08.467499 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdefe6-5764-41d0-ad70-b2b41d000621 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:08.467787 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdefe6-5764-41d0-ad70-b2b41d000621 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:08.468067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fdefe6-5764-41d0-ad70-b2b41d000621 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:08.468537 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e860992-b99d-4e18-9d72-75be012ea1c4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:08.470021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e860992-b99d-4e18-9d72-75be012ea1c4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5e860992-b99d-4e18-9d72-75be012ea1c4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:08.484692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:08.485567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:08.486387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:08.486387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:08.486387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:08.486387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:08.486387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:08.486387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:08.486387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:08.486387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:08.486387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 271/527] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:08.487310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e860992-b99d-4e18-9d72-75be012ea1c4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:08.546645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdefe6-5764-41d0-ad70-b2b41d000621 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:08.548155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fdefe6-5764-41d0-ad70-b2b41d000621 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:08.589376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e860992-b99d-4e18-9d72-75be012ea1c4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:08.621049 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:08.625431 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7c5b3-c4f5-4f52-9744-f235da9e8573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:08.626099 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7c5b3-c4f5-4f52-9744-f235da9e8573 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:08.626387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7c5b3-c4f5-4f52-9744-f235da9e8573 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:08.626668 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7c5b3-c4f5-4f52-9744-f235da9e8573 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:08.627461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7c5b3-c4f5-4f52-9744-f235da9e8573 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:08.628199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7c5b3-c4f5-4f52-9744-f235da9e8573 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:08.629697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7c5b3-c4f5-4f52-9744-f235da9e8573 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:08.649456 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 272/528] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:08.653901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7c5b3-c4f5-4f52-9744-f235da9e8573 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:08.659140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 257/529] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:08 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 331 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:08:08.659140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdefe6-5764-41d0-ad70-b2b41d000621 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:08.682236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:08.762677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fdefe6-5764-41d0-ad70-b2b41d000621 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:08.763849 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7c5b3-c4f5-4f52-9744-f235da9e8573 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:08.796785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b30b9b-9e2b-435d-9d43-adf759ca613d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:08.797319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3c026-b819-44ec-966b-f694e56c0b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:08.797549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b30b9b-9e2b-435d-9d43-adf759ca613d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:08.797770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b30b9b-9e2b-435d-9d43-adf759ca613d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:08.797924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3c026-b819-44ec-966b-f694e56c0b39 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:08.798032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48b30b9b-9e2b-435d-9d43-adf759ca613d None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:08.798199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3c026-b819-44ec-966b-f694e56c0b39 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:08.798454 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5f3c026-b819-44ec-966b-f694e56c0b39 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:08.798801 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b30b9b-9e2b-435d-9d43-adf759ca613d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:08.799114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b30b9b-9e2b-435d-9d43-adf759ca613d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:08.799213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3c026-b819-44ec-966b-f694e56c0b39 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:08.799463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3c026-b819-44ec-966b-f694e56c0b39 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:08.800569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48b30b9b-9e2b-435d-9d43-adf759ca613d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:08.800827 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5f3c026-b819-44ec-966b-f694e56c0b39 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:08.817463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 273/530] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:08.817463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3c026-b819-44ec-966b-f694e56c0b39 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:08.821376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 258/531] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:08 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:08.822184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b30b9b-9e2b-435d-9d43-adf759ca613d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:08.852177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:08.903493 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:08.922962 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5f3c026-b819-44ec-966b-f694e56c0b39 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:08.931906 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48b30b9b-9e2b-435d-9d43-adf759ca613d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:08.959374 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af779c36-c81f-47ad-b93c-00e666c9b97d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:08.959954 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af779c36-c81f-47ad-b93c-00e666c9b97d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:08.960238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af779c36-c81f-47ad-b93c-00e666c9b97d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:08.960522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af779c36-c81f-47ad-b93c-00e666c9b97d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:08.961360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af779c36-c81f-47ad-b93c-00e666c9b97d None admin] RBAC: Adding query filter params (role.id=ec1445be03c942a98070dd9213fd0705, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=97f259ac2eb4425f8b4dcffeccdcd439) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:08.961667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af779c36-c81f-47ad-b93c-00e666c9b97d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:08.963192 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af779c36-c81f-47ad-b93c-00e666c9b97d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:08.968665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 274/532] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:08 2022] GET /identity/v3/role_assignments?user.id=97f259ac2eb4425f8b4dcffeccdcd439&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=ec1445be03c942a98070dd9213fd0705 => generated 259 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:08.969032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243db240-b61e-44c0-a110-f40ab9f2b141 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:08.969469 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af779c36-c81f-47ad-b93c-00e666c9b97d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:08.970190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db240-b61e-44c0-a110-f40ab9f2b141 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:08.970476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db240-b61e-44c0-a110-f40ab9f2b141 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:08.970750 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243db240-b61e-44c0-a110-f40ab9f2b141 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:08.989957 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243db240-b61e-44c0-a110-f40ab9f2b141 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:08.991787 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-243db240-b61e-44c0-a110-f40ab9f2b141 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-243db240-b61e-44c0-a110-f40ab9f2b141 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:09.016841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:09.017958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:09.023534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:09.023534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:09.023534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:09.023534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:09.023534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 259/533] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:09.023534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243db240-b61e-44c0-a110-f40ab9f2b141 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:09.107627 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af779c36-c81f-47ad-b93c-00e666c9b97d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:09.148448 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:09.156606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e4cfa-f77b-49f1-b20e-b1b65092627b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:09.157770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4cfa-f77b-49f1-b20e-b1b65092627b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:09.158200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4cfa-f77b-49f1-b20e-b1b65092627b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:09.158618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255e4cfa-f77b-49f1-b20e-b1b65092627b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:09.163538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243db240-b61e-44c0-a110-f40ab9f2b141 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:09.168292 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e4cfa-f77b-49f1-b20e-b1b65092627b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:09.169817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255e4cfa-f77b-49f1-b20e-b1b65092627b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-255e4cfa-f77b-49f1-b20e-b1b65092627b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:09.187432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:09.188483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:09.189460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:09.189460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:09.189460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:09.189460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:09.189460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:09.189460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:09.189460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:09.189460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:09.189460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 275/534] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:08 2022] GET /identity/v3/projects/service => generated 88 bytes in 219 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:09.195315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e4cfa-f77b-49f1-b20e-b1b65092627b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:09.195315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:09.212737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b914bbe-9fb4-4514-8f26-23ab28c889ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:09.213839 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b914bbe-9fb4-4514-8f26-23ab28c889ff None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:09.214229 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b914bbe-9fb4-4514-8f26-23ab28c889ff None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:09.214656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b914bbe-9fb4-4514-8f26-23ab28c889ff None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:09.215598 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b914bbe-9fb4-4514-8f26-23ab28c889ff None admin] RBAC: Adding query filter params (role.id=ec1445be03c942a98070dd9213fd0705, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=a2fbb5beba8a45a5b0a9b0beba0e0d63) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:09.216547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b914bbe-9fb4-4514-8f26-23ab28c889ff None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:09.218535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b914bbe-9fb4-4514-8f26-23ab28c889ff None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:09.226616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 260/535] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:09 2022] GET /identity/v3/role_assignments?user.id=a2fbb5beba8a45a5b0a9b0beba0e0d63&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=ec1445be03c942a98070dd9213fd0705 => generated 259 bytes in 207 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:09.228208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b914bbe-9fb4-4514-8f26-23ab28c889ff None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:09.349318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255e4cfa-f77b-49f1-b20e-b1b65092627b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:09.390915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b02a67-eec4-4bc3-9a13-fa8d27a748ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:09.391695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b02a67-eec4-4bc3-9a13-fa8d27a748ae None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:09.392056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b02a67-eec4-4bc3-9a13-fa8d27a748ae None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:09.392441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16b02a67-eec4-4bc3-9a13-fa8d27a748ae None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:09.393822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b02a67-eec4-4bc3-9a13-fa8d27a748ae None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:09.394255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b02a67-eec4-4bc3-9a13-fa8d27a748ae None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:09.395929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16b02a67-eec4-4bc3-9a13-fa8d27a748ae None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:09.409636 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 276/536] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:09.415185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b02a67-eec4-4bc3-9a13-fa8d27a748ae None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:09.506062 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:09.519449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b914bbe-9fb4-4514-8f26-23ab28c889ff None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:09.551342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16b02a67-eec4-4bc3-9a13-fa8d27a748ae None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:09.558836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be0c2b-4b93-47b9-aaa0-ba003aa36d6b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:09.559508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be0c2b-4b93-47b9-aaa0-ba003aa36d6b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:09.559795 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be0c2b-4b93-47b9-aaa0-ba003aa36d6b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:09.560076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8be0c2b-4b93-47b9-aaa0-ba003aa36d6b None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:09.560869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be0c2b-4b93-47b9-aaa0-ba003aa36d6b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:09.561229 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be0c2b-4b93-47b9-aaa0-ba003aa36d6b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:09.562687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8be0c2b-4b93-47b9-aaa0-ba003aa36d6b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:09.576546 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 261/537] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:09.582836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be0c2b-4b93-47b9-aaa0-ba003aa36d6b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:09.593245 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aa93b28-8119-4567-99ab-023cdce073df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:09.598568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa93b28-8119-4567-99ab-023cdce073df None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:09.599072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa93b28-8119-4567-99ab-023cdce073df None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:09.599566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aa93b28-8119-4567-99ab-023cdce073df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:09.600867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:09.614647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa93b28-8119-4567-99ab-023cdce073df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:09.616615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7aa93b28-8119-4567-99ab-023cdce073df None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7aa93b28-8119-4567-99ab-023cdce073df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:09.646430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:09.647334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:09.648139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:09.648139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:09.648139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:09.648139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:09.648139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:09.648139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:09.648139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:09.648139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:09.654859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 277/538] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:09.660996 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ef975-d12d-4714-9b1c-a1917dce7006 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:09.661331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ef975-d12d-4714-9b1c-a1917dce7006 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:09.663843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d1ef975-d12d-4714-9b1c-a1917dce7006 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:09.663843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 278/539] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:08:09.663843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ef975-d12d-4714-9b1c-a1917dce7006 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:09.751962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8be0c2b-4b93-47b9-aaa0-ba003aa36d6b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:09.777535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d1ef975-d12d-4714-9b1c-a1917dce7006 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:09.799081 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28110a41-8bc2-4650-a6ec-1a3c6ded9859 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:09.800257 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28110a41-8bc2-4650-a6ec-1a3c6ded9859 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:09.800547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28110a41-8bc2-4650-a6ec-1a3c6ded9859 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:09.800830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28110a41-8bc2-4650-a6ec-1a3c6ded9859 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:09.801970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28110a41-8bc2-4650-a6ec-1a3c6ded9859 None admin] RBAC: Adding query filter params (role.id=ec1445be03c942a98070dd9213fd0705, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=0c09ffb276b84b2aa8735d6907a0de73) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:09.802522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28110a41-8bc2-4650-a6ec-1a3c6ded9859 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:09.803695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:09.805474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28110a41-8bc2-4650-a6ec-1a3c6ded9859 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:09.821018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 262/540] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:09 2022] GET /identity/v3/role_assignments?user.id=0c09ffb276b84b2aa8735d6907a0de73&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=ec1445be03c942a98070dd9213fd0705 => generated 259 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:09.821018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daae53c-2aee-4f47-9fe5-9b25a9bf4ba7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:09.821018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daae53c-2aee-4f47-9fe5-9b25a9bf4ba7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:09.821018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5daae53c-2aee-4f47-9fe5-9b25a9bf4ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:09.825771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa188be-d4a1-4f14-bc16-c6626d69bef5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:09.826454 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa188be-d4a1-4f14-bc16-c6626d69bef5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:09.826740 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa188be-d4a1-4f14-bc16-c6626d69bef5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:09.827022 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afa188be-d4a1-4f14-bc16-c6626d69bef5 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:09.827890 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa188be-d4a1-4f14-bc16-c6626d69bef5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:09.828207 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa188be-d4a1-4f14-bc16-c6626d69bef5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:09.830907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afa188be-d4a1-4f14-bc16-c6626d69bef5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:09.854561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5daae53c-2aee-4f47-9fe5-9b25a9bf4ba7 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:09.856724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5daae53c-2aee-4f47-9fe5-9b25a9bf4ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:09.856971 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 279/541] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:09.866346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa188be-d4a1-4f14-bc16-c6626d69bef5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:09.992226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afa188be-d4a1-4f14-bc16-c6626d69bef5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:10.034734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c113cd-4b27-4e12-87bb-8091dd5f22b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:10.035940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c113cd-4b27-4e12-87bb-8091dd5f22b3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:10.036423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c113cd-4b27-4e12-87bb-8091dd5f22b3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:10.037044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c113cd-4b27-4e12-87bb-8091dd5f22b3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:10.038506 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c113cd-4b27-4e12-87bb-8091dd5f22b3 None admin] RBAC: Adding query filter params (role.id=ec1445be03c942a98070dd9213fd0705, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=1b725c28490f4f90b5eec565cd0fb603) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:10.039103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c113cd-4b27-4e12-87bb-8091dd5f22b3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:10.040827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:10.041075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c113cd-4b27-4e12-87bb-8091dd5f22b3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:10.048180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 280/542] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:09 2022] GET /identity/v3/role_assignments?user.id=1b725c28490f4f90b5eec565cd0fb603&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=ec1445be03c942a98070dd9213fd0705 => generated 259 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:10.054481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 263/543] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:09 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 238 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:10.078858 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c113cd-4b27-4e12-87bb-8091dd5f22b3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:10.133456 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:10.190125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c113cd-4b27-4e12-87bb-8091dd5f22b3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:10.227762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201dec-316c-4efd-b620-7cf74a16cc0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:10.228572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201dec-316c-4efd-b620-7cf74a16cc0b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:10.228855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201dec-316c-4efd-b620-7cf74a16cc0b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:10.229156 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23201dec-316c-4efd-b620-7cf74a16cc0b None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:10.240591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23201dec-316c-4efd-b620-7cf74a16cc0b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-23201dec-316c-4efd-b620-7cf74a16cc0b None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:10.249035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:10.249903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:10.250670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:10.250670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:10.250670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:10.250670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:10.250670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:10.250670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:10.250670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:10.250670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:10.250670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:10.250670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:10.250670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:10.250670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:10.255088 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 281/544] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:10.256537 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daae53c-2aee-4f47-9fe5-9b25a9bf4ba7 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:10.372077 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5daae53c-2aee-4f47-9fe5-9b25a9bf4ba7 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:10.407168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26296fb5-0246-4afe-a6db-1c4c60dec755 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:10.407847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26296fb5-0246-4afe-a6db-1c4c60dec755 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:10.408128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26296fb5-0246-4afe-a6db-1c4c60dec755 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:10.408402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26296fb5-0246-4afe-a6db-1c4c60dec755 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:10.409175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26296fb5-0246-4afe-a6db-1c4c60dec755 None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:10.409484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26296fb5-0246-4afe-a6db-1c4c60dec755 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:10.410866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26296fb5-0246-4afe-a6db-1c4c60dec755 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:10.423801 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 264/545] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:10.425148 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201dec-316c-4efd-b620-7cf74a16cc0b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:10.584608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23201dec-316c-4efd-b620-7cf74a16cc0b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:10.595074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:10.622575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c783640-3525-4a86-995d-cfea8125b2d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:10.623336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c783640-3525-4a86-995d-cfea8125b2d2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:10.623664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c783640-3525-4a86-995d-cfea8125b2d2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:10.623946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c783640-3525-4a86-995d-cfea8125b2d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:10.635324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c783640-3525-4a86-995d-cfea8125b2d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:10.637341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c783640-3525-4a86-995d-cfea8125b2d2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7c783640-3525-4a86-995d-cfea8125b2d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:10.655663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:10.656526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:10.657370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:10.657370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:10.657370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:10.657370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:10.657370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 282/546] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:10.662530 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26296fb5-0246-4afe-a6db-1c4c60dec755 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:10.735815 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:10.776020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26296fb5-0246-4afe-a6db-1c4c60dec755 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:10.810578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b443c29-c6c2-49c5-97db-d89cd1c927fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:10.812108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b443c29-c6c2-49c5-97db-d89cd1c927fb None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:10.812587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b443c29-c6c2-49c5-97db-d89cd1c927fb None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:10.813081 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b443c29-c6c2-49c5-97db-d89cd1c927fb None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:10.814001 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b443c29-c6c2-49c5-97db-d89cd1c927fb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:10.814497 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b443c29-c6c2-49c5-97db-d89cd1c927fb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:10.816060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b443c29-c6c2-49c5-97db-d89cd1c927fb None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:10.829450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 265/547] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:10.837034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c783640-3525-4a86-995d-cfea8125b2d2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:10.968845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c783640-3525-4a86-995d-cfea8125b2d2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:11.004816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0f1c6-303d-4460-8d59-5171f91cf228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:11.005912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0f1c6-303d-4460-8d59-5171f91cf228 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:11.006341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0f1c6-303d-4460-8d59-5171f91cf228 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:11.006756 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c0f1c6-303d-4460-8d59-5171f91cf228 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:11.016433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0f1c6-303d-4460-8d59-5171f91cf228 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:11.018117 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c0f1c6-303d-4460-8d59-5171f91cf228 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d4c0f1c6-303d-4460-8d59-5171f91cf228 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:11.033154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:11.034261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:11.035892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:11.035892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:11.035892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:11.035892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:11.035892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:11.035892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:11.035892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:11.035892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:11.035892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 18:08:11.035892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:11.038374 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 283/548] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:08:10 2022] GET /identity/v3/users/swift => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:11.045101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b443c29-c6c2-49c5-97db-d89cd1c927fb None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:11.233069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b443c29-c6c2-49c5-97db-d89cd1c927fb None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:11.263064 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:11.287050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86f3d52-df91-4cbd-aa09-4d3f44398222 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:11.287737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3d52-df91-4cbd-aa09-4d3f44398222 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:11.288023 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3d52-df91-4cbd-aa09-4d3f44398222 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:11.288302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86f3d52-df91-4cbd-aa09-4d3f44398222 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:11.289174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f3d52-df91-4cbd-aa09-4d3f44398222 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:11.289489 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f3d52-df91-4cbd-aa09-4d3f44398222 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:11.290941 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86f3d52-df91-4cbd-aa09-4d3f44398222 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:11.316536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 266/549] 10.222.0.64 () {56 vars in 1135 bytes} [Thu May 26 18:08:11 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:11.321691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0f1c6-303d-4460-8d59-5171f91cf228 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:11.377572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:11.478538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c0f1c6-303d-4460-8d59-5171f91cf228 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:11.527145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446f439-dc6c-4c2c-a5bb-c7b51bb33488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:11.527734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446f439-dc6c-4c2c-a5bb-c7b51bb33488 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:11.528019 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446f439-dc6c-4c2c-a5bb-c7b51bb33488 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:11.528294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2446f439-dc6c-4c2c-a5bb-c7b51bb33488 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:11.620603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446f439-dc6c-4c2c-a5bb-c7b51bb33488 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:11.622650 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2446f439-dc6c-4c2c-a5bb-c7b51bb33488 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:11.655891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:11.761462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8274a5-3b5c-428c-a922-38fda791d583 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:11.761788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8274a5-3b5c-428c-a922-38fda791d583 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:11.762031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d8274a5-3b5c-428c-a922-38fda791d583 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:11.763461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 284/550] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 442 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:08:11.763674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 267/551] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:11.768891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446f439-dc6c-4c2c-a5bb-c7b51bb33488 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:11.773143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17895553-3ed4-4369-9fec-da3019be4c10 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:11.773434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17895553-3ed4-4369-9fec-da3019be4c10 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:11.773720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17895553-3ed4-4369-9fec-da3019be4c10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:11.818056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-17895553-3ed4-4369-9fec-da3019be4c10 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:11.819190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-17895553-3ed4-4369-9fec-da3019be4c10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:11.891450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2446f439-dc6c-4c2c-a5bb-c7b51bb33488 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:11.911998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:11.929334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ef2f5-8f65-4333-8ebe-fea5aa59441a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:11.930372 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ef2f5-8f65-4333-8ebe-fea5aa59441a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:11.930802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ef2f5-8f65-4333-8ebe-fea5aa59441a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:11.931487 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ef2f5-8f65-4333-8ebe-fea5aa59441a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:11.933054 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 268/552] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:08:11.934818 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f627ac-2e0b-4acf-a2f6-61f7c6f7cab4 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:11.935238 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f627ac-2e0b-4acf-a2f6-61f7c6f7cab4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:11.935529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08f627ac-2e0b-4acf-a2f6-61f7c6f7cab4 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:11.937396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 269/553] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:11 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:11.946788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb87f3-f9dd-4041-808f-4da0246526d1 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:11.949175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb87f3-f9dd-4041-808f-4da0246526d1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:11.949563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ef2f5-8f65-4333-8ebe-fea5aa59441a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:11.949995 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2deb87f3-f9dd-4041-808f-4da0246526d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:11.951606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ef2f5-8f65-4333-8ebe-fea5aa59441a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:11.972847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2deb87f3-f9dd-4041-808f-4da0246526d1 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:11.974106 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2deb87f3-f9dd-4041-808f-4da0246526d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-434ef2f5-8f65-4333-8ebe-fea5aa59441a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:11.975860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:11.976973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:11.978069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:11.978069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:11.978069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:11.978069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:11.979904 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 285/554] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:11.981745 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ef2f5-8f65-4333-8ebe-fea5aa59441a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.077439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 270/555] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:12.078258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb87f3-f9dd-4041-808f-4da0246526d1 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.092951 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ef2f5-8f65-4333-8ebe-fea5aa59441a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.132419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20a1d6-9abe-4dec-9109-69e7af35a84e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.133622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20a1d6-9abe-4dec-9109-69e7af35a84e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.134116 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20a1d6-9abe-4dec-9109-69e7af35a84e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.134594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af20a1d6-9abe-4dec-9109-69e7af35a84e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.143035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:12.149344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af20a1d6-9abe-4dec-9109-69e7af35a84e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-af20a1d6-9abe-4dec-9109-69e7af35a84e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:12.155806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:12.156761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:12.157589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:12.157589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:12.157589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:12.157589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:12.157589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:12.157589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:12.157589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:12.157589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:12.157589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:12.157589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:12.157589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:12.157589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:12.160269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 286/556] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:11 2022] GET /identity/v3/roles/service => generated 85 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:12.161350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20a1d6-9abe-4dec-9109-69e7af35a84e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.193737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:12.213254 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2deb87f3-f9dd-4041-808f-4da0246526d1 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.252139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f225a-8a99-403b-bfbd-1bad98aee190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.252810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f225a-8a99-403b-bfbd-1bad98aee190 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.253417 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f225a-8a99-403b-bfbd-1bad98aee190 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.253811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af8f225a-8a99-403b-bfbd-1bad98aee190 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.254601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f225a-8a99-403b-bfbd-1bad98aee190 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:12.255246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f225a-8a99-403b-bfbd-1bad98aee190 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.256727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af8f225a-8a99-403b-bfbd-1bad98aee190 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.271199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af20a1d6-9abe-4dec-9109-69e7af35a84e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.273368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 271/557] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:12.275172 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f225a-8a99-403b-bfbd-1bad98aee190 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.312316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bfe7a-ffb2-4da9-9802-03221d5b6c85 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.313532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfe7a-ffb2-4da9-9802-03221d5b6c85 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.314050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfe7a-ffb2-4da9-9802-03221d5b6c85 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.314532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e3bfe7a-ffb2-4da9-9802-03221d5b6c85 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.326080 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e3bfe7a-ffb2-4da9-9802-03221d5b6c85 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3e3bfe7a-ffb2-4da9-9802-03221d5b6c85 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:12.334290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:12.335700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:12.336510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:12.336510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:12.336510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:12.336510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:12.336510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:12.336510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:12.336510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:12.336510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:12.336510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:12.336510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:12.336510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:12.336510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:12.339218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 287/558] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:12 2022] GET /identity/v3/roles/service => generated 85 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:12.340775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bfe7a-ffb2-4da9-9802-03221d5b6c85 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.393500 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af8f225a-8a99-403b-bfbd-1bad98aee190 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.397334 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:12.431314 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d6d22-8005-457a-8db4-6b94e901e21b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.431976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d6d22-8005-457a-8db4-6b94e901e21b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.432269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d6d22-8005-457a-8db4-6b94e901e21b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.432553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba6d6d22-8005-457a-8db4-6b94e901e21b None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.433684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d6d22-8005-457a-8db4-6b94e901e21b None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:12.433820 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d6d22-8005-457a-8db4-6b94e901e21b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.435315 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba6d6d22-8005-457a-8db4-6b94e901e21b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.437755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:12.446617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e3bfe7a-ffb2-4da9-9802-03221d5b6c85 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.450445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 272/559] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:12.451543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d6d22-8005-457a-8db4-6b94e901e21b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.484046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3b606-079e-43ac-b77c-cf6c81e5a72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.485225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3b606-079e-43ac-b77c-cf6c81e5a72b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.485720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3b606-079e-43ac-b77c-cf6c81e5a72b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.486204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c3b606-079e-43ac-b77c-cf6c81e5a72b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.493375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3b606-079e-43ac-b77c-cf6c81e5a72b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.495109 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c3b606-079e-43ac-b77c-cf6c81e5a72b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f0c3b606-079e-43ac-b77c-cf6c81e5a72b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:12.510637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:12.512184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:12.513068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:12.513068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:12.513068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:12.513068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:12.513068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:12.513068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:12.513068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:12.513068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:12.519993 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 288/560] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:12.521270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3b606-079e-43ac-b77c-cf6c81e5a72b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.569222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba6d6d22-8005-457a-8db4-6b94e901e21b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.606958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53651c-bf4d-4515-9dcf-7eba11e4eb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.607551 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53651c-bf4d-4515-9dcf-7eba11e4eb01 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.607840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53651c-bf4d-4515-9dcf-7eba11e4eb01 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.608121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da53651c-bf4d-4515-9dcf-7eba11e4eb01 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.609001 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53651c-bf4d-4515-9dcf-7eba11e4eb01 None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:12.609323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53651c-bf4d-4515-9dcf-7eba11e4eb01 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.610799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da53651c-bf4d-4515-9dcf-7eba11e4eb01 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.624871 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 273/561] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:12 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:12.625953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53651c-bf4d-4515-9dcf-7eba11e4eb01 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.633841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c3b606-079e-43ac-b77c-cf6c81e5a72b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.657351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:12.669552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e656d-4635-479b-b578-c8295368c368 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.670645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e656d-4635-479b-b578-c8295368c368 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.671137 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e656d-4635-479b-b578-c8295368c368 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.671617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc5e656d-4635-479b-b578-c8295368c368 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.684098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e656d-4635-479b-b578-c8295368c368 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.686817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc5e656d-4635-479b-b578-c8295368c368 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-bc5e656d-4635-479b-b578-c8295368c368 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:12.706772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:12.707744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:12.708604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:12.708604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:12.708604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:12.708604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:12.710931 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 289/562] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:12.711940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e656d-4635-479b-b578-c8295368c368 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.716424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:12.741373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da53651c-bf4d-4515-9dcf-7eba11e4eb01 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.775141 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f12264-e319-492a-8ebe-3d0633b9d843 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.775797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f12264-e319-492a-8ebe-3d0633b9d843 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.776083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f12264-e319-492a-8ebe-3d0633b9d843 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.776371 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f12264-e319-492a-8ebe-3d0633b9d843 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.777206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f12264-e319-492a-8ebe-3d0633b9d843 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:12.777519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f12264-e319-492a-8ebe-3d0633b9d843 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.778942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f12264-e319-492a-8ebe-3d0633b9d843 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.790615 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 274/563] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:12.791400 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f12264-e319-492a-8ebe-3d0633b9d843 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.816299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc5e656d-4635-479b-b578-c8295368c368 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.849500 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61816a4d-b738-40c6-b0fd-402fcdd2faab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.850370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816a4d-b738-40c6-b0fd-402fcdd2faab None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.850571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816a4d-b738-40c6-b0fd-402fcdd2faab None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.850874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61816a4d-b738-40c6-b0fd-402fcdd2faab None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.861658 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61816a4d-b738-40c6-b0fd-402fcdd2faab None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.863035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61816a4d-b738-40c6-b0fd-402fcdd2faab None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.873261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-61816a4d-b738-40c6-b0fd-402fcdd2faab None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:12.880129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:12.881114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:12.881992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:12.881992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:12.881992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:12.881992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:12.881992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 290/564] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:12.882700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3ff4-6b57-4fec-b5d3-b2058aa2110c None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.882953 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3ff4-6b57-4fec-b5d3-b2058aa2110c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.883233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-181c3ff4-6b57-4fec-b5d3-b2058aa2110c None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.884482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 291/565] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:12.885659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c670b8-6574-4d8d-8119-6d50eaddb3da None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.885934 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c670b8-6574-4d8d-8119-6d50eaddb3da None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.886212 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c670b8-6574-4d8d-8119-6d50eaddb3da None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.892308 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 292/566] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:12 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:12.893090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c670b8-6574-4d8d-8119-6d50eaddb3da None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.894804 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f12264-e319-492a-8ebe-3d0633b9d843 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:12.930257 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc2db1-c2b4-4682-8240-4c397e2adb05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:12.930915 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc2db1-c2b4-4682-8240-4c397e2adb05 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:12.931198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc2db1-c2b4-4682-8240-4c397e2adb05 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:12.931475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26cc2db1-c2b4-4682-8240-4c397e2adb05 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:12.932187 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc2db1-c2b4-4682-8240-4c397e2adb05 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:12.932493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc2db1-c2b4-4682-8240-4c397e2adb05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:12.934489 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26cc2db1-c2b4-4682-8240-4c397e2adb05 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:12.945636 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 275/567] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:12.946605 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc2db1-c2b4-4682-8240-4c397e2adb05 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:12.954021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:13.003504 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c670b8-6574-4d8d-8119-6d50eaddb3da None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.037478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d7b9f10-68bc-4f4a-9b01-55a3357df3db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.038128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b9f10-68bc-4f4a-9b01-55a3357df3db None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.038417 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b9f10-68bc-4f4a-9b01-55a3357df3db None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.038698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d7b9f10-68bc-4f4a-9b01-55a3357df3db None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.039519 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b9f10-68bc-4f4a-9b01-55a3357df3db None admin] RBAC: Adding query filter params (role.id=ec1445be03c942a98070dd9213fd0705, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=9cb21a6eef0e418182b2dd755096ca77) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:13.039836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b9f10-68bc-4f4a-9b01-55a3357df3db None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.041317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d7b9f10-68bc-4f4a-9b01-55a3357df3db None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.043459 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26cc2db1-c2b4-4682-8240-4c397e2adb05 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.046684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 293/568] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:12 2022] GET /identity/v3/role_assignments?user.id=9cb21a6eef0e418182b2dd755096ca77&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=ec1445be03c942a98070dd9213fd0705 => generated 259 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:13.047835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5077577-582b-4cfe-ae5b-22730dfd4624 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.048127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5077577-582b-4cfe-ae5b-22730dfd4624 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.048403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5077577-582b-4cfe-ae5b-22730dfd4624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.066863 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c5077577-582b-4cfe-ae5b-22730dfd4624 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:13.068100 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c5077577-582b-4cfe-ae5b-22730dfd4624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:13.091951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bfc75af-dd0d-4c40-849b-cedbc692c284 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.093462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc75af-dd0d-4c40-849b-cedbc692c284 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.093754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc75af-dd0d-4c40-849b-cedbc692c284 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.094037 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bfc75af-dd0d-4c40-849b-cedbc692c284 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.094777 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc75af-dd0d-4c40-849b-cedbc692c284 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:13.095089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc75af-dd0d-4c40-849b-cedbc692c284 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.096491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bfc75af-dd0d-4c40-849b-cedbc692c284 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.115505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 276/569] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:13.116857 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e2973-7129-4043-85a5-2a313b054239 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.117178 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e2973-7129-4043-85a5-2a313b054239 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.117459 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9e2973-7129-4043-85a5-2a313b054239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.124467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:13.136073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-cc9e2973-7129-4043-85a5-2a313b054239 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:13.138025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cc9e2973-7129-4043-85a5-2a313b054239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:13.155102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 294/570] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:13.155927 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5077577-582b-4cfe-ae5b-22730dfd4624 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.212793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:13.237428 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 277/571] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:13.245011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e2973-7129-4043-85a5-2a313b054239 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.273713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5077577-582b-4cfe-ae5b-22730dfd4624 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.309242 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026ad83-b0ae-4e93-a87b-e33be9ab00e3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.310037 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026ad83-b0ae-4e93-a87b-e33be9ab00e3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.310323 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026ad83-b0ae-4e93-a87b-e33be9ab00e3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.310602 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f026ad83-b0ae-4e93-a87b-e33be9ab00e3 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.317764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026ad83-b0ae-4e93-a87b-e33be9ab00e3 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.319204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f026ad83-b0ae-4e93-a87b-e33be9ab00e3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f026ad83-b0ae-4e93-a87b-e33be9ab00e3 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:13.335819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:13.336802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:13.338306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:13.338306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:13.338306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:13.338306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:13.338306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:13.338306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:13.338306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:13.338306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:13.338306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 18:08:13.338306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:13.339221 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 295/572] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/users/glance => generated 84 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:13.340563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026ad83-b0ae-4e93-a87b-e33be9ab00e3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.351009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9e2973-7129-4043-85a5-2a313b054239 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.386797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e6937-9575-4354-8490-bef35df4f523 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.387589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e6937-9575-4354-8490-bef35df4f523 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.387872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e6937-9575-4354-8490-bef35df4f523 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.388191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b50e6937-9575-4354-8490-bef35df4f523 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.390193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:13.396121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e6937-9575-4354-8490-bef35df4f523 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.398038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b50e6937-9575-4354-8490-bef35df4f523 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-b50e6937-9575-4354-8490-bef35df4f523 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:13.413072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:13.414239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:13.415241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:13.415241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:13.415241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:13.415241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:13.415241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:13.415241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:13.415241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:13.415241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:13.415241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 18:08:13.415241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:13.415241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 278/573] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:13.415241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e6937-9575-4354-8490-bef35df4f523 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.456232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f026ad83-b0ae-4e93-a87b-e33be9ab00e3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.467996 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:13.495137 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1dfcac-812a-4a89-b2a2-751810ceb038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.495969 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dfcac-812a-4a89-b2a2-751810ceb038 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.496254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dfcac-812a-4a89-b2a2-751810ceb038 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.496531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf1dfcac-812a-4a89-b2a2-751810ceb038 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.506992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf1dfcac-812a-4a89-b2a2-751810ceb038 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-cf1dfcac-812a-4a89-b2a2-751810ceb038 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:13.515026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:13.515948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:13.516764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:13.516764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:13.516764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:13.516764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:13.516764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:13.516764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:13.516764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:13.516764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:13.516764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:13.516764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:13.516764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:13.516764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:13.516764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 296/574] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:13.518048 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1dfcac-812a-4a89-b2a2-751810ceb038 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.531346 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b50e6937-9575-4354-8490-bef35df4f523 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.568237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54681d-8f1a-45eb-860f-5a5155d0dfbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.569055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54681d-8f1a-45eb-860f-5a5155d0dfbe None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.569360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54681d-8f1a-45eb-860f-5a5155d0dfbe None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.569619 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e54681d-8f1a-45eb-860f-5a5155d0dfbe None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.580027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e54681d-8f1a-45eb-860f-5a5155d0dfbe None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5e54681d-8f1a-45eb-860f-5a5155d0dfbe None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:13.587755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:13.588675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:13.590056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:13.590056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:13.590056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:13.590056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:13.590056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:13.590056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:13.590056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:13.590056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:13.590056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:13.590056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:13.590056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:13.590056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:13.590056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 279/575] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:13.590755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54681d-8f1a-45eb-860f-5a5155d0dfbe None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.635132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf1dfcac-812a-4a89-b2a2-751810ceb038 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.649433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:13.675034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b000d-2c6f-4fae-a390-eb0b4e0206df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.676081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b000d-2c6f-4fae-a390-eb0b4e0206df None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.676545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b000d-2c6f-4fae-a390-eb0b4e0206df None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.677113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d33b000d-2c6f-4fae-a390-eb0b4e0206df None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.678130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b000d-2c6f-4fae-a390-eb0b4e0206df None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:13.678623 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b000d-2c6f-4fae-a390-eb0b4e0206df None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.680486 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d33b000d-2c6f-4fae-a390-eb0b4e0206df None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.694724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e54681d-8f1a-45eb-860f-5a5155d0dfbe None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.700403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 297/576] 10.222.0.64 () {56 vars in 1137 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:13.701442 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b000d-2c6f-4fae-a390-eb0b4e0206df None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.733781 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c424f-4926-4cb2-a998-8dce2bdc4f51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.734756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c424f-4926-4cb2-a998-8dce2bdc4f51 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.735153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:13.735431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c424f-4926-4cb2-a998-8dce2bdc4f51 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.736217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f05c424f-4926-4cb2-a998-8dce2bdc4f51 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.737654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c424f-4926-4cb2-a998-8dce2bdc4f51 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:13.738001 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c424f-4926-4cb2-a998-8dce2bdc4f51 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.739608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f05c424f-4926-4cb2-a998-8dce2bdc4f51 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.761589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 280/577] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:13.761589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c424f-4926-4cb2-a998-8dce2bdc4f51 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.823984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d33b000d-2c6f-4fae-a390-eb0b4e0206df None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.865376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e90408-142a-49d7-abc7-95d052a17720 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.865585 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f05c424f-4926-4cb2-a998-8dce2bdc4f51 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:13.866051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e90408-142a-49d7-abc7-95d052a17720 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.866335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e90408-142a-49d7-abc7-95d052a17720 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.866618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e90408-142a-49d7-abc7-95d052a17720 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.867478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e90408-142a-49d7-abc7-95d052a17720 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:13.868348 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e90408-142a-49d7-abc7-95d052a17720 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.869304 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e90408-142a-49d7-abc7-95d052a17720 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.883072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 298/578] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:13.883264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:13.883673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e90408-142a-49d7-abc7-95d052a17720 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.905350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6a4ec-daab-41e5-90b7-af0fb6e49e3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:13.905949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6a4ec-daab-41e5-90b7-af0fb6e49e3d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:13.906232 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6a4ec-daab-41e5-90b7-af0fb6e49e3d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:13.906510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a6a4ec-daab-41e5-90b7-af0fb6e49e3d None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:13.907249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6a4ec-daab-41e5-90b7-af0fb6e49e3d None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:13.907569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6a4ec-daab-41e5-90b7-af0fb6e49e3d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:13.908940 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a6a4ec-daab-41e5-90b7-af0fb6e49e3d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:13.916711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 281/579] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:13.917543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6a4ec-daab-41e5-90b7-af0fb6e49e3d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:13.991603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:14.004790 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e90408-142a-49d7-abc7-95d052a17720 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:14.024490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a6a4ec-daab-41e5-90b7-af0fb6e49e3d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:14.038505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09526c3-e1a6-45e1-8c39-75c92c21bd9e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:14.039290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09526c3-e1a6-45e1-8c39-75c92c21bd9e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:14.039568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09526c3-e1a6-45e1-8c39-75c92c21bd9e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:14.039920 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a09526c3-e1a6-45e1-8c39-75c92c21bd9e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:14.050979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09526c3-e1a6-45e1-8c39-75c92c21bd9e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:14.052929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a09526c3-e1a6-45e1-8c39-75c92c21bd9e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:14.059653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e4d02-e759-42c3-8d27-47a287ae6810 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:14.060438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e4d02-e759-42c3-8d27-47a287ae6810 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:14.060720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e4d02-e759-42c3-8d27-47a287ae6810 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:14.060996 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970e4d02-e759-42c3-8d27-47a287ae6810 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a09526c3-e1a6-45e1-8c39-75c92c21bd9e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:14.070182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:14.071031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:14.071889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:14.071889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:14.071889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:14.071889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:14.071889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 299/580] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:14.072163 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09526c3-e1a6-45e1-8c39-75c92c21bd9e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:14.078014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e4d02-e759-42c3-8d27-47a287ae6810 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:14.079536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970e4d02-e759-42c3-8d27-47a287ae6810 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-970e4d02-e759-42c3-8d27-47a287ae6810 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:14.097458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:14.098353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:14.099276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:14.099276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:14.099276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:14.099276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:14.099276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 282/581] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:14.100218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e4d02-e759-42c3-8d27-47a287ae6810 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:14.128220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:14.191689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a09526c3-e1a6-45e1-8c39-75c92c21bd9e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:14.218426 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970e4d02-e759-42c3-8d27-47a287ae6810 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:14.226904 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c02bf0-4be0-4fbd-a8fd-e32a190b5364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:14.227765 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c02bf0-4be0-4fbd-a8fd-e32a190b5364 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:14.228118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c02bf0-4be0-4fbd-a8fd-e32a190b5364 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:14.228453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01c02bf0-4be0-4fbd-a8fd-e32a190b5364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:14.239848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c02bf0-4be0-4fbd-a8fd-e32a190b5364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:14.241474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01c02bf0-4be0-4fbd-a8fd-e32a190b5364 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:14.243616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:14.256433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b96013-9475-47e7-8bcb-3973866c5c88 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:14.257264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b96013-9475-47e7-8bcb-3973866c5c88 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:14.257546 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b96013-9475-47e7-8bcb-3973866c5c88 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:14.257818 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66b96013-9475-47e7-8bcb-3973866c5c88 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-01c02bf0-4be0-4fbd-a8fd-e32a190b5364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:14.266028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:14.267083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:14.268181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:14.268181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:14.268181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:14.268181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:14.268798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 300/582] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:14.269891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c02bf0-4be0-4fbd-a8fd-e32a190b5364 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:14.273707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b96013-9475-47e7-8bcb-3973866c5c88 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:14.275383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66b96013-9475-47e7-8bcb-3973866c5c88 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-66b96013-9475-47e7-8bcb-3973866c5c88 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:14.299624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:14.300544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:14.301419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:14.301419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:14.301419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:14.301419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:14.303183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 283/583] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:14.304100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b96013-9475-47e7-8bcb-3973866c5c88 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:14.383759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01c02bf0-4be0-4fbd-a8fd-e32a190b5364 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:14.390287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:14.412161 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66b96013-9475-47e7-8bcb-3973866c5c88 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:14.422657 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a7316-631d-46c1-b2f1-ff3ff878deb3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:14.423302 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a7316-631d-46c1-b2f1-ff3ff878deb3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:14.423591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a7316-631d-46c1-b2f1-ff3ff878deb3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:14.423874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543a7316-631d-46c1-b2f1-ff3ff878deb3 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:14.424587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a7316-631d-46c1-b2f1-ff3ff878deb3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:14.424898 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a7316-631d-46c1-b2f1-ff3ff878deb3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:14.426332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-543a7316-631d-46c1-b2f1-ff3ff878deb3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:14.443427 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 301/584] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:14.444294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a7316-631d-46c1-b2f1-ff3ff878deb3 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:14.446847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587bd2b-bece-4efd-832b-2db87956ac9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:14.447511 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587bd2b-bece-4efd-832b-2db87956ac9f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:14.447801 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587bd2b-bece-4efd-832b-2db87956ac9f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:14.448085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9587bd2b-bece-4efd-832b-2db87956ac9f None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:14.448810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587bd2b-bece-4efd-832b-2db87956ac9f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:14.449671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587bd2b-bece-4efd-832b-2db87956ac9f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:14.451253 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9587bd2b-bece-4efd-832b-2db87956ac9f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:14.469886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 284/585] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:14.469886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587bd2b-bece-4efd-832b-2db87956ac9f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:14.513193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:14.559429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543a7316-631d-46c1-b2f1-ff3ff878deb3 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:14.584190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9587bd2b-bece-4efd-832b-2db87956ac9f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:14.598738 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d438e6-d62b-4af2-b18e-88f4d5522049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:14.599403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d438e6-d62b-4af2-b18e-88f4d5522049 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:14.599684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d438e6-d62b-4af2-b18e-88f4d5522049 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:14.599951 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7d438e6-d62b-4af2-b18e-88f4d5522049 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:14.600667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d438e6-d62b-4af2-b18e-88f4d5522049 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:14.600970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d438e6-d62b-4af2-b18e-88f4d5522049 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:14.602378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7d438e6-d62b-4af2-b18e-88f4d5522049 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:14.614511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 302/586] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:14.615273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d438e6-d62b-4af2-b18e-88f4d5522049 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:14.625993 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885cf197-7b73-4875-8475-0e3a3dd44702 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:14.626657 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cf197-7b73-4875-8475-0e3a3dd44702 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:14.626938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cf197-7b73-4875-8475-0e3a3dd44702 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:14.627212 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885cf197-7b73-4875-8475-0e3a3dd44702 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:14.627926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885cf197-7b73-4875-8475-0e3a3dd44702 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:14.628228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885cf197-7b73-4875-8475-0e3a3dd44702 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:14.629626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885cf197-7b73-4875-8475-0e3a3dd44702 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:14.637858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:14.647810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 285/587] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:14.649456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885cf197-7b73-4875-8475-0e3a3dd44702 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:14.735338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7d438e6-d62b-4af2-b18e-88f4d5522049 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:14.751708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:14.755463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885cf197-7b73-4875-8475-0e3a3dd44702 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:14.774438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be3bb9-404a-42b4-b44b-054d2dd0eacd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:14.775316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be3bb9-404a-42b4-b44b-054d2dd0eacd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:14.775667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be3bb9-404a-42b4-b44b-054d2dd0eacd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:14.776006 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80be3bb9-404a-42b4-b44b-054d2dd0eacd None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:14.783077 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be3bb9-404a-42b4-b44b-054d2dd0eacd None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:14.784376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80be3bb9-404a-42b4-b44b-054d2dd0eacd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:14.790801 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4c47d-3bcd-4da6-8e83-1fed566b858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:14.791701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4c47d-3bcd-4da6-8e83-1fed566b858d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:14.792086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4c47d-3bcd-4da6-8e83-1fed566b858d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:14.792462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa4c47d-3bcd-4da6-8e83-1fed566b858d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-80be3bb9-404a-42b4-b44b-054d2dd0eacd None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:14.798594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:14.799632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:14.805429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:14.805429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:14.805429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:14.805429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:14.805429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:14.805429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:14.805429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:14.805429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:14.805429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 303/588] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:14.805429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be3bb9-404a-42b4-b44b-054d2dd0eacd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:14.806299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4c47d-3bcd-4da6-8e83-1fed566b858d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:14.807833 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0aa4c47d-3bcd-4da6-8e83-1fed566b858d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-0aa4c47d-3bcd-4da6-8e83-1fed566b858d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:14.823805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:14.825446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:14.826329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:14.826329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:14.826329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:14.826329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:14.826329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:14.826329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:14.826329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:14.826329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:14.826329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 286/589] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:14.826881 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4c47d-3bcd-4da6-8e83-1fed566b858d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:14.888031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:14.914773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80be3bb9-404a-42b4-b44b-054d2dd0eacd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:14.933177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa4c47d-3bcd-4da6-8e83-1fed566b858d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:14.950611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08701d-cfba-45fa-8fa8-9ac396efe369 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:14.951407 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08701d-cfba-45fa-8fa8-9ac396efe369 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:14.951685 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08701d-cfba-45fa-8fa8-9ac396efe369 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:14.952174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab08701d-cfba-45fa-8fa8-9ac396efe369 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:14.959550 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08701d-cfba-45fa-8fa8-9ac396efe369 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:14.961008 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab08701d-cfba-45fa-8fa8-9ac396efe369 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:14.968790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c81f-0a6a-4752-9543-4f983c9189b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:14.969615 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c81f-0a6a-4752-9543-4f983c9189b4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:14.969897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c81f-0a6a-4752-9543-4f983c9189b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:14.970172 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e0c81f-0a6a-4752-9543-4f983c9189b4 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ab08701d-cfba-45fa-8fa8-9ac396efe369 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:14.975754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:14.976640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:14.977591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:14.977591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:14.977591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:14.977591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:14.977591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:14.977591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:14.977591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:14.977591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:14.977591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 18:08:14.977591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:14.977591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 304/590] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:14 2022] GET /identity/v3/users/neutron => generated 85 bytes in 176 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:14.978167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08701d-cfba-45fa-8fa8-9ac396efe369 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:14.982635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0c81f-0a6a-4752-9543-4f983c9189b4 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:14.984100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e0c81f-0a6a-4752-9543-4f983c9189b4 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-17e0c81f-0a6a-4752-9543-4f983c9189b4 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:14.999785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:15.000689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:15.001660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:15.001660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:15.001660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:15.001660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:15.001660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:15.001660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:15.001660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:15.001660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:15.001660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 18:08:15.001660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:15.001660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 287/591] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:08:14 2022] GET /identity/v3/users/cinder => generated 84 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:15.002233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c81f-0a6a-4752-9543-4f983c9189b4 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:15.016379 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:15.091837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab08701d-cfba-45fa-8fa8-9ac396efe369 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:15.115288 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e0c81f-0a6a-4752-9543-4f983c9189b4 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:15.127375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43f821-21d0-4694-88fb-e592aa579959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:15.128034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43f821-21d0-4694-88fb-e592aa579959 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:15.128339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43f821-21d0-4694-88fb-e592aa579959 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:15.128612 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af43f821-21d0-4694-88fb-e592aa579959 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:15.129432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43f821-21d0-4694-88fb-e592aa579959 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:15.129739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43f821-21d0-4694-88fb-e592aa579959 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:15.131159 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af43f821-21d0-4694-88fb-e592aa579959 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:15.137744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:15.147047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 305/592] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:15.148296 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43f821-21d0-4694-88fb-e592aa579959 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:15.157410 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57867c8-12ad-4aa6-98b1-3983c9937945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:15.158082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57867c8-12ad-4aa6-98b1-3983c9937945 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:15.158778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57867c8-12ad-4aa6-98b1-3983c9937945 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:15.159064 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f57867c8-12ad-4aa6-98b1-3983c9937945 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:15.159853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57867c8-12ad-4aa6-98b1-3983c9937945 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:15.160512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57867c8-12ad-4aa6-98b1-3983c9937945 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:15.162325 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f57867c8-12ad-4aa6-98b1-3983c9937945 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:15.183252 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 288/593] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:15.184834 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57867c8-12ad-4aa6-98b1-3983c9937945 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:15.254180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:15.261623 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af43f821-21d0-4694-88fb-e592aa579959 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:15.289159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f57867c8-12ad-4aa6-98b1-3983c9937945 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:15.294837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c55bd-05ea-41ae-8ca7-457aa014ac31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:15.295503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c55bd-05ea-41ae-8ca7-457aa014ac31 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:15.295783 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c55bd-05ea-41ae-8ca7-457aa014ac31 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:15.296059 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-535c55bd-05ea-41ae-8ca7-457aa014ac31 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:15.296882 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c55bd-05ea-41ae-8ca7-457aa014ac31 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:15.297254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c55bd-05ea-41ae-8ca7-457aa014ac31 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:15.298660 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-535c55bd-05ea-41ae-8ca7-457aa014ac31 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:15.315756 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 306/594] 10.222.0.64 () {56 vars in 1139 bytes} [Thu May 26 18:08:15 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:15.316518 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c55bd-05ea-41ae-8ca7-457aa014ac31 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:15.322864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d17c1-e2fe-45aa-9308-1f5dcd1de205 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:15.323523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d17c1-e2fe-45aa-9308-1f5dcd1de205 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:15.323801 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d17c1-e2fe-45aa-9308-1f5dcd1de205 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:15.324102 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d91d17c1-e2fe-45aa-9308-1f5dcd1de205 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:15.324927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d17c1-e2fe-45aa-9308-1f5dcd1de205 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:15.325262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d17c1-e2fe-45aa-9308-1f5dcd1de205 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:15.326696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d91d17c1-e2fe-45aa-9308-1f5dcd1de205 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:15.343174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 289/595] 10.222.0.64 () {56 vars in 1137 bytes} [Thu May 26 18:08:15 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:15.343931 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d17c1-e2fe-45aa-9308-1f5dcd1de205 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:15.378983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:15.412689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-535c55bd-05ea-41ae-8ca7-457aa014ac31 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:15.442379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d91d17c1-e2fe-45aa-9308-1f5dcd1de205 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:15.447810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4445d83-c927-4b18-ab3c-65e9063ab6da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:15.448691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4445d83-c927-4b18-ab3c-65e9063ab6da None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:15.448969 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4445d83-c927-4b18-ab3c-65e9063ab6da None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:15.449275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4445d83-c927-4b18-ab3c-65e9063ab6da None admin] PATH_INFO: `/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/a2fbb5beba8a45a5b0a9b0beba0e0d63/roles/ec1445be03c942a98070dd9213fd0705` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:15.463404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4445d83-c927-4b18-ab3c-65e9063ab6da None admin] RBAC: Authorizing `identity:create_grant(project_id=ab7fe8d932964e7ab1f442f26ef0735b, user_id=a2fbb5beba8a45a5b0a9b0beba0e0d63, role_id=ec1445be03c942a98070dd9213fd0705)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:15.464822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4445d83-c927-4b18-ab3c-65e9063ab6da None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:15.476010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdbf07-a1c8-41b1-81a9-200f4674a983 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:15.476893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdbf07-a1c8-41b1-81a9-200f4674a983 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:15.477204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdbf07-a1c8-41b1-81a9-200f4674a983 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:15.477480 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14bdbf07-a1c8-41b1-81a9-200f4674a983 None admin] PATH_INFO: `/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/97f259ac2eb4425f8b4dcffeccdcd439/roles/ec1445be03c942a98070dd9213fd0705` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:15.477597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 307/596] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:08:15 2022] PUT /identity/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/a2fbb5beba8a45a5b0a9b0beba0e0d63/roles/ec1445be03c942a98070dd9213fd0705 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:15.478940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5ef2b-79b4-4167-a109-0c3a71b4adda None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:15.479218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5ef2b-79b4-4167-a109-0c3a71b4adda None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:15.479492 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef5ef2b-79b4-4167-a109-0c3a71b4adda None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:15.482147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 308/597] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:15.482673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5ef2b-79b4-4167-a109-0c3a71b4adda None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:15.485593 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:15.500835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdbf07-a1c8-41b1-81a9-200f4674a983 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab7fe8d932964e7ab1f442f26ef0735b, user_id=97f259ac2eb4425f8b4dcffeccdcd439, role_id=ec1445be03c942a98070dd9213fd0705)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:15.502776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14bdbf07-a1c8-41b1-81a9-200f4674a983 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:15.519264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 290/598] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:08:15 2022] PUT /identity/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/97f259ac2eb4425f8b4dcffeccdcd439/roles/ec1445be03c942a98070dd9213fd0705 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:15.520369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdbf07-a1c8-41b1-81a9-200f4674a983 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:15.619085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef5ef2b-79b4-4167-a109-0c3a71b4adda None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:15.661886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:15.673324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee29b95b-2207-4864-85aa-5ff364241483 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:15.674498 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29b95b-2207-4864-85aa-5ff364241483 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:15.674789 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29b95b-2207-4864-85aa-5ff364241483 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:15.675190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee29b95b-2207-4864-85aa-5ff364241483 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:15.687193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14bdbf07-a1c8-41b1-81a9-200f4674a983 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:15.690975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29b95b-2207-4864-85aa-5ff364241483 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:15.692439 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee29b95b-2207-4864-85aa-5ff364241483 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ee29b95b-2207-4864-85aa-5ff364241483 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:15.719533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:15.720606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:15.721594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:15.721594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:15.721594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:15.721594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:15.726662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 309/599] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 240 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:15.729575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb41e-a721-452c-ab89-f3b5fc9d55d0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:15.730066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb41e-a721-452c-ab89-f3b5fc9d55d0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:15.730914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da8fb41e-a721-452c-ab89-f3b5fc9d55d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:15.745293 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefcc79-54ff-40da-9eeb-6293a797f227 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:15.746500 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefcc79-54ff-40da-9eeb-6293a797f227 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:15.746873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefcc79-54ff-40da-9eeb-6293a797f227 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:15.747210 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cefcc79-54ff-40da-9eeb-6293a797f227 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:15.758727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefcc79-54ff-40da-9eeb-6293a797f227 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:15.760183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cefcc79-54ff-40da-9eeb-6293a797f227 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:15.762597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-da8fb41e-a721-452c-ab89-f3b5fc9d55d0 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:15.763817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-da8fb41e-a721-452c-ab89-f3b5fc9d55d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-1cefcc79-54ff-40da-9eeb-6293a797f227 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:15.779688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:15.780701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:15.781888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:15.781888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:15.781888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:15.781888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:15.781888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 291/600] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:15.782341 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefcc79-54ff-40da-9eeb-6293a797f227 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:15.826391 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:15.846500 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 310/601] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:15 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:15.847896 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fb41e-a721-452c-ab89-f3b5fc9d55d0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:15.906801 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cefcc79-54ff-40da-9eeb-6293a797f227 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:15.942295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205552f9-edf1-4ea4-a6a4-3350b28062a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:15.943264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205552f9-edf1-4ea4-a6a4-3350b28062a3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:15.943731 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205552f9-edf1-4ea4-a6a4-3350b28062a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:15.944185 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-205552f9-edf1-4ea4-a6a4-3350b28062a3 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:15.945182 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205552f9-edf1-4ea4-a6a4-3350b28062a3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:15.945671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205552f9-edf1-4ea4-a6a4-3350b28062a3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:15.947224 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-205552f9-edf1-4ea4-a6a4-3350b28062a3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:15.955289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:15.961089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 292/602] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:15.962212 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205552f9-edf1-4ea4-a6a4-3350b28062a3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:15.971687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da8fb41e-a721-452c-ab89-f3b5fc9d55d0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:16.009860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7444041-9dbd-4ee2-88b4-528a02d8af70 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:16.010748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7444041-9dbd-4ee2-88b4-528a02d8af70 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:16.011106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7444041-9dbd-4ee2-88b4-528a02d8af70 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:16.011455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7444041-9dbd-4ee2-88b4-528a02d8af70 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:16.012883 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7444041-9dbd-4ee2-88b4-528a02d8af70 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:16.013299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7444041-9dbd-4ee2-88b4-528a02d8af70 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:16.014751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7444041-9dbd-4ee2-88b4-528a02d8af70 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:16.028083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 311/603] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:16.029074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7444041-9dbd-4ee2-88b4-528a02d8af70 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:16.069541 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-205552f9-edf1-4ea4-a6a4-3350b28062a3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:16.080194 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:16.106008 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034eaebd-4414-4e3d-84ac-d18f952c8e96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:16.107358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034eaebd-4414-4e3d-84ac-d18f952c8e96 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:16.107644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034eaebd-4414-4e3d-84ac-d18f952c8e96 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:16.107923 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-034eaebd-4414-4e3d-84ac-d18f952c8e96 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:16.118657 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-034eaebd-4414-4e3d-84ac-d18f952c8e96 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-034eaebd-4414-4e3d-84ac-d18f952c8e96 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:16.126433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:16.127336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:16.128145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:16.128145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:16.128145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:16.128145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:16.128145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:16.128145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:16.128145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:16.128145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:16.128145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:16.128145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:16.128145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:16.128145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:16.132299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 293/604] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:15 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:16.133198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034eaebd-4414-4e3d-84ac-d18f952c8e96 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:16.149911 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7444041-9dbd-4ee2-88b4-528a02d8af70 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:16.194705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:16.202904 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18993b1-8d1e-4479-90e9-d08466402be1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:16.204236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18993b1-8d1e-4479-90e9-d08466402be1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:16.204786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18993b1-8d1e-4479-90e9-d08466402be1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:16.205434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d18993b1-8d1e-4479-90e9-d08466402be1 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:16.215882 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18993b1-8d1e-4479-90e9-d08466402be1 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:16.218622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d18993b1-8d1e-4479-90e9-d08466402be1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d18993b1-8d1e-4479-90e9-d08466402be1 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:16.239224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:16.240154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:16.241051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:16.241051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:16.241051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:16.241051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:16.241051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:16.241051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:16.241051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:16.241051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:16.247699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 312/605] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:16.247699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18993b1-8d1e-4479-90e9-d08466402be1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:16.251697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-034eaebd-4414-4e3d-84ac-d18f952c8e96 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:16.292333 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8e02e-6baa-4c65-94cc-075f120a54fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:16.293397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8e02e-6baa-4c65-94cc-075f120a54fb None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:16.293734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8e02e-6baa-4c65-94cc-075f120a54fb None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:16.294014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e8e02e-6baa-4c65-94cc-075f120a54fb None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:16.303020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8e02e-6baa-4c65-94cc-075f120a54fb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:16.304592 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e8e02e-6baa-4c65-94cc-075f120a54fb None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-b0e8e02e-6baa-4c65-94cc-075f120a54fb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:16.323390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:16.324929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:16.325872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:16.325872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:16.325872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:16.325872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:16.325872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:16.325872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:16.325872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:16.325872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:16.325872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 294/606] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:16 2022] GET /identity/v3/projects/service => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:16.326915 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8e02e-6baa-4c65-94cc-075f120a54fb None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:16.389421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d18993b1-8d1e-4479-90e9-d08466402be1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:16.417542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:16.427899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcd291-a6f2-4d33-9c4b-6bf5c6e71460 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:16.428565 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcd291-a6f2-4d33-9c4b-6bf5c6e71460 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:16.428950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcd291-a6f2-4d33-9c4b-6bf5c6e71460 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:16.429271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7bcd291-a6f2-4d33-9c4b-6bf5c6e71460 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:16.430116 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcd291-a6f2-4d33-9c4b-6bf5c6e71460 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:16.430501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcd291-a6f2-4d33-9c4b-6bf5c6e71460 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:16.432197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7bcd291-a6f2-4d33-9c4b-6bf5c6e71460 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:16.436618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e8e02e-6baa-4c65-94cc-075f120a54fb None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:16.441548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 313/607] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:16 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:16.442418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcd291-a6f2-4d33-9c4b-6bf5c6e71460 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:16.460731 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:16.483381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfebde5-442f-4634-9d7f-d9513315d39f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:16.484073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfebde5-442f-4634-9d7f-d9513315d39f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:16.484373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfebde5-442f-4634-9d7f-d9513315d39f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:16.485049 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfebde5-442f-4634-9d7f-d9513315d39f None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:16.486119 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfebde5-442f-4634-9d7f-d9513315d39f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:16.486436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfebde5-442f-4634-9d7f-d9513315d39f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:16.487885 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfebde5-442f-4634-9d7f-d9513315d39f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:16.504308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 295/608] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:16.505467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfebde5-442f-4634-9d7f-d9513315d39f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:16.563483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7bcd291-a6f2-4d33-9c4b-6bf5c6e71460 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:16.600599 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a5189-c9c8-4167-9e7e-23c05462dbf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:16.601694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a5189-c9c8-4167-9e7e-23c05462dbf6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:16.602294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a5189-c9c8-4167-9e7e-23c05462dbf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:16.602773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d9a5189-c9c8-4167-9e7e-23c05462dbf6 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:16.603773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a5189-c9c8-4167-9e7e-23c05462dbf6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:16.604289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a5189-c9c8-4167-9e7e-23c05462dbf6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:16.606393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d9a5189-c9c8-4167-9e7e-23c05462dbf6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:16.618543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfebde5-442f-4634-9d7f-d9513315d39f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:16.627157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 314/609] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:16 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:16.628378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a5189-c9c8-4167-9e7e-23c05462dbf6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:16.654536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4d1c7-9c77-4af8-a4ec-8836f699c330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:16.655332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4d1c7-9c77-4af8-a4ec-8836f699c330 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:16.655616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4d1c7-9c77-4af8-a4ec-8836f699c330 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:16.655896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40d4d1c7-9c77-4af8-a4ec-8836f699c330 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:16.659147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:16.669397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4d1c7-9c77-4af8-a4ec-8836f699c330 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:16.671619 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40d4d1c7-9c77-4af8-a4ec-8836f699c330 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-40d4d1c7-9c77-4af8-a4ec-8836f699c330 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:16.693533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:16.694529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:16.695430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:16.695430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:16.695430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:16.695430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:16.697065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 296/610] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:16.698116 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4d1c7-9c77-4af8-a4ec-8836f699c330 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:16.730156 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:16.753848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d9a5189-c9c8-4167-9e7e-23c05462dbf6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:16.799793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a24d44-ae40-4660-bb1f-9b499504e2e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:16.801021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a24d44-ae40-4660-bb1f-9b499504e2e6 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:16.801316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a24d44-ae40-4660-bb1f-9b499504e2e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:16.801596 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2a24d44-ae40-4660-bb1f-9b499504e2e6 None admin] PATH_INFO: `/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/1b725c28490f4f90b5eec565cd0fb603/roles/ec1445be03c942a98070dd9213fd0705` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:16.808087 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40d4d1c7-9c77-4af8-a4ec-8836f699c330 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:16.823015 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a24d44-ae40-4660-bb1f-9b499504e2e6 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab7fe8d932964e7ab1f442f26ef0735b, user_id=1b725c28490f4f90b5eec565cd0fb603, role_id=ec1445be03c942a98070dd9213fd0705)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:16.825251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2a24d44-ae40-4660-bb1f-9b499504e2e6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:16.843125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 315/611] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:08:16 2022] PUT /identity/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/1b725c28490f4f90b5eec565cd0fb603/roles/ec1445be03c942a98070dd9213fd0705 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:16.844455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a24d44-ae40-4660-bb1f-9b499504e2e6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:16.846904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e3689-2ec6-4937-af92-8fb0ce1f2d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:16.848180 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e3689-2ec6-4937-af92-8fb0ce1f2d0d None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:16.848460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e3689-2ec6-4937-af92-8fb0ce1f2d0d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:16.848797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368e3689-2ec6-4937-af92-8fb0ce1f2d0d None admin] PATH_INFO: `/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/0c09ffb276b84b2aa8735d6907a0de73/roles/ec1445be03c942a98070dd9213fd0705` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:16.870910 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e3689-2ec6-4937-af92-8fb0ce1f2d0d None admin] RBAC: Authorizing `identity:create_grant(project_id=ab7fe8d932964e7ab1f442f26ef0735b, user_id=0c09ffb276b84b2aa8735d6907a0de73, role_id=ec1445be03c942a98070dd9213fd0705)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:16.873024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368e3689-2ec6-4937-af92-8fb0ce1f2d0d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:16.896911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 297/612] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:08:16 2022] PUT /identity/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/0c09ffb276b84b2aa8735d6907a0de73/roles/ec1445be03c942a98070dd9213fd0705 => generated 0 bytes in 199 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:16.951190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:16.988349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2a24d44-ae40-4660-bb1f-9b499504e2e6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:17.026990 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb81558-c8b6-484b-9ca7-0188d41a2774 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:17.028199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb81558-c8b6-484b-9ca7-0188d41a2774 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:17.028733 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb81558-c8b6-484b-9ca7-0188d41a2774 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:17.028733 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bb81558-c8b6-484b-9ca7-0188d41a2774 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:17.029494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb81558-c8b6-484b-9ca7-0188d41a2774 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:17.029803 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb81558-c8b6-484b-9ca7-0188d41a2774 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:17.031179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bb81558-c8b6-484b-9ca7-0188d41a2774 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:17.049189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 316/613] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:17.050639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e3689-2ec6-4937-af92-8fb0ce1f2d0d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:17.158711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:17.190071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368e3689-2ec6-4937-af92-8fb0ce1f2d0d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:17.235770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5600-633a-4f36-9f1f-b5e57ace7508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:17.236962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5600-633a-4f36-9f1f-b5e57ace7508 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:17.237491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5600-633a-4f36-9f1f-b5e57ace7508 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:17.237985 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eef5600-633a-4f36-9f1f-b5e57ace7508 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:17.246341 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef5600-633a-4f36-9f1f-b5e57ace7508 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:17.248076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5eef5600-633a-4f36-9f1f-b5e57ace7508 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5eef5600-633a-4f36-9f1f-b5e57ace7508 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:17.263430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:17.264425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:17.265997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:17.265997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:17.265997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:17.265997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:17.265997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:17.265997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:17.265997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:17.265997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:17.265997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 18:08:17.265997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:17.268416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 298/614] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:08:17 2022] GET /identity/v3/users/swift => generated 83 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:17.273878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb81558-c8b6-484b-9ca7-0188d41a2774 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:17.403864 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bb81558-c8b6-484b-9ca7-0188d41a2774 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:17.440122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d0a6d-3d76-4047-a620-252adf58ba99 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:17.441234 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d0a6d-3d76-4047-a620-252adf58ba99 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:17.441729 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d0a6d-3d76-4047-a620-252adf58ba99 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:17.442242 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-593d0a6d-3d76-4047-a620-252adf58ba99 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:17.443288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d0a6d-3d76-4047-a620-252adf58ba99 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:17.443823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d0a6d-3d76-4047-a620-252adf58ba99 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:17.445494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-593d0a6d-3d76-4047-a620-252adf58ba99 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:17.448660 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:17.472319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 317/615] 10.222.0.64 () {56 vars in 1135 bytes} [Thu May 26 18:08:17 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:17.477529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5600-633a-4f36-9f1f-b5e57ace7508 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:17.618287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5eef5600-633a-4f36-9f1f-b5e57ace7508 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:17.655495 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3f0ce3-2467-430b-a343-3dac4166f5d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:17.656639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f0ce3-2467-430b-a343-3dac4166f5d9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:17.657184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f0ce3-2467-430b-a343-3dac4166f5d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:17.657679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3f0ce3-2467-430b-a343-3dac4166f5d9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:17.666818 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:17.669648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f0ce3-2467-430b-a343-3dac4166f5d9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:17.671400 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3f0ce3-2467-430b-a343-3dac4166f5d9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-1b3f0ce3-2467-430b-a343-3dac4166f5d9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:17.690038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:17.690992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:17.691920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:17.691920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:17.691920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:17.691920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:17.694235 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 299/616] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:17.702072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d0a6d-3d76-4047-a620-252adf58ba99 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:17.764173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61131627-ce2c-4e60-ab41-d23e55c856da None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:17.764848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61131627-ce2c-4e60-ab41-d23e55c856da None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:17.765466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61131627-ce2c-4e60-ab41-d23e55c856da None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:17.768110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 300/617] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:17.773232 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5883b-8b6e-4b87-9ea7-54b686a43d29 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:17.773977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5883b-8b6e-4b87-9ea7-54b686a43d29 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:17.774480 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf5883b-8b6e-4b87-9ea7-54b686a43d29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:17.798252 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fdf5883b-8b6e-4b87-9ea7-54b686a43d29 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:17.799913 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fdf5883b-8b6e-4b87-9ea7-54b686a43d29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:17.857453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-593d0a6d-3d76-4047-a620-252adf58ba99 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:17.887380 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 301/618] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:17.914407 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5883b-8b6e-4b87-9ea7-54b686a43d29 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:17.915764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d8b95-716b-4269-a821-cc4945810c52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:17.916442 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d8b95-716b-4269-a821-cc4945810c52 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:17.916729 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d8b95-716b-4269-a821-cc4945810c52 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:17.917104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e86d8b95-716b-4269-a821-cc4945810c52 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:17.917831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d8b95-716b-4269-a821-cc4945810c52 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:17.918746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d8b95-716b-4269-a821-cc4945810c52 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:17.920764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e86d8b95-716b-4269-a821-cc4945810c52 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:17.932849 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 318/619] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:17.938400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d8b95-716b-4269-a821-cc4945810c52 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:18.030902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:18.080695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf5883b-8b6e-4b87-9ea7-54b686a43d29 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:18.083000 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e86d8b95-716b-4269-a821-cc4945810c52 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:18.105989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:18.120329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88fc70ee-b8a3-4458-b5d6-2f350d96005e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:18.121560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc70ee-b8a3-4458-b5d6-2f350d96005e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.121977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40ae8c-83ea-4840-a758-f678bc822215 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:18.122340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc70ee-b8a3-4458-b5d6-2f350d96005e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.122839 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40ae8c-83ea-4840-a758-f678bc822215 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.123080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88fc70ee-b8a3-4458-b5d6-2f350d96005e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.123182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40ae8c-83ea-4840-a758-f678bc822215 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.123389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40ae8c-83ea-4840-a758-f678bc822215 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.131151 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40ae8c-83ea-4840-a758-f678bc822215 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:18.132575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d40ae8c-83ea-4840-a758-f678bc822215 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:18.135370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88fc70ee-b8a3-4458-b5d6-2f350d96005e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-88fc70ee-b8a3-4458-b5d6-2f350d96005e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:18.144140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:18.145139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:18.145982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:18.145982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:18.145982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:18.145982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:18.145982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:18.145982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:18.145982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:18.145982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:18.145982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:18.145982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:18.145982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:18.145982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:18.148800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 302/620] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:18.150384 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e96e96-1a69-431c-ae9a-f91dfff0d17f None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.150879 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e96e96-1a69-431c-ae9a-f91dfff0d17f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.151381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46e96e96-1a69-431c-ae9a-f91dfff0d17f None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5d40ae8c-83ea-4840-a758-f678bc822215 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:18.153699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:18.154576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:18.155467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:18.155467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:18.155467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:18.155467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:18.155467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:18.155467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:18.155467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:18.155467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:18.155467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 319/622] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:17 2022] GET /identity/v3/projects/service => generated 88 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:18.156403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40ae8c-83ea-4840-a758-f678bc822215 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:18.156608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 303/622] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:18.164160 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350cfdd-a229-445c-9c4c-a872d0b5825d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.164160 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350cfdd-a229-445c-9c4c-a872d0b5825d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.164160 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3350cfdd-a229-445c-9c4c-a872d0b5825d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.176717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3350cfdd-a229-445c-9c4c-a872d0b5825d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:18.177882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3350cfdd-a229-445c-9c4c-a872d0b5825d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:18.251256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 304/623] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:08:18.252118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350cfdd-a229-445c-9c4c-a872d0b5825d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:18.303419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40ae8c-83ea-4840-a758-f678bc822215 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:18.323811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:18.348155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9645a-29dd-4cf1-b5ac-21179b95256c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:18.348830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9645a-29dd-4cf1-b5ac-21179b95256c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.349310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9645a-29dd-4cf1-b5ac-21179b95256c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.349596 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb9645a-29dd-4cf1-b5ac-21179b95256c None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.350720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9645a-29dd-4cf1-b5ac-21179b95256c None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:18.351183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9645a-29dd-4cf1-b5ac-21179b95256c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:18.352828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb9645a-29dd-4cf1-b5ac-21179b95256c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:18.363617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 320/624] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:18.364519 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9645a-29dd-4cf1-b5ac-21179b95256c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:18.372748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3350cfdd-a229-445c-9c4c-a872d0b5825d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:18.393308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:18.415521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e5a0d-9065-48a8-beeb-c10894241616 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:18.416183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e5a0d-9065-48a8-beeb-c10894241616 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.416467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e5a0d-9065-48a8-beeb-c10894241616 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.416743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a24e5a0d-9065-48a8-beeb-c10894241616 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.417709 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e5a0d-9065-48a8-beeb-c10894241616 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:18.418057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e5a0d-9065-48a8-beeb-c10894241616 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:18.419671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a24e5a0d-9065-48a8-beeb-c10894241616 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:18.436529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 305/625] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:18.437474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e5a0d-9065-48a8-beeb-c10894241616 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:18.486774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb9645a-29dd-4cf1-b5ac-21179b95256c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:18.525823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45003566-e3ea-4025-8c0b-1fe95351b9ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:18.526632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45003566-e3ea-4025-8c0b-1fe95351b9ff None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.526920 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45003566-e3ea-4025-8c0b-1fe95351b9ff None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.527202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45003566-e3ea-4025-8c0b-1fe95351b9ff None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.538918 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45003566-e3ea-4025-8c0b-1fe95351b9ff None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-45003566-e3ea-4025-8c0b-1fe95351b9ff None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:18.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:18.548247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:18.549091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:18.549091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:18.549091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:18.549091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:18.549091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:18.549091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:18.549091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:18.549091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:18.549091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:18.549091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:18.549091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:18.549091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:18.549091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 321/626] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:18.550278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45003566-e3ea-4025-8c0b-1fe95351b9ff None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:18.566471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a24e5a0d-9065-48a8-beeb-c10894241616 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:18.594887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:18.609142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21880e0-8a89-417e-a40a-948539c3db77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:18.610271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21880e0-8a89-417e-a40a-948539c3db77 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.610794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21880e0-8a89-417e-a40a-948539c3db77 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.611290 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a21880e0-8a89-417e-a40a-948539c3db77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.626342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21880e0-8a89-417e-a40a-948539c3db77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:18.628763 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a21880e0-8a89-417e-a40a-948539c3db77 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-a21880e0-8a89-417e-a40a-948539c3db77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:18.650601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:18.651544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:18.652447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:18.652447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:18.652447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:18.652447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:18.654637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 306/627] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:18.655559 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21880e0-8a89-417e-a40a-948539c3db77 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:18.678763 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45003566-e3ea-4025-8c0b-1fe95351b9ff None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:18.687940 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:18.725076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381959d-3662-4efa-8a51-40b06db7ecd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:18.726354 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381959d-3662-4efa-8a51-40b06db7ecd7 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.726731 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381959d-3662-4efa-8a51-40b06db7ecd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.727473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b381959d-3662-4efa-8a51-40b06db7ecd7 None admin] PATH_INFO: `/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/9cb21a6eef0e418182b2dd755096ca77/roles/ec1445be03c942a98070dd9213fd0705` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.746881 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381959d-3662-4efa-8a51-40b06db7ecd7 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab7fe8d932964e7ab1f442f26ef0735b, user_id=9cb21a6eef0e418182b2dd755096ca77, role_id=ec1445be03c942a98070dd9213fd0705)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:18.748437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b381959d-3662-4efa-8a51-40b06db7ecd7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:18.768686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 322/628] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:08:18 2022] PUT /identity/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/9cb21a6eef0e418182b2dd755096ca77/roles/ec1445be03c942a98070dd9213fd0705 => generated 0 bytes in 219 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:18.769986 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381959d-3662-4efa-8a51-40b06db7ecd7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:18.778745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a21880e0-8a89-417e-a40a-948539c3db77 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:18.819334 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c697817-1b41-4455-bfaa-5ee99128f174 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:18.820311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c697817-1b41-4455-bfaa-5ee99128f174 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.820744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c697817-1b41-4455-bfaa-5ee99128f174 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.821197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c697817-1b41-4455-bfaa-5ee99128f174 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.822442 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c697817-1b41-4455-bfaa-5ee99128f174 None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:18.824854 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c697817-1b41-4455-bfaa-5ee99128f174 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:18.825174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c697817-1b41-4455-bfaa-5ee99128f174 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:18.835238 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 307/629] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:18.844215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c697817-1b41-4455-bfaa-5ee99128f174 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:18.884113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:18.903825 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b381959d-3662-4efa-8a51-40b06db7ecd7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:18.948451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3cc99-0f7d-469d-bc80-99396090a926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:18.949260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3cc99-0f7d-469d-bc80-99396090a926 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:18.949598 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3cc99-0f7d-469d-bc80-99396090a926 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:18.949919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be3cc99-0f7d-469d-bc80-99396090a926 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:18.950662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3cc99-0f7d-469d-bc80-99396090a926 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:18.950968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3cc99-0f7d-469d-bc80-99396090a926 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:18.954118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be3cc99-0f7d-469d-bc80-99396090a926 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:18.966968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 323/630] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:18.972850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3cc99-0f7d-469d-bc80-99396090a926 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:19.035704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:19.058395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c697817-1b41-4455-bfaa-5ee99128f174 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:19.102038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4192-14d8-4dfe-9293-b7b0319503eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:19.102842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4192-14d8-4dfe-9293-b7b0319503eb None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.103034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be3cc99-0f7d-469d-bc80-99396090a926 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:19.103396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4192-14d8-4dfe-9293-b7b0319503eb None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.103396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-729b4192-14d8-4dfe-9293-b7b0319503eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.116828 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b4192-14d8-4dfe-9293-b7b0319503eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:19.118322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-729b4192-14d8-4dfe-9293-b7b0319503eb None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-729b4192-14d8-4dfe-9293-b7b0319503eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:19.139876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:19.140840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:19.141756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:19.141756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:19.141756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:19.141756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:19.147191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 308/631] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:19.152528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4192-14d8-4dfe-9293-b7b0319503eb None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:19.175278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf63cb6-932e-422c-ab4e-54dbfb3c2ba9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:19.176089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63cb6-932e-422c-ab4e-54dbfb3c2ba9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.182651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63cb6-932e-422c-ab4e-54dbfb3c2ba9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.182934 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf63cb6-932e-422c-ab4e-54dbfb3c2ba9 None admin] PATH_INFO: `/v3/users/glance` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.201684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf63cb6-932e-422c-ab4e-54dbfb3c2ba9 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:19.203064 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cf63cb6-932e-422c-ab4e-54dbfb3c2ba9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3cf63cb6-932e-422c-ab4e-54dbfb3c2ba9 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:19.227659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:19.229941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:19.233036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:19.233036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:19.233036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:19.233036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:19.233036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:19.233036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:19.233036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:19.233036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:19.233036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. May 26 18:08:19.233036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:19.233036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 324/632] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:08:18 2022] GET /identity/v3/users/glance => generated 84 bytes in 257 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:19.237925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf63cb6-932e-422c-ab4e-54dbfb3c2ba9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:19.254527 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:19.301647 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-729b4192-14d8-4dfe-9293-b7b0319503eb None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:19.344009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b030-925f-473a-a329-ab4451a35e30 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:19.344681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b030-925f-473a-a329-ab4451a35e30 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.344967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b030-925f-473a-a329-ab4451a35e30 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.345266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d09b030-925f-473a-a329-ab4451a35e30 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.345987 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09b030-925f-473a-a329-ab4451a35e30 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:19.346297 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09b030-925f-473a-a329-ab4451a35e30 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:19.347680 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d09b030-925f-473a-a329-ab4451a35e30 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:19.370195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:19.374100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 309/633] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:19.384537 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b030-925f-473a-a329-ab4451a35e30 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:19.424696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cf63cb6-932e-422c-ab4e-54dbfb3c2ba9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:19.483534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417a1fd-4e93-46bf-b44d-11ba8e8308b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:19.484751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417a1fd-4e93-46bf-b44d-11ba8e8308b4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.484751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417a1fd-4e93-46bf-b44d-11ba8e8308b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.484751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5417a1fd-4e93-46bf-b44d-11ba8e8308b4 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.485893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417a1fd-4e93-46bf-b44d-11ba8e8308b4 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:19.487519 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417a1fd-4e93-46bf-b44d-11ba8e8308b4 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:19.488000 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5417a1fd-4e93-46bf-b44d-11ba8e8308b4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:19.521722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 325/634] 10.222.0.64 () {56 vars in 1137 bytes} [Thu May 26 18:08:19 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:19.527089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417a1fd-4e93-46bf-b44d-11ba8e8308b4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:19.602482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d09b030-925f-473a-a329-ab4451a35e30 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:19.657205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:19.677452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3371e7a2-5100-41f9-a3a0-099a4b4030c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:19.678266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371e7a2-5100-41f9-a3a0-099a4b4030c2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.678547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371e7a2-5100-41f9-a3a0-099a4b4030c2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.678818 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3371e7a2-5100-41f9-a3a0-099a4b4030c2 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.693679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371e7a2-5100-41f9-a3a0-099a4b4030c2 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:19.695146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3371e7a2-5100-41f9-a3a0-099a4b4030c2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-3371e7a2-5100-41f9-a3a0-099a4b4030c2 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:19.720105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:19.721144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:19.722091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:19.722091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:19.722091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:19.722091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:19.722091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:19.722091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:19.722091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:19.722091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:19.722091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 18:08:19.722091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:19.727992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 310/635] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 26 18:08:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:19.730632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f3143-a6b1-4f56-9d2f-c8d4d895afbc None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.730920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f3143-a6b1-4f56-9d2f-c8d4d895afbc None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.731196 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-248f3143-a6b1-4f56-9d2f-c8d4d895afbc None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.732958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 311/636] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:19.735827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f3143-a6b1-4f56-9d2f-c8d4d895afbc None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:19.742715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5417a1fd-4e93-46bf-b44d-11ba8e8308b4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:19.779631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53f3790d-08c4-485b-8bd9-b954f35ff3d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:19.780456 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3790d-08c4-485b-8bd9-b954f35ff3d4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.780835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3790d-08c4-485b-8bd9-b954f35ff3d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.781327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53f3790d-08c4-485b-8bd9-b954f35ff3d4 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.808081 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:19.852535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3790d-08c4-485b-8bd9-b954f35ff3d4 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:19.854061 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53f3790d-08c4-485b-8bd9-b954f35ff3d4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:19.856909 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-248f3143-a6b1-4f56-9d2f-c8d4d895afbc None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:19.893071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea088d7-ec47-4f3d-8cfb-e7da7ffc600f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:19.893737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea088d7-ec47-4f3d-8cfb-e7da7ffc600f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.894268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea088d7-ec47-4f3d-8cfb-e7da7ffc600f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.894268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea088d7-ec47-4f3d-8cfb-e7da7ffc600f None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.895109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea088d7-ec47-4f3d-8cfb-e7da7ffc600f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:19.895418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea088d7-ec47-4f3d-8cfb-e7da7ffc600f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:19.896850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea088d7-ec47-4f3d-8cfb-e7da7ffc600f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:19.915420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 312/637] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 26 18:08:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:19.916602 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd4ef7-e996-4d17-b933-2b71326053a3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.916898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd4ef7-e996-4d17-b933-2b71326053a3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.917206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9fd4ef7-e996-4d17-b933-2b71326053a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.920873 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:19.934311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f9fd4ef7-e996-4d17-b933-2b71326053a3 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:19.935514 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f9fd4ef7-e996-4d17-b933-2b71326053a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:19.967980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 326/638] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 437 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:08:19.967980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52e0db-762c-4415-b50e-af7bd6375e66 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:19.967980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52e0db-762c-4415-b50e-af7bd6375e66 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:19.967980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa52e0db-762c-4415-b50e-af7bd6375e66 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:19.967980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 327/639] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:19.967980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52e0db-762c-4415-b50e-af7bd6375e66 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:20.015225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 313/640] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:20.016493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9354a75-a170-4958-bba1-d16268902202 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:20.016788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9354a75-a170-4958-bba1-d16268902202 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:20.017298 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9354a75-a170-4958-bba1-d16268902202 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:20.033347 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d9354a75-a170-4958-bba1-d16268902202 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:20.034569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d9354a75-a170-4958-bba1-d16268902202 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:20.083731 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:20.094517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa52e0db-762c-4415-b50e-af7bd6375e66 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:20.113988 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 314/641] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:20 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:20.115026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9354a75-a170-4958-bba1-d16268902202 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:20.134472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5ee86-41ca-4b52-af44-cda698eb5794 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:20.135254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5ee86-41ca-4b52-af44-cda698eb5794 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:20.135617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5ee86-41ca-4b52-af44-cda698eb5794 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:20.135939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b5ee86-41ca-4b52-af44-cda698eb5794 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:20.171056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:20.210958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5ee86-41ca-4b52-af44-cda698eb5794 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:20.212551 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1b5ee86-41ca-4b52-af44-cda698eb5794 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:20.231159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9354a75-a170-4958-bba1-d16268902202 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:20.269674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33734c9-b67e-4752-91bc-9afff4e3b9ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:20.270499 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33734c9-b67e-4752-91bc-9afff4e3b9ec None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:20.270782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33734c9-b67e-4752-91bc-9afff4e3b9ec None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:20.271234 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a33734c9-b67e-4752-91bc-9afff4e3b9ec None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:20.282690 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33734c9-b67e-4752-91bc-9afff4e3b9ec None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:20.284135 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a33734c9-b67e-4752-91bc-9afff4e3b9ec None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-a33734c9-b67e-4752-91bc-9afff4e3b9ec None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:20.303467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:20.304353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:20.305258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:20.305258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:20.305258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:20.305258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:20.305258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 315/642] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:20.306169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33734c9-b67e-4752-91bc-9afff4e3b9ec None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:20.317715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 328/643] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:08:20.319551 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5ee86-41ca-4b52-af44-cda698eb5794 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:20.337672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:20.383580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:20.412003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a33734c9-b67e-4752-91bc-9afff4e3b9ec None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:20.425222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b5ee86-41ca-4b52-af44-cda698eb5794 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:20.446722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5048ca-9d8e-457f-a602-1254eec3a201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:20.447561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5048ca-9d8e-457f-a602-1254eec3a201 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:20.447844 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5048ca-9d8e-457f-a602-1254eec3a201 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:20.448112 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b5048ca-9d8e-457f-a602-1254eec3a201 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:20.458837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b5048ca-9d8e-457f-a602-1254eec3a201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:20.462455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d6203-bef3-4848-8ee4-a76eab74fd9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:20.463351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d6203-bef3-4848-8ee4-a76eab74fd9f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:20.463733 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d6203-bef3-4848-8ee4-a76eab74fd9f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:20.464102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-970d6203-bef3-4848-8ee4-a76eab74fd9f None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5b5048ca-9d8e-457f-a602-1254eec3a201 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:20.467089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:20.468287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:20.469318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:20.469318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:20.469318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:20.469318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:20.469318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:20.469318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:20.469318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:20.469318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:20.469318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:20.469318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:20.469318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:20.469318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:20.473061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 316/644] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:20.473884 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5048ca-9d8e-457f-a602-1254eec3a201 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:20.478510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-970d6203-bef3-4848-8ee4-a76eab74fd9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-970d6203-bef3-4848-8ee4-a76eab74fd9f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:20.487182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:20.488266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:20.489381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:20.489381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:20.489381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:20.489381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:20.489381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:20.489381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:20.489381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:20.489381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:20.489381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:20.489381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:20.489381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:20.489381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:20.489381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 329/645] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:20.491230 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d6203-bef3-4848-8ee4-a76eab74fd9f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:20.576493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:20.590726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b5048ca-9d8e-457f-a602-1254eec3a201 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:20.603056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-970d6203-bef3-4848-8ee4-a76eab74fd9f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:20.627191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c153804-d678-4d66-8e74-b7edeb964261 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:20.627943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c153804-d678-4d66-8e74-b7edeb964261 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:20.628161 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c153804-d678-4d66-8e74-b7edeb964261 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:20.628405 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c153804-d678-4d66-8e74-b7edeb964261 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:20.629316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c153804-d678-4d66-8e74-b7edeb964261 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:20.629493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c153804-d678-4d66-8e74-b7edeb964261 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:20.629950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:20.630809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c153804-d678-4d66-8e74-b7edeb964261 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:20.642795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab74bbb-8c59-44f3-92c7-fa089929710f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:20.643590 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab74bbb-8c59-44f3-92c7-fa089929710f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:20.643871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab74bbb-8c59-44f3-92c7-fa089929710f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:20.644373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ab74bbb-8c59-44f3-92c7-fa089929710f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:20.644478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 317/646] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:20.645211 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c153804-d678-4d66-8e74-b7edeb964261 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:20.660284 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab74bbb-8c59-44f3-92c7-fa089929710f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:20.662153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ab74bbb-8c59-44f3-92c7-fa089929710f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8ab74bbb-8c59-44f3-92c7-fa089929710f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:20.679786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:20.680669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:20.681581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:20.681581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:20.681581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:20.681581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:20.681581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 330/647] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:20.681860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab74bbb-8c59-44f3-92c7-fa089929710f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:20.754816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c153804-d678-4d66-8e74-b7edeb964261 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:20.790812 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f545cae-ecea-49ea-acbe-febaf2b4c691 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:20.791572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f545cae-ecea-49ea-acbe-febaf2b4c691 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:20.791895 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f545cae-ecea-49ea-acbe-febaf2b4c691 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:20.792163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f545cae-ecea-49ea-acbe-febaf2b4c691 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:20.792898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f545cae-ecea-49ea-acbe-febaf2b4c691 None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:20.794025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f545cae-ecea-49ea-acbe-febaf2b4c691 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:20.795166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f545cae-ecea-49ea-acbe-febaf2b4c691 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:20.797098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ab74bbb-8c59-44f3-92c7-fa089929710f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:20.803641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 318/648] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:20.805200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f545cae-ecea-49ea-acbe-febaf2b4c691 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:20.818171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:20.835648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa39b7-fe8f-4eea-9d24-7c23ada7f86c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:20.836262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa39b7-fe8f-4eea-9d24-7c23ada7f86c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:20.836545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa39b7-fe8f-4eea-9d24-7c23ada7f86c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:20.836816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05aa39b7-fe8f-4eea-9d24-7c23ada7f86c None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:20.837589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa39b7-fe8f-4eea-9d24-7c23ada7f86c None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:20.837894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa39b7-fe8f-4eea-9d24-7c23ada7f86c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:20.839254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05aa39b7-fe8f-4eea-9d24-7c23ada7f86c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:20.848278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 331/649] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:20.848970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa39b7-fe8f-4eea-9d24-7c23ada7f86c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:20.889702 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:20.919653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f545cae-ecea-49ea-acbe-febaf2b4c691 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:20.956845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05aa39b7-fe8f-4eea-9d24-7c23ada7f86c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:20.961096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f5fb6-8479-43ff-8ae3-a8f67bdf5b93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:20.961917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f5fb6-8479-43ff-8ae3-a8f67bdf5b93 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:20.962204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f5fb6-8479-43ff-8ae3-a8f67bdf5b93 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:20.962485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a17f5fb6-8479-43ff-8ae3-a8f67bdf5b93 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:20.970933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f5fb6-8479-43ff-8ae3-a8f67bdf5b93 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:20.972414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a17f5fb6-8479-43ff-8ae3-a8f67bdf5b93 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-a17f5fb6-8479-43ff-8ae3-a8f67bdf5b93 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:20.988457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:20.989494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:20.990563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:20.990563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:20.990563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:20.990563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:20.990563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:20.990563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:20.990563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:20.990563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:20.994203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 319/650] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 190 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:20.994980 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f5fb6-8479-43ff-8ae3-a8f67bdf5b93 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:21.001213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfad744-952a-47fb-94c5-b6f636294ea6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:21.002085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfad744-952a-47fb-94c5-b6f636294ea6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:21.002510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfad744-952a-47fb-94c5-b6f636294ea6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:21.002936 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bfad744-952a-47fb-94c5-b6f636294ea6 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:21.004304 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfad744-952a-47fb-94c5-b6f636294ea6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:21.004813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfad744-952a-47fb-94c5-b6f636294ea6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:21.006809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bfad744-952a-47fb-94c5-b6f636294ea6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:21.020297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 332/651] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:21.021112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfad744-952a-47fb-94c5-b6f636294ea6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:21.068410 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:21.101794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a17f5fb6-8479-43ff-8ae3-a8f67bdf5b93 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:21.133492 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:21.138910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bfad744-952a-47fb-94c5-b6f636294ea6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:21.139787 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707bece-615e-4ecf-a2a4-133f9c9586a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:21.141023 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707bece-615e-4ecf-a2a4-133f9c9586a3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:21.141476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707bece-615e-4ecf-a2a4-133f9c9586a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:21.141748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6707bece-615e-4ecf-a2a4-133f9c9586a3 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:21.152338 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707bece-615e-4ecf-a2a4-133f9c9586a3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:21.154402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6707bece-615e-4ecf-a2a4-133f9c9586a3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-6707bece-615e-4ecf-a2a4-133f9c9586a3 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:21.171491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:21.172386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:21.173292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:21.173292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:21.173292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:21.173292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:21.173292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 320/652] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:21.173572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707bece-615e-4ecf-a2a4-133f9c9586a3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:21.178303 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ba1f0-0e95-4ed5-9e7b-1e271b9c1adb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:21.178303 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ba1f0-0e95-4ed5-9e7b-1e271b9c1adb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:21.178303 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ba1f0-0e95-4ed5-9e7b-1e271b9c1adb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:21.178303 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d4ba1f0-0e95-4ed5-9e7b-1e271b9c1adb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:21.188425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ba1f0-0e95-4ed5-9e7b-1e271b9c1adb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:21.189883 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d4ba1f0-0e95-4ed5-9e7b-1e271b9c1adb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3d4ba1f0-0e95-4ed5-9e7b-1e271b9c1adb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:21.207280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:21.208298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:21.209203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:21.209203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:21.209203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:21.209203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:21.209203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 333/653] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:21.209612 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ba1f0-0e95-4ed5-9e7b-1e271b9c1adb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:21.282451 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6707bece-615e-4ecf-a2a4-133f9c9586a3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:21.304733 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:21.307296 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d4ba1f0-0e95-4ed5-9e7b-1e271b9c1adb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:21.316726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf0a4ded-0131-4b5a-97f2-bcfac9f467dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:21.317416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a4ded-0131-4b5a-97f2-bcfac9f467dd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:21.317704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a4ded-0131-4b5a-97f2-bcfac9f467dd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:21.317985 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0a4ded-0131-4b5a-97f2-bcfac9f467dd None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:21.318765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a4ded-0131-4b5a-97f2-bcfac9f467dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:21.319078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a4ded-0131-4b5a-97f2-bcfac9f467dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:21.320537 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf0a4ded-0131-4b5a-97f2-bcfac9f467dd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:21.337142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 321/654] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:21.337142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93682f45-7aa1-43c2-98d4-2bd149bbd407 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:21.337142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93682f45-7aa1-43c2-98d4-2bd149bbd407 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:21.337142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93682f45-7aa1-43c2-98d4-2bd149bbd407 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:21.337142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 322/655] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:21 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:21.337142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93682f45-7aa1-43c2-98d4-2bd149bbd407 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:21.343256 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ad2fc-de7b-4247-8321-af12119dae37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:21.344090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ad2fc-de7b-4247-8321-af12119dae37 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:21.344367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ad2fc-de7b-4247-8321-af12119dae37 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:21.344642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f8ad2fc-de7b-4247-8321-af12119dae37 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:21.351413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ad2fc-de7b-4247-8321-af12119dae37 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:21.352893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f8ad2fc-de7b-4247-8321-af12119dae37 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8f8ad2fc-de7b-4247-8321-af12119dae37 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:21.366893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:21.367734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:21.368597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:21.368597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:21.368597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:21.368597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:21.368597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:21.368597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:21.368597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:21.368597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:21.368597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 334/656] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:21.369138 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ad2fc-de7b-4247-8321-af12119dae37 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:21.382252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:21.442802 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93682f45-7aa1-43c2-98d4-2bd149bbd407 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:21.469912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f8ad2fc-de7b-4247-8321-af12119dae37 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:21.481097 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c176b0-1558-4064-8732-29c413ebd94f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:21.482023 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c176b0-1558-4064-8732-29c413ebd94f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:21.482304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c176b0-1558-4064-8732-29c413ebd94f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:21.482579 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93c176b0-1558-4064-8732-29c413ebd94f None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:21.483286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c176b0-1558-4064-8732-29c413ebd94f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:21.483600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c176b0-1558-4064-8732-29c413ebd94f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:21.484950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93c176b0-1558-4064-8732-29c413ebd94f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:21.496909 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 323/657] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:21.497665 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c176b0-1558-4064-8732-29c413ebd94f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:21.507587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a86b3d6-c2bd-4ebc-9fb0-e2d7ae24256a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:21.508247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86b3d6-c2bd-4ebc-9fb0-e2d7ae24256a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:21.508529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86b3d6-c2bd-4ebc-9fb0-e2d7ae24256a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:21.508805 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a86b3d6-c2bd-4ebc-9fb0-e2d7ae24256a None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:21.509557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86b3d6-c2bd-4ebc-9fb0-e2d7ae24256a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:21.509863 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86b3d6-c2bd-4ebc-9fb0-e2d7ae24256a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:21.511221 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a86b3d6-c2bd-4ebc-9fb0-e2d7ae24256a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:21.523322 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 335/658] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:21.524480 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e7acd-09b6-4ae7-a55e-bc4ce0455f6d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:21.524767 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e7acd-09b6-4ae7-a55e-bc4ce0455f6d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:21.525078 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00e7acd-09b6-4ae7-a55e-bc4ce0455f6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:21.541324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b00e7acd-09b6-4ae7-a55e-bc4ce0455f6d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:21.542489 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b00e7acd-09b6-4ae7-a55e-bc4ce0455f6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:21.543134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:21.598435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93c176b0-1558-4064-8732-29c413ebd94f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:21.603034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:21.608280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 336/659] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:21 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:21.609103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e7acd-09b6-4ae7-a55e-bc4ce0455f6d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:21.633374 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a6df2-3a1c-4c4d-b167-85b4c0cd791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:21.634027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a6df2-3a1c-4c4d-b167-85b4c0cd791c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:21.634312 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a6df2-3a1c-4c4d-b167-85b4c0cd791c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:21.634590 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d14a6df2-3a1c-4c4d-b167-85b4c0cd791c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:21.635419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a6df2-3a1c-4c4d-b167-85b4c0cd791c None admin] RBAC: Adding query filter params (role.id=ec1445be03c942a98070dd9213fd0705, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=a2fbb5beba8a45a5b0a9b0beba0e0d63) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:21.635731 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a6df2-3a1c-4c4d-b167-85b4c0cd791c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:21.637737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d14a6df2-3a1c-4c4d-b167-85b4c0cd791c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:21.653077 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 324/660] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:21 2022] GET /identity/v3/role_assignments?user.id=a2fbb5beba8a45a5b0a9b0beba0e0d63&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=ec1445be03c942a98070dd9213fd0705 => generated 608 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:21.653077 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a6df2-3a1c-4c4d-b167-85b4c0cd791c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:21.717700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00e7acd-09b6-4ae7-a55e-bc4ce0455f6d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:21.755451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51826d-bfa8-4545-b116-103b54e5f722 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:21.755802 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d14a6df2-3a1c-4c4d-b167-85b4c0cd791c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:21.756125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51826d-bfa8-4545-b116-103b54e5f722 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:21.756408 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51826d-bfa8-4545-b116-103b54e5f722 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:21.756687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef51826d-bfa8-4545-b116-103b54e5f722 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:21.757517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51826d-bfa8-4545-b116-103b54e5f722 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:21.757827 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51826d-bfa8-4545-b116-103b54e5f722 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:21.759269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef51826d-bfa8-4545-b116-103b54e5f722 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:21.764540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:21.774102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 337/661] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:21.775351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51826d-bfa8-4545-b116-103b54e5f722 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:21.800012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056a804-94a0-4297-98a6-28de11002580 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:21.801025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056a804-94a0-4297-98a6-28de11002580 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:21.801429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056a804-94a0-4297-98a6-28de11002580 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:21.801718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d056a804-94a0-4297-98a6-28de11002580 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:21.811583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056a804-94a0-4297-98a6-28de11002580 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:21.813108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d056a804-94a0-4297-98a6-28de11002580 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-d056a804-94a0-4297-98a6-28de11002580 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:21.829688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:21.830674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:21.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:21.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:21.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:21.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:21.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:21.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:21.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:21.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:21.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 18:08:21.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:21.831580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 325/662] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:08:21 2022] GET /identity/v3/users/cinder => generated 84 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:21.832154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056a804-94a0-4297-98a6-28de11002580 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:21.852960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:21.900300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef51826d-bfa8-4545-b116-103b54e5f722 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:21.941741 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d056a804-94a0-4297-98a6-28de11002580 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:21.942115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eaf81-1566-4ccd-955d-e5ef01bd54a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:21.942913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eaf81-1566-4ccd-955d-e5ef01bd54a6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:21.943353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eaf81-1566-4ccd-955d-e5ef01bd54a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:21.943632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d1eaf81-1566-4ccd-955d-e5ef01bd54a6 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:21.953589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1eaf81-1566-4ccd-955d-e5ef01bd54a6 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:21.955173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d1eaf81-1566-4ccd-955d-e5ef01bd54a6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7d1eaf81-1566-4ccd-955d-e5ef01bd54a6 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:21.974180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:21.975127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:21.981940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:21.981940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:21.981940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:21.981940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:21.981940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:21.981940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:21.981940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:21.981940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:21.981940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. May 26 18:08:21.981940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:21.982487 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8f342-8ad1-4334-a2f4-a357359c87b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:21.982584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 338/663] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:21 2022] GET /identity/v3/users/neutron => generated 85 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:21.982655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8f342-8ad1-4334-a2f4-a357359c87b8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:21.982723 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eaf81-1566-4ccd-955d-e5ef01bd54a6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:21.982800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8f342-8ad1-4334-a2f4-a357359c87b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:21.982800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99a8f342-8ad1-4334-a2f4-a357359c87b8 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:21.989763 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99a8f342-8ad1-4334-a2f4-a357359c87b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-99a8f342-8ad1-4334-a2f4-a357359c87b8 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:21.998148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:21.999070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:21.999877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:21.999877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:21.999877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:21.999877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:21.999877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:21.999877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:21.999877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:21.999877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:21.999877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:21.999877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:21.999877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:21.999877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:21.999877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 326/664] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:21 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:22.001733 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8f342-8ad1-4334-a2f4-a357359c87b8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:22.027926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:22.096514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d1eaf81-1566-4ccd-955d-e5ef01bd54a6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:22.105143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99a8f342-8ad1-4334-a2f4-a357359c87b8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:22.124660 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:22.141093 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e1512-e709-4df4-8225-5c8369fd9310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:22.141760 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e1512-e709-4df4-8225-5c8369fd9310 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:22.142047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e1512-e709-4df4-8225-5c8369fd9310 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:22.142321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37e1512-e709-4df4-8225-5c8369fd9310 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:22.143146 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e1512-e709-4df4-8225-5c8369fd9310 None admin] RBAC: Adding query filter params (role.id=ec1445be03c942a98070dd9213fd0705, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=97f259ac2eb4425f8b4dcffeccdcd439) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:22.143457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e1512-e709-4df4-8225-5c8369fd9310 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:22.144880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37e1512-e709-4df4-8225-5c8369fd9310 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:22.145678 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5098b9f-c3b8-4493-ad9c-d749000b6436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:22.147144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5098b9f-c3b8-4493-ad9c-d749000b6436 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:22.147584 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5098b9f-c3b8-4493-ad9c-d749000b6436 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:22.148015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5098b9f-c3b8-4493-ad9c-d749000b6436 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:22.148888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5098b9f-c3b8-4493-ad9c-d749000b6436 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:22.149222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5098b9f-c3b8-4493-ad9c-d749000b6436 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:22.150798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5098b9f-c3b8-4493-ad9c-d749000b6436 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:22.151613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 339/665] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:21 2022] GET /identity/v3/role_assignments?user.id=97f259ac2eb4425f8b4dcffeccdcd439&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=ec1445be03c942a98070dd9213fd0705 => generated 608 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:22.152185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e1512-e709-4df4-8225-5c8369fd9310 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:22.182945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 327/666] 10.222.0.64 () {56 vars in 1137 bytes} [Thu May 26 18:08:21 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:22.184825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5098b9f-c3b8-4493-ad9c-d749000b6436 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:22.271551 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37e1512-e709-4df4-8225-5c8369fd9310 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:22.284541 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:22.302561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5098b9f-c3b8-4493-ad9c-d749000b6436 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:22.310281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f32b9-43b9-469c-95d4-d70e237f34af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:22.310962 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f32b9-43b9-469c-95d4-d70e237f34af None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:22.311241 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f32b9-43b9-469c-95d4-d70e237f34af None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:22.311515 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b53f32b9-43b9-469c-95d4-d70e237f34af None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:22.312355 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f32b9-43b9-469c-95d4-d70e237f34af None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:22.312663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f32b9-43b9-469c-95d4-d70e237f34af None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:22.314203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b53f32b9-43b9-469c-95d4-d70e237f34af None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:22.334239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 340/667] 10.222.0.64 () {56 vars in 1139 bytes} [Thu May 26 18:08:22 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:22.335101 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f32b9-43b9-469c-95d4-d70e237f34af None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:22.344164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48daac1-37d6-41ad-8d26-0c3a53489fa4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:22.345099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48daac1-37d6-41ad-8d26-0c3a53489fa4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:22.345523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48daac1-37d6-41ad-8d26-0c3a53489fa4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:22.345941 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f48daac1-37d6-41ad-8d26-0c3a53489fa4 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:22.346856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48daac1-37d6-41ad-8d26-0c3a53489fa4 None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:22.347307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48daac1-37d6-41ad-8d26-0c3a53489fa4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:22.348824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f48daac1-37d6-41ad-8d26-0c3a53489fa4 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:22.359440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 328/668] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:22 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:22.360465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48daac1-37d6-41ad-8d26-0c3a53489fa4 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:22.389141 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:22.466575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b53f32b9-43b9-469c-95d4-d70e237f34af None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:22.488287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f48daac1-37d6-41ad-8d26-0c3a53489fa4 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:22.510089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922dc7e-aa84-4738-9275-f50c7a330307 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:22.510845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922dc7e-aa84-4738-9275-f50c7a330307 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:22.511197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922dc7e-aa84-4738-9275-f50c7a330307 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:22.511563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0922dc7e-aa84-4738-9275-f50c7a330307 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:22.526658 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864134a-9ad2-4d27-be5b-fb639b71fd39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:22.528573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864134a-9ad2-4d27-be5b-fb639b71fd39 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:22.529345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864134a-9ad2-4d27-be5b-fb639b71fd39 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:22.529824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3864134a-9ad2-4d27-be5b-fb639b71fd39 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:22.554144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:22.600378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922dc7e-aa84-4738-9275-f50c7a330307 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:22.602418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0922dc7e-aa84-4738-9275-f50c7a330307 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:22.621612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864134a-9ad2-4d27-be5b-fb639b71fd39 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:22.623951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3864134a-9ad2-4d27-be5b-fb639b71fd39 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:22.659542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:22.740134 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 341/670] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:08:22.741291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922dc7e-aa84-4738-9275-f50c7a330307 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:22.741410 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 329/670] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:22 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:08:22.742203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864134a-9ad2-4d27-be5b-fb639b71fd39 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:22.794903 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:22.865810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3864134a-9ad2-4d27-be5b-fb639b71fd39 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:22.875063 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0922dc7e-aa84-4738-9275-f50c7a330307 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:22.908158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21540887-8999-40f9-ade8-0848028c8363 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:22.908969 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21540887-8999-40f9-ade8-0848028c8363 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:22.909407 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21540887-8999-40f9-ade8-0848028c8363 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:22.909817 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21540887-8999-40f9-ade8-0848028c8363 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:22.913784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f556f3-25fa-48db-8df6-94bb19fb94cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:22.914800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f556f3-25fa-48db-8df6-94bb19fb94cd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:22.915292 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f556f3-25fa-48db-8df6-94bb19fb94cd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:22.915770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f556f3-25fa-48db-8df6-94bb19fb94cd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:22.922359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21540887-8999-40f9-ade8-0848028c8363 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:22.924067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21540887-8999-40f9-ade8-0848028c8363 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:22.929784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f556f3-25fa-48db-8df6-94bb19fb94cd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:22.931403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f556f3-25fa-48db-8df6-94bb19fb94cd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:22.933618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-21540887-8999-40f9-ade8-0848028c8363 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:22.946361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:22.947268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:22.948154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:22.948154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:22.948154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:22.948154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-34f556f3-25fa-48db-8df6-94bb19fb94cd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:22.954475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:22.955327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:22.956185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:22.956185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:22.956185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:22.956185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:22.956185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 342/671] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:22.956185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f556f3-25fa-48db-8df6-94bb19fb94cd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:22.957173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 330/672] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:22.958467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21540887-8999-40f9-ade8-0848028c8363 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:23.061611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f556f3-25fa-48db-8df6-94bb19fb94cd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:23.087504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21540887-8999-40f9-ade8-0848028c8363 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:23.092945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:23.099841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b517f8a-6509-48ca-af93-a7bcdcd2bf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:23.100742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b517f8a-6509-48ca-af93-a7bcdcd2bf5c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.101073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b517f8a-6509-48ca-af93-a7bcdcd2bf5c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.101521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b517f8a-6509-48ca-af93-a7bcdcd2bf5c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.113313 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b517f8a-6509-48ca-af93-a7bcdcd2bf5c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:23.114767 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b517f8a-6509-48ca-af93-a7bcdcd2bf5c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:23.127576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50ee6f-d87e-4836-82b4-334ce052b614 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:23.128538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50ee6f-d87e-4836-82b4-334ce052b614 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.129052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50ee6f-d87e-4836-82b4-334ce052b614 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.129548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b50ee6f-d87e-4836-82b4-334ce052b614 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.130456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50ee6f-d87e-4836-82b4-334ce052b614 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:23.130961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50ee6f-d87e-4836-82b4-334ce052b614 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:23.132538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b50ee6f-d87e-4836-82b4-334ce052b614 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7b517f8a-6509-48ca-af93-a7bcdcd2bf5c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:23.133485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:23.134332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:23.135226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:23.135226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:23.135226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:23.135226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:23.139426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 343/673] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 184 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:23.140251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b517f8a-6509-48ca-af93-a7bcdcd2bf5c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:23.151005 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 331/674] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:23.153082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50ee6f-d87e-4836-82b4-334ce052b614 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:23.197802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:23.253716 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b517f8a-6509-48ca-af93-a7bcdcd2bf5c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:23.259034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b50ee6f-d87e-4836-82b4-334ce052b614 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:23.289721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3a147-cec8-41db-80ce-d14419da0bd4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:23.290465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3a147-cec8-41db-80ce-d14419da0bd4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.290665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3a147-cec8-41db-80ce-d14419da0bd4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.290942 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8f3a147-cec8-41db-80ce-d14419da0bd4 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.291715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3a147-cec8-41db-80ce-d14419da0bd4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:23.292127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3a147-cec8-41db-80ce-d14419da0bd4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:23.294267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8f3a147-cec8-41db-80ce-d14419da0bd4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:23.297062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e1d48-fb6d-47ca-8e27-191b9c5a6df2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:23.297946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e1d48-fb6d-47ca-8e27-191b9c5a6df2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.298451 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e1d48-fb6d-47ca-8e27-191b9c5a6df2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.298933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79e1d48-fb6d-47ca-8e27-191b9c5a6df2 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.299843 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e1d48-fb6d-47ca-8e27-191b9c5a6df2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:23.300507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e1d48-fb6d-47ca-8e27-191b9c5a6df2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:23.302178 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a79e1d48-fb6d-47ca-8e27-191b9c5a6df2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:23.310385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 344/675] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:23.310385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3a147-cec8-41db-80ce-d14419da0bd4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:23.318530 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 332/676] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:23.319583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e1d48-fb6d-47ca-8e27-191b9c5a6df2 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:23.344034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:23.426669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8f3a147-cec8-41db-80ce-d14419da0bd4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:23.431533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79e1d48-fb6d-47ca-8e27-191b9c5a6df2 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:23.434294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:23.467704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb20fb-25c1-4ccb-9a45-346be31db406 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:23.468720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467c941-fbe9-43de-9130-671c6b88e247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:23.469173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb20fb-25c1-4ccb-9a45-346be31db406 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.469562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467c941-fbe9-43de-9130-671c6b88e247 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.469847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467c941-fbe9-43de-9130-671c6b88e247 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.470075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb20fb-25c1-4ccb-9a45-346be31db406 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.470176 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2467c941-fbe9-43de-9130-671c6b88e247 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.470667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cb20fb-25c1-4ccb-9a45-346be31db406 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.477702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467c941-fbe9-43de-9130-671c6b88e247 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:23.478386 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb20fb-25c1-4ccb-9a45-346be31db406 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:23.479163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2467c941-fbe9-43de-9130-671c6b88e247 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:23.480255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cb20fb-25c1-4ccb-9a45-346be31db406 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-2467c941-fbe9-43de-9130-671c6b88e247 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:23.494544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:23.495523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:23.496517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:23.496517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:23.496517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:23.496517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:23.496517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:23.496517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:23.496517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:23.496517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:23.496517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 18:08:23.496517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-90cb20fb-25c1-4ccb-9a45-346be31db406 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:23.498437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:23.499266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:23.500149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:23.500149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:23.500149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:23.500149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:23.500149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:23.500149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:23.500149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:23.500149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:23.500569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 333/677] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:08:23 2022] GET /identity/v3/users/swift => generated 83 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:23.501232 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467c941-fbe9-43de-9130-671c6b88e247 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:23.503181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 345/678] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:23.504173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb20fb-25c1-4ccb-9a45-346be31db406 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:23.585256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:23.608638 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2467c941-fbe9-43de-9130-671c6b88e247 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:23.612692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cb20fb-25c1-4ccb-9a45-346be31db406 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:23.647817 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538dc4c-8076-4368-9f0e-ac626c8c79a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:23.648609 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538dc4c-8076-4368-9f0e-ac626c8c79a3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.648893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538dc4c-8076-4368-9f0e-ac626c8c79a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.649195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c538dc4c-8076-4368-9f0e-ac626c8c79a3 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.655304 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c95597-2fc0-429a-8343-6ff78afca39e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:23.656209 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95597-2fc0-429a-8343-6ff78afca39e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.656694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95597-2fc0-429a-8343-6ff78afca39e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.657214 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c95597-2fc0-429a-8343-6ff78afca39e None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.657929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538dc4c-8076-4368-9f0e-ac626c8c79a3 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:23.658473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c95597-2fc0-429a-8343-6ff78afca39e None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:23.659013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c95597-2fc0-429a-8343-6ff78afca39e None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:23.659388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c538dc4c-8076-4368-9f0e-ac626c8c79a3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:23.661197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c95597-2fc0-429a-8343-6ff78afca39e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-c538dc4c-8076-4368-9f0e-ac626c8c79a3 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:23.673070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:23.673994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:23.674893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:23.674893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:23.674893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:23.674893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:23.674893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:23.674893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:23.674893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:23.674893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:23.678889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 334/679] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:23.679713 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538dc4c-8076-4368-9f0e-ac626c8c79a3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:23.683959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 346/680] 10.222.0.64 () {56 vars in 1135 bytes} [Thu May 26 18:08:23 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:23.685089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c95597-2fc0-429a-8343-6ff78afca39e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:23.712607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:23.786849 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c538dc4c-8076-4368-9f0e-ac626c8c79a3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:23.799992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c95597-2fc0-429a-8343-6ff78afca39e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:23.825842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4dfcd-02b2-4bc9-9e0b-547ee2d6326f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:23.826515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4dfcd-02b2-4bc9-9e0b-547ee2d6326f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.827188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4dfcd-02b2-4bc9-9e0b-547ee2d6326f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.827188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36c4dfcd-02b2-4bc9-9e0b-547ee2d6326f None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.827893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4dfcd-02b2-4bc9-9e0b-547ee2d6326f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:23.828155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4dfcd-02b2-4bc9-9e0b-547ee2d6326f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:23.829642 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36c4dfcd-02b2-4bc9-9e0b-547ee2d6326f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:23.837231 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:23.842971 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 335/681] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:23.843868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4dfcd-02b2-4bc9-9e0b-547ee2d6326f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:23.846051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4513c11-d541-4dd7-b488-94a3765d2d55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:23.847503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4513c11-d541-4dd7-b488-94a3765d2d55 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.848171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4513c11-d541-4dd7-b488-94a3765d2d55 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.848654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4513c11-d541-4dd7-b488-94a3765d2d55 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.849692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4513c11-d541-4dd7-b488-94a3765d2d55 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:23.850223 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4513c11-d541-4dd7-b488-94a3765d2d55 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:23.852193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4513c11-d541-4dd7-b488-94a3765d2d55 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:23.871208 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 347/682] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:23 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:23.873181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4513c11-d541-4dd7-b488-94a3765d2d55 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:23.947716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36c4dfcd-02b2-4bc9-9e0b-547ee2d6326f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:23.971737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:23.983786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca1f9947-be88-4c5e-b33c-62b0787303e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:23.984386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f9947-be88-4c5e-b33c-62b0787303e2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:23.984672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f9947-be88-4c5e-b33c-62b0787303e2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:23.984948 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca1f9947-be88-4c5e-b33c-62b0787303e2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:23.993409 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4513c11-d541-4dd7-b488-94a3765d2d55 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:24.031319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7e29-c96a-4790-a097-29867d3c01cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:24.032251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7e29-c96a-4790-a097-29867d3c01cd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:24.032541 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7e29-c96a-4790-a097-29867d3c01cd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:24.032814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c9e7e29-c96a-4790-a097-29867d3c01cd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:24.033819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7e29-c96a-4790-a097-29867d3c01cd None admin] RBAC: Adding query filter params (role.id=ec1445be03c942a98070dd9213fd0705, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=0c09ffb276b84b2aa8735d6907a0de73) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:24.034521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7e29-c96a-4790-a097-29867d3c01cd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:24.036172 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c9e7e29-c96a-4790-a097-29867d3c01cd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:24.042029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 348/683] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:23 2022] GET /identity/v3/role_assignments?user.id=0c09ffb276b84b2aa8735d6907a0de73&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=ec1445be03c942a98070dd9213fd0705 => generated 608 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:24.042808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7e29-c96a-4790-a097-29867d3c01cd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:24.066970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:24.073832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f9947-be88-4c5e-b33c-62b0787303e2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:24.076832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca1f9947-be88-4c5e-b33c-62b0787303e2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:24.180487 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c9e7e29-c96a-4790-a097-29867d3c01cd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:24.221381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 336/684] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:23 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:08:24.223454 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e7ac0-e84a-4aee-9912-17830d86433a None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:24.223937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e7ac0-e84a-4aee-9912-17830d86433a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:24.224397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e17e7ac0-e84a-4aee-9912-17830d86433a None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:24.226439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 337/685] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:24.227335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e7ac0-e84a-4aee-9912-17830d86433a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:24.229855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-458e8042-cbbb-47a1-9409-d60b6b241e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:24.231339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e8042-cbbb-47a1-9409-d60b6b241e4d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:24.232075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e8042-cbbb-47a1-9409-d60b6b241e4d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:24.232418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-458e8042-cbbb-47a1-9409-d60b6b241e4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:24.233358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e8042-cbbb-47a1-9409-d60b6b241e4d None admin] RBAC: Adding query filter params (role.id=ec1445be03c942a98070dd9213fd0705, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=1b725c28490f4f90b5eec565cd0fb603) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:24.234392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e8042-cbbb-47a1-9409-d60b6b241e4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:24.235426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-458e8042-cbbb-47a1-9409-d60b6b241e4d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:24.249011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 349/686] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:24 2022] GET /identity/v3/role_assignments?user.id=1b725c28490f4f90b5eec565cd0fb603&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=ec1445be03c942a98070dd9213fd0705 => generated 608 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:24.249011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a71983-4fa8-45b6-bb5f-a3925a93e79d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:24.249011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a71983-4fa8-45b6-bb5f-a3925a93e79d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:24.249011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a71983-4fa8-45b6-bb5f-a3925a93e79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:24.267538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-66a71983-4fa8-45b6-bb5f-a3925a93e79d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:24.268758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-66a71983-4fa8-45b6-bb5f-a3925a93e79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:24.277444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:24.372229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 350/687] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:24.387573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:24.392695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e17e7ac0-e84a-4aee-9912-17830d86433a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:24.400390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a71983-4fa8-45b6-bb5f-a3925a93e79d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:24.444879 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab43a5-6aec-42ad-a60d-dc241c781454 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:24.447318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab43a5-6aec-42ad-a60d-dc241c781454 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:24.447867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab43a5-6aec-42ad-a60d-dc241c781454 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:24.448346 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ab43a5-6aec-42ad-a60d-dc241c781454 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:24.464380 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab43a5-6aec-42ad-a60d-dc241c781454 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:24.467034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ab43a5-6aec-42ad-a60d-dc241c781454 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-10ab43a5-6aec-42ad-a60d-dc241c781454 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:24.490813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:24.491764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:24.492628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:24.492628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:24.492628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:24.492628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:24.497178 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 338/688] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:24.498400 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab43a5-6aec-42ad-a60d-dc241c781454 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:24.539132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a71983-4fa8-45b6-bb5f-a3925a93e79d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:24.583762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e0a9be1-7638-4857-b0ac-0d0c85530ec0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:24.584585 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a9be1-7638-4857-b0ac-0d0c85530ec0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:24.584871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a9be1-7638-4857-b0ac-0d0c85530ec0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:24.585203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e0a9be1-7638-4857-b0ac-0d0c85530ec0 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:24.598211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a9be1-7638-4857-b0ac-0d0c85530ec0 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:24.599782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e0a9be1-7638-4857-b0ac-0d0c85530ec0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:24.601924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-1e0a9be1-7638-4857-b0ac-0d0c85530ec0 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:24.622373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:24.623375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:24.624224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:24.624224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:24.624224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:24.624224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:24.624224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 351/689] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:24.627124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f601497-81db-4621-b789-b6ab8f1939c4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:24.627124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f601497-81db-4621-b789-b6ab8f1939c4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:24.627124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f601497-81db-4621-b789-b6ab8f1939c4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:24.627599 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 352/690] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:24 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:24.633023 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc0823-62f0-4189-987b-fdd6f7b7fbe2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:24.633347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc0823-62f0-4189-987b-fdd6f7b7fbe2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:24.633591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18dc0823-62f0-4189-987b-fdd6f7b7fbe2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:24.652510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-18dc0823-62f0-4189-987b-fdd6f7b7fbe2 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:24.654246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-18dc0823-62f0-4189-987b-fdd6f7b7fbe2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:24.732120 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 353/691] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:08:24.733105 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc0823-62f0-4189-987b-fdd6f7b7fbe2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:24.767986 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ab43a5-6aec-42ad-a60d-dc241c781454 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:24.815361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e8124-48e4-4b66-b922-82577f54d7eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:24.816029 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8124-48e4-4b66-b922-82577f54d7eb None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:24.816311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8124-48e4-4b66-b922-82577f54d7eb None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:24.816581 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-216e8124-48e4-4b66-b922-82577f54d7eb None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:24.817334 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e8124-48e4-4b66-b922-82577f54d7eb None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:24.817642 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e8124-48e4-4b66-b922-82577f54d7eb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:24.819569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-216e8124-48e4-4b66-b922-82577f54d7eb None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:24.839050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 339/692] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 341 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:24.841395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e8124-48e4-4b66-b922-82577f54d7eb None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:24.859644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:24.866495 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18dc0823-62f0-4189-987b-fdd6f7b7fbe2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:24.898423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:24.913446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66649a0-382b-4197-b52f-d730e5810600 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:24.914048 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66649a0-382b-4197-b52f-d730e5810600 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:24.914338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66649a0-382b-4197-b52f-d730e5810600 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:24.915433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c66649a0-382b-4197-b52f-d730e5810600 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:24.916177 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66649a0-382b-4197-b52f-d730e5810600 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:24.916492 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66649a0-382b-4197-b52f-d730e5810600 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:24.917904 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c66649a0-382b-4197-b52f-d730e5810600 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:24.931644 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 354/693] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:24.932631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66649a0-382b-4197-b52f-d730e5810600 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:24.961804 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-216e8124-48e4-4b66-b922-82577f54d7eb None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.000683 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d592477-40d7-4738-a9ff-e65ce45918a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.001514 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592477-40d7-4738-a9ff-e65ce45918a5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.001895 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592477-40d7-4738-a9ff-e65ce45918a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.002211 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d592477-40d7-4738-a9ff-e65ce45918a5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.014127 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d592477-40d7-4738-a9ff-e65ce45918a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-0d592477-40d7-4738-a9ff-e65ce45918a5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:25.022870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:25.025072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:25.027009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:25.027009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:25.027009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:25.027009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:25.027009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:25.027009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:25.027009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:25.027009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:25.027009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:25.027009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:25.027009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:08:25.027009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:25.029143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 340/694] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:08:24 2022] GET /identity/v3/roles/admin => generated 83 bytes in 185 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:25.037010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d592477-40d7-4738-a9ff-e65ce45918a5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:25.039011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c66649a0-382b-4197-b52f-d730e5810600 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.076865 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29b60c-e4dc-435a-b8f4-224090c6e56a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.077698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29b60c-e4dc-435a-b8f4-224090c6e56a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.077985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29b60c-e4dc-435a-b8f4-224090c6e56a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.078374 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c29b60c-e4dc-435a-b8f4-224090c6e56a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.086270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29b60c-e4dc-435a-b8f4-224090c6e56a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:25.087751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c29b60c-e4dc-435a-b8f4-224090c6e56a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:25.104223 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8c29b60c-e4dc-435a-b8f4-224090c6e56a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:25.106616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:25.107750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:25.108900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:25.108900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:25.108900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:25.108900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:25.108900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:25.108900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:25.108900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:25.108900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:25.111817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 355/695] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:25.112954 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29b60c-e4dc-435a-b8f4-224090c6e56a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:25.145323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d592477-40d7-4738-a9ff-e65ce45918a5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.169514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:25.184529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db6fe0-a48c-4d54-b8df-ac27bbae9180 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.185277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db6fe0-a48c-4d54-b8df-ac27bbae9180 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.185519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db6fe0-a48c-4d54-b8df-ac27bbae9180 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.185793 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32db6fe0-a48c-4d54-b8df-ac27bbae9180 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.186554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db6fe0-a48c-4d54-b8df-ac27bbae9180 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:25.187930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32db6fe0-a48c-4d54-b8df-ac27bbae9180 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:25.211301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 341/696] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:08:25 2022] POST /identity/v3/users => generated 254 bytes in 181 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:25.212438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db6fe0-a48c-4d54-b8df-ac27bbae9180 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:25.240485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c29b60c-e4dc-435a-b8f4-224090c6e56a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.288941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7ab17-d11a-4563-9f1c-b078ff438087 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.289970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7ab17-d11a-4563-9f1c-b078ff438087 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.290501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7ab17-d11a-4563-9f1c-b078ff438087 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.291043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb7ab17-d11a-4563-9f1c-b078ff438087 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.292094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7ab17-d11a-4563-9f1c-b078ff438087 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:25.292635 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7ab17-d11a-4563-9f1c-b078ff438087 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:25.294454 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb7ab17-d11a-4563-9f1c-b078ff438087 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:25.321540 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 356/697] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:08:25 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:25.338604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7ab17-d11a-4563-9f1c-b078ff438087 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:25.370925 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32db6fe0-a48c-4d54-b8df-ac27bbae9180 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.416354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987a7cd-6286-4439-a686-d83bcb54a4b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.417064 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987a7cd-6286-4439-a686-d83bcb54a4b5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.417360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987a7cd-6286-4439-a686-d83bcb54a4b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.417644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f987a7cd-6286-4439-a686-d83bcb54a4b5 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.418550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987a7cd-6286-4439-a686-d83bcb54a4b5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:25.418873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987a7cd-6286-4439-a686-d83bcb54a4b5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:25.420513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f987a7cd-6286-4439-a686-d83bcb54a4b5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:25.434778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 342/698] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:25.435467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:25.440666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987a7cd-6286-4439-a686-d83bcb54a4b5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:25.534807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb7ab17-d11a-4563-9f1c-b078ff438087 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.543075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:25.568401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f987a7cd-6286-4439-a686-d83bcb54a4b5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.583961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df3325-9655-4576-afba-fdadf34f361b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.585206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df3325-9655-4576-afba-fdadf34f361b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.585637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df3325-9655-4576-afba-fdadf34f361b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.586058 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21df3325-9655-4576-afba-fdadf34f361b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.600085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df3325-9655-4576-afba-fdadf34f361b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:25.601954 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21df3325-9655-4576-afba-fdadf34f361b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:25.606615 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e442-f6f9-49b6-b96b-5f738eec2873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.607525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e442-f6f9-49b6-b96b-5f738eec2873 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.607805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e442-f6f9-49b6-b96b-5f738eec2873 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.608080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1608e442-f6f9-49b6-b96b-5f738eec2873 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.609014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608e442-f6f9-49b6-b96b-5f738eec2873 None admin] RBAC: Adding query filter params (role.id=ec1445be03c942a98070dd9213fd0705, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=9cb21a6eef0e418182b2dd755096ca77) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:25.609329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608e442-f6f9-49b6-b96b-5f738eec2873 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:25.610857 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1608e442-f6f9-49b6-b96b-5f738eec2873 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:25.617960 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 343/699] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:25 2022] GET /identity/v3/role_assignments?user.id=9cb21a6eef0e418182b2dd755096ca77&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=ec1445be03c942a98070dd9213fd0705 => generated 608 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-21df3325-9655-4576-afba-fdadf34f361b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:25.625270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:25.626390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:25.627533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:25.627533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:25.627533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:25.627533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:25.629586 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 357/700] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:25.635494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e442-f6f9-49b6-b96b-5f738eec2873 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:25.696297 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:25.764501 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1608e442-f6f9-49b6-b96b-5f738eec2873 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:25.814724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b81d8-f924-4f57-9ec7-2038168b3632 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:25.815415 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b81d8-f924-4f57-9ec7-2038168b3632 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:25.815700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b81d8-f924-4f57-9ec7-2038168b3632 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:25.815976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c9b81d8-f924-4f57-9ec7-2038168b3632 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:25.816703 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b81d8-f924-4f57-9ec7-2038168b3632 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:25.817023 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b81d8-f924-4f57-9ec7-2038168b3632 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:25.818391 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c9b81d8-f924-4f57-9ec7-2038168b3632 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:25.835162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 344/701] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:25.840872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df3325-9655-4576-afba-fdadf34f361b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:25.974446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21df3325-9655-4576-afba-fdadf34f361b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:26.010992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa190b4d-6a55-4c43-8080-6309a0e9a7a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:26.011784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190b4d-6a55-4c43-8080-6309a0e9a7a5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:26.012095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190b4d-6a55-4c43-8080-6309a0e9a7a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:26.012375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa190b4d-6a55-4c43-8080-6309a0e9a7a5 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:26.019703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa190b4d-6a55-4c43-8080-6309a0e9a7a5 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:26.021172 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa190b4d-6a55-4c43-8080-6309a0e9a7a5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-aa190b4d-6a55-4c43-8080-6309a0e9a7a5 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:26.036571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:26.037622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:26.038539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:26.038539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:26.038539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:26.038539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:26.038539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:26.038539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:26.038539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:26.038539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:26.038539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 18:08:26.038539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:26.038539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 358/702] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 26 18:08:25 2022] GET /identity/v3/users/nova => generated 82 bytes in 198 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:26.043397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b81d8-f924-4f57-9ec7-2038168b3632 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:26.176333 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c9b81d8-f924-4f57-9ec7-2038168b3632 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:26.198165 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:26.213685 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64079cd0-1836-47d0-81ae-e8ee3bed2550 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:26.214356 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079cd0-1836-47d0-81ae-e8ee3bed2550 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:26.214637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079cd0-1836-47d0-81ae-e8ee3bed2550 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:26.214911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64079cd0-1836-47d0-81ae-e8ee3bed2550 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:26.216258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64079cd0-1836-47d0-81ae-e8ee3bed2550 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:26.216567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64079cd0-1836-47d0-81ae-e8ee3bed2550 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:26.218043 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64079cd0-1836-47d0-81ae-e8ee3bed2550 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:26.241513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 345/703] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 26 18:08:26 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:26.246989 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa190b4d-6a55-4c43-8080-6309a0e9a7a5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:26.278434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:26.395950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa190b4d-6a55-4c43-8080-6309a0e9a7a5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:26.438016 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3abe3-3227-4485-8c14-669e24f0e872 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:26.438672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3abe3-3227-4485-8c14-669e24f0e872 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:26.438959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3abe3-3227-4485-8c14-669e24f0e872 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:26.439240 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b3abe3-3227-4485-8c14-669e24f0e872 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:26.523855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3abe3-3227-4485-8c14-669e24f0e872 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:26.525249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b3abe3-3227-4485-8c14-669e24f0e872 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:26.550431 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:26.647423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 359/704] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:08:26.654114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64079cd0-1836-47d0-81ae-e8ee3bed2550 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:26.762926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64079cd0-1836-47d0-81ae-e8ee3bed2550 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:26.799969 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98c8c753-0c7b-4b46-9341-85e79008adbc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:26.800678 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8c753-0c7b-4b46-9341-85e79008adbc None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:26.800956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8c753-0c7b-4b46-9341-85e79008adbc None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:26.801250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98c8c753-0c7b-4b46-9341-85e79008adbc None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:26.811782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8c753-0c7b-4b46-9341-85e79008adbc None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:26.813245 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98c8c753-0c7b-4b46-9341-85e79008adbc None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-98c8c753-0c7b-4b46-9341-85e79008adbc None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:26.830739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:26.831639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:26.832513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:26.832513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:26.832513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:26.832513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:26.832513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 346/705] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:26.838608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3abe3-3227-4485-8c14-669e24f0e872 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:26.862468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30401643-255d-4fa5-a529-7690a4b4b0e6 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:26.862768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30401643-255d-4fa5-a529-7690a4b4b0e6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:26.863024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30401643-255d-4fa5-a529-7690a4b4b0e6 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:26.864428 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 347/706] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:08:26.869377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace13f8a-0e5d-4c8b-a553-2e015a1cfe6a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:26.869660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace13f8a-0e5d-4c8b-a553-2e015a1cfe6a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:26.869935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace13f8a-0e5d-4c8b-a553-2e015a1cfe6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:26.900246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ace13f8a-0e5d-4c8b-a553-2e015a1cfe6a None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:26.901460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ace13f8a-0e5d-4c8b-a553-2e015a1cfe6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:26.941400 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:27.008446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b3abe3-3227-4485-8c14-669e24f0e872 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.024475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 348/707] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:08:27.025875 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644285b7-04fa-4b39-a3a6-750045ca7330 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.026222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644285b7-04fa-4b39-a3a6-750045ca7330 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.026506 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-644285b7-04fa-4b39-a3a6-750045ca7330 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.031123 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:27.032484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 349/708] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:27.033805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfe52-868a-4843-9850-35a748a335db None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.034097 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfe52-868a-4843-9850-35a748a335db None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.034375 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29fbfe52-868a-4843-9850-35a748a335db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.052642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d43b56-daf5-4a3b-ac66-d0222a8b1a68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.053535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43b56-daf5-4a3b-ac66-d0222a8b1a68 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.053982 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43b56-daf5-4a3b-ac66-d0222a8b1a68 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.054268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d43b56-daf5-4a3b-ac66-d0222a8b1a68 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.054997 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d43b56-daf5-4a3b-ac66-d0222a8b1a68 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:27.055350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d43b56-daf5-4a3b-ac66-d0222a8b1a68 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.056720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-29fbfe52-868a-4843-9850-35a748a335db None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:27.056841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6d43b56-daf5-4a3b-ac66-d0222a8b1a68 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.058061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-29fbfe52-868a-4843-9850-35a748a335db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:27.069550 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 360/709] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:27.070266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d43b56-daf5-4a3b-ac66-d0222a8b1a68 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.154024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 350/710] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) May 26 18:08:27.154024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbfe52-868a-4843-9850-35a748a335db None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.194675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6d43b56-daf5-4a3b-ac66-d0222a8b1a68 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.233121 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc47e80-6ff6-4e34-a1af-4854c936cd40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.233915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47e80-6ff6-4e34-a1af-4854c936cd40 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.234200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47e80-6ff6-4e34-a1af-4854c936cd40 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.234473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cc47e80-6ff6-4e34-a1af-4854c936cd40 None admin] PATH_INFO: `/v3/services/network` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.235128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc47e80-6ff6-4e34-a1af-4854c936cd40 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.236967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cc47e80-6ff6-4e34-a1af-4854c936cd40 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.242843 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4cc47e80-6ff6-4e34-a1af-4854c936cd40 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:27.256998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:27.258343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:27.259158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 361/711] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:27 2022] GET /identity/v3/services/network => generated 88 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:27.261291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc47e80-6ff6-4e34-a1af-4854c936cd40 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.270583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29fbfe52-868a-4843-9850-35a748a335db None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.314222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:27.320483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf61e8d-3203-4e3b-bbf1-d022241ca163 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.321869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf61e8d-3203-4e3b-bbf1-d022241ca163 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.322680 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf61e8d-3203-4e3b-bbf1-d022241ca163 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.323100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aaf61e8d-3203-4e3b-bbf1-d022241ca163 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.332105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf61e8d-3203-4e3b-bbf1-d022241ca163 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.334490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aaf61e8d-3203-4e3b-bbf1-d022241ca163 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-aaf61e8d-3203-4e3b-bbf1-d022241ca163 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:27.352444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:27.353568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:27.354659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:27.354659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:27.354659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:27.354659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:27.354659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:27.354659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:27.354659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:27.354659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:27.358762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 351/712] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:27 2022] GET /identity/v3/projects/service => generated 88 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:27.360222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf61e8d-3203-4e3b-bbf1-d022241ca163 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.383076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cc47e80-6ff6-4e34-a1af-4854c936cd40 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.420391 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b59a06-0095-4a85-ae26-fca30553c12d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.421445 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b59a06-0095-4a85-ae26-fca30553c12d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.421828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b59a06-0095-4a85-ae26-fca30553c12d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.422245 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5b59a06-0095-4a85-ae26-fca30553c12d None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.423004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b59a06-0095-4a85-ae26-fca30553c12d None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.424489 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5b59a06-0095-4a85-ae26-fca30553c12d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f5b59a06-0095-4a85-ae26-fca30553c12d None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:27.437762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:27.438872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 18:08:27.439889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:27.445390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 362/713] 10.222.0.64 () {56 vars in 1129 bytes} [Thu May 26 18:08:27 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:27.446366 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b59a06-0095-4a85-ae26-fca30553c12d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.491041 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aaf61e8d-3203-4e3b-bbf1-d022241ca163 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.527107 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53575b9e-000b-48fb-847b-6e2f2ceca17f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.528471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53575b9e-000b-48fb-847b-6e2f2ceca17f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.528618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53575b9e-000b-48fb-847b-6e2f2ceca17f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.528845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53575b9e-000b-48fb-847b-6e2f2ceca17f None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.529584 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53575b9e-000b-48fb-847b-6e2f2ceca17f None admin] RBAC: Adding query filter params (name=network) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:27.529948 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53575b9e-000b-48fb-847b-6e2f2ceca17f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.531383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53575b9e-000b-48fb-847b-6e2f2ceca17f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.536441 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 352/714] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 26 18:08:27 2022] GET /identity/v3/services?name=network => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:27.537377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53575b9e-000b-48fb-847b-6e2f2ceca17f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.542132 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:27.581667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5b59a06-0095-4a85-ae26-fca30553c12d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.589258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:27.620670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059cfe0-2471-4db9-ae94-e43cf71e772f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.621444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059cfe0-2471-4db9-ae94-e43cf71e772f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.621742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059cfe0-2471-4db9-ae94-e43cf71e772f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.622020 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8059cfe0-2471-4db9-ae94-e43cf71e772f None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.622850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059cfe0-2471-4db9-ae94-e43cf71e772f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:27.623226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059cfe0-2471-4db9-ae94-e43cf71e772f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.624671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8059cfe0-2471-4db9-ae94-e43cf71e772f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.638154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 363/715] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:27 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:27.639091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059cfe0-2471-4db9-ae94-e43cf71e772f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.675496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53575b9e-000b-48fb-847b-6e2f2ceca17f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.714939 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783c32a-13c7-4274-b43f-63053c9c6259 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.716572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783c32a-13c7-4274-b43f-63053c9c6259 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.717114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783c32a-13c7-4274-b43f-63053c9c6259 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.717631 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e783c32a-13c7-4274-b43f-63053c9c6259 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.718608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783c32a-13c7-4274-b43f-63053c9c6259 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:27.719121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783c32a-13c7-4274-b43f-63053c9c6259 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.720710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e783c32a-13c7-4274-b43f-63053c9c6259 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.725922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 353/716] 10.222.0.64 () {56 vars in 1124 bytes} [Thu May 26 18:08:27 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:27.727051 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783c32a-13c7-4274-b43f-63053c9c6259 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.762817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8059cfe0-2471-4db9-ae94-e43cf71e772f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.801696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:27.842146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e783c32a-13c7-4274-b43f-63053c9c6259 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:27.882833 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1d37c-b9bb-431a-998d-df1a0b207404 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.883525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1d37c-b9bb-431a-998d-df1a0b207404 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.883806 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1d37c-b9bb-431a-998d-df1a0b207404 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.884083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f1d37c-b9bb-431a-998d-df1a0b207404 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.884942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1d37c-b9bb-431a-998d-df1a0b207404 None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=97f259ac2eb4425f8b4dcffeccdcd439) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:27.885286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1d37c-b9bb-431a-998d-df1a0b207404 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.886803 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f1d37c-b9bb-431a-998d-df1a0b207404 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.894454 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 354/717] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:27 2022] GET /identity/v3/role_assignments?user.id=97f259ac2eb4425f8b4dcffeccdcd439&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 259 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:27.895449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1d37c-b9bb-431a-998d-df1a0b207404 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:27.931024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97ac7b82-ac57-4e9f-9e73-6b81f1cf9046 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:27.932085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac7b82-ac57-4e9f-9e73-6b81f1cf9046 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:27.932645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac7b82-ac57-4e9f-9e73-6b81f1cf9046 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:27.933160 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97ac7b82-ac57-4e9f-9e73-6b81f1cf9046 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:27.934509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac7b82-ac57-4e9f-9e73-6b81f1cf9046 None admin] RBAC: Adding query filter params (type=network) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:27.935080 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac7b82-ac57-4e9f-9e73-6b81f1cf9046 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:27.936715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97ac7b82-ac57-4e9f-9e73-6b81f1cf9046 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:27.943995 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 364/718] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 26 18:08:27 2022] GET /identity/v3/services?type=network => generated 124 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:28.020426 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f1d37c-b9bb-431a-998d-df1a0b207404 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:28.064417 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:28.072191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1872c783-8c39-457a-9dc1-4c9354598fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:28.073324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872c783-8c39-457a-9dc1-4c9354598fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.073324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872c783-8c39-457a-9dc1-4c9354598fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.073483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1872c783-8c39-457a-9dc1-4c9354598fe5 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.074142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872c783-8c39-457a-9dc1-4c9354598fe5 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:28.074450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872c783-8c39-457a-9dc1-4c9354598fe5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:28.075900 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1872c783-8c39-457a-9dc1-4c9354598fe5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:28.082687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 355/719] 10.222.0.64 () {56 vars in 1124 bytes} [Thu May 26 18:08:27 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:28.127683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4535b-a460-4ff9-88a6-7cdf2645ae48 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.127965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4535b-a460-4ff9-88a6-7cdf2645ae48 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.128250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf4535b-a460-4ff9-88a6-7cdf2645ae48 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.130033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 365/720] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:28.136002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d550f45-8013-4bb6-8772-e8920f44bf6b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.136636 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d550f45-8013-4bb6-8772-e8920f44bf6b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.137168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d550f45-8013-4bb6-8772-e8920f44bf6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.165287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9d550f45-8013-4bb6-8772-e8920f44bf6b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:28.166553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9d550f45-8013-4bb6-8772-e8920f44bf6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:28.253795 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 356/721] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:28.277334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4535b-a460-4ff9-88a6-7cdf2645ae48 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:28.311654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:28.392474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf4535b-a460-4ff9-88a6-7cdf2645ae48 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:28.430066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55da2f-f89e-41cc-8e12-faab57ed5738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:28.431248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55da2f-f89e-41cc-8e12-faab57ed5738 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.431735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55da2f-f89e-41cc-8e12-faab57ed5738 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.432212 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e55da2f-f89e-41cc-8e12-faab57ed5738 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.445567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e55da2f-f89e-41cc-8e12-faab57ed5738 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5e55da2f-f89e-41cc-8e12-faab57ed5738 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:28.454320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:28.455337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:28.456201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:28.456201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:28.456201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:28.456201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:28.456201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:28.456201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:28.456201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:28.456201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:28.456201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:28.456201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:28.456201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:28.456201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:28.459101 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 366/722] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:28 2022] GET /identity/v3/roles/service => generated 85 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:28.464605 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d550f45-8013-4bb6-8772-e8920f44bf6b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:28.572920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d550f45-8013-4bb6-8772-e8920f44bf6b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:28.600076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:28.615380 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea725d34-1d0c-464b-bdd8-430becd7b1dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:28.616060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea725d34-1d0c-464b-bdd8-430becd7b1dc None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.616349 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea725d34-1d0c-464b-bdd8-430becd7b1dc None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.616629 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea725d34-1d0c-464b-bdd8-430becd7b1dc None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.617408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea725d34-1d0c-464b-bdd8-430becd7b1dc None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:28.617723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea725d34-1d0c-464b-bdd8-430becd7b1dc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:28.619099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea725d34-1d0c-464b-bdd8-430becd7b1dc None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:28.628134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 357/723] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:28 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:28.633178 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55da2f-f89e-41cc-8e12-faab57ed5738 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:28.743508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678ceef-4b48-4cf2-b6e4-cbe72a9a2725 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.743508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678ceef-4b48-4cf2-b6e4-cbe72a9a2725 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.744065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c678ceef-4b48-4cf2-b6e4-cbe72a9a2725 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.746634 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 358/724] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:28.750683 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ac6c5-8dc4-41e7-8fa2-dfd04770b581 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.750968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ac6c5-8dc4-41e7-8fa2-dfd04770b581 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.751253 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a2ac6c5-8dc4-41e7-8fa2-dfd04770b581 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.759465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:28.770703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e55da2f-f89e-41cc-8e12-faab57ed5738 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:28.802057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8a2ac6c5-8dc4-41e7-8fa2-dfd04770b581 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:28.803268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8a2ac6c5-8dc4-41e7-8fa2-dfd04770b581 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:28.806800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ee124-a51c-4b06-b844-b215a1b11170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:28.807837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ee124-a51c-4b06-b844-b215a1b11170 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:28.808321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ee124-a51c-4b06-b844-b215a1b11170 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:28.808794 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-709ee124-a51c-4b06-b844-b215a1b11170 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:28.819993 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ee124-a51c-4b06-b844-b215a1b11170 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:28.821790 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-709ee124-a51c-4b06-b844-b215a1b11170 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-709ee124-a51c-4b06-b844-b215a1b11170 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:28.841373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:28.842353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:28.843217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:28.843217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:28.843217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:28.843217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:28.845660 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 367/725] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:28.850605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ee124-a51c-4b06-b844-b215a1b11170 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:28.914912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 359/726] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:28.938334 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ac6c5-8dc4-41e7-8fa2-dfd04770b581 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:29.075554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a2ac6c5-8dc4-41e7-8fa2-dfd04770b581 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:29.083887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-709ee124-a51c-4b06-b844-b215a1b11170 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:29.111142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:29.146125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f694377-e237-4b49-a16b-f8603d768f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:29.146920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f694377-e237-4b49-a16b-f8603d768f45 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:29.147212 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f694377-e237-4b49-a16b-f8603d768f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:29.147489 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f694377-e237-4b49-a16b-f8603d768f45 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:29.152202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ba9d7-672c-4d40-89d2-6d4c055f7012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:29.152902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ba9d7-672c-4d40-89d2-6d4c055f7012 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:29.153218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ba9d7-672c-4d40-89d2-6d4c055f7012 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:29.153558 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-653ba9d7-672c-4d40-89d2-6d4c055f7012 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:29.154285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ba9d7-672c-4d40-89d2-6d4c055f7012 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:29.156621 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ba9d7-672c-4d40-89d2-6d4c055f7012 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:29.158011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-653ba9d7-672c-4d40-89d2-6d4c055f7012 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:29.170328 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f694377-e237-4b49-a16b-f8603d768f45 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5f694377-e237-4b49-a16b-f8603d768f45 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:29.182050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:29.183003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:29.183852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:29.183852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:29.183852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:29.183852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:29.183852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:29.183852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:29.183852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:29.183852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:29.183852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:29.183852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:29.183852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:08:29.183852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:29.186923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 368/728] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:29.187035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 360/728] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:08:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:29.190131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f694377-e237-4b49-a16b-f8603d768f45 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:29.192215 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ba9d7-672c-4d40-89d2-6d4c055f7012 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:29.196934 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:29.343759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-653ba9d7-672c-4d40-89d2-6d4c055f7012 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:29.391807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d79aa-8457-42f4-a64a-6a9207422c7f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:29.392910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d79aa-8457-42f4-a64a-6a9207422c7f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:29.393419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d79aa-8457-42f4-a64a-6a9207422c7f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:29.394860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784d79aa-8457-42f4-a64a-6a9207422c7f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:29.401825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f694377-e237-4b49-a16b-f8603d768f45 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:29.411405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d79aa-8457-42f4-a64a-6a9207422c7f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:29.413000 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-784d79aa-8457-42f4-a64a-6a9207422c7f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:29.440927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c60bd-6cf0-4876-9ccc-acab127f7b73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:29.442021 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c60bd-6cf0-4876-9ccc-acab127f7b73 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-784d79aa-8457-42f4-a64a-6a9207422c7f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:29.442345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:29.443248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:29.444563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:29.444563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:29.444563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:29.444563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:29.444563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:29.444563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:29.444563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:29.444563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:29.444563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 18:08:29.444563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:29.444563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 369/729] 10.222.0.64 () {56 vars in 1117 bytes} [Thu May 26 18:08:29 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 252 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:29.446018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c60bd-6cf0-4876-9ccc-acab127f7b73 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:29.446573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9c60bd-6cf0-4876-9ccc-acab127f7b73 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:29.447602 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c60bd-6cf0-4876-9ccc-acab127f7b73 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:29.448300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c60bd-6cf0-4876-9ccc-acab127f7b73 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:29.449268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d79aa-8457-42f4-a64a-6a9207422c7f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:29.450306 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e9c60bd-6cf0-4876-9ccc-acab127f7b73 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:29.465515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 361/730] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:08:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:29.467214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c60bd-6cf0-4876-9ccc-acab127f7b73 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:29.525810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:29.545419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:29.570946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784d79aa-8457-42f4-a64a-6a9207422c7f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:29.628122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba509ed-4edf-4507-b135-af344c92b98c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:29.628806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba509ed-4edf-4507-b135-af344c92b98c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:29.629111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba509ed-4edf-4507-b135-af344c92b98c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:29.629388 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba509ed-4edf-4507-b135-af344c92b98c None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:29.630227 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba509ed-4edf-4507-b135-af344c92b98c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:29.630534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba509ed-4edf-4507-b135-af344c92b98c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:29.631947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba509ed-4edf-4507-b135-af344c92b98c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:29.662729 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 370/731] 10.222.0.64 () {56 vars in 1149 bytes} [Thu May 26 18:08:29 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:29.670131 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba509ed-4edf-4507-b135-af344c92b98c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:29.675813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9c60bd-6cf0-4876-9ccc-acab127f7b73 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:29.710459 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2cac5-485f-477a-bf5a-41841f8f5b02 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:29.711646 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2cac5-485f-477a-bf5a-41841f8f5b02 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:29.712133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2cac5-485f-477a-bf5a-41841f8f5b02 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:29.712645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8a2cac5-485f-477a-bf5a-41841f8f5b02 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:29.726073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2cac5-485f-477a-bf5a-41841f8f5b02 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:29.727798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8a2cac5-485f-477a-bf5a-41841f8f5b02 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-e8a2cac5-485f-477a-bf5a-41841f8f5b02 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:29.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:29.749302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:29.750162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:29.750162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:29.750162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:29.750162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:29.752861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 362/732] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:29.758017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2cac5-485f-477a-bf5a-41841f8f5b02 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:29.866922 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba509ed-4edf-4507-b135-af344c92b98c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:29.908373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:29.913764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:29.923824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8a2cac5-485f-477a-bf5a-41841f8f5b02 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:29.957722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3aebe-8645-42e5-8b8b-9d85c0678658 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:29.958403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3aebe-8645-42e5-8b8b-9d85c0678658 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:29.958694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3aebe-8645-42e5-8b8b-9d85c0678658 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:29.958982 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee3aebe-8645-42e5-8b8b-9d85c0678658 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:29.962004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e3609-84b4-4ef2-9c87-58505474918b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:29.962881 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3609-84b4-4ef2-9c87-58505474918b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:29.963370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3609-84b4-4ef2-9c87-58505474918b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:29.963915 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392e3609-84b4-4ef2-9c87-58505474918b None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:29.964827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e3609-84b4-4ef2-9c87-58505474918b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:29.966141 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e3609-84b4-4ef2-9c87-58505474918b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:29.968018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-392e3609-84b4-4ef2-9c87-58505474918b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:29.982796 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 363/733] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:29.990284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e3609-84b4-4ef2-9c87-58505474918b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:30.096934 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3aebe-8645-42e5-8b8b-9d85c0678658 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:30.098425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee3aebe-8645-42e5-8b8b-9d85c0678658 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:30.198912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-392e3609-84b4-4ef2-9c87-58505474918b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:30.265899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5299fee-7515-4547-95cc-d3bd17bf4752 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:30.266706 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299fee-7515-4547-95cc-d3bd17bf4752 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.266995 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299fee-7515-4547-95cc-d3bd17bf4752 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.267276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5299fee-7515-4547-95cc-d3bd17bf4752 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.280899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5299fee-7515-4547-95cc-d3bd17bf4752 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:30.282394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5299fee-7515-4547-95cc-d3bd17bf4752 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:30.300796 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 371/734] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 631 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:08:30.306009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3aebe-8645-42e5-8b8b-9d85c0678658 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-c5299fee-7515-4547-95cc-d3bd17bf4752 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:30.312340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:30.313303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:30.314197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:30.314197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:30.314197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:30.314197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:30.314197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:30.314197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:30.314197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:30.314197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:30.314197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 18:08:30.314197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:30.314197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 364/735] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:08:29 2022] GET /identity/v3/users/swift => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:30.320424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5299fee-7515-4547-95cc-d3bd17bf4752 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:30.353351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:30.355321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:30.516957 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5299fee-7515-4547-95cc-d3bd17bf4752 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:30.532580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee3aebe-8645-42e5-8b8b-9d85c0678658 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:30.552463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56e978-8933-46af-a776-ef35fcf308b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:30.553190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56e978-8933-46af-a776-ef35fcf308b5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.553481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56e978-8933-46af-a776-ef35fcf308b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.553760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe56e978-8933-46af-a776-ef35fcf308b5 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.554601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56e978-8933-46af-a776-ef35fcf308b5 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:30.554915 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56e978-8933-46af-a776-ef35fcf308b5 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:30.556355 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe56e978-8933-46af-a776-ef35fcf308b5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:30.574582 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 365/736] 10.222.0.64 () {56 vars in 1135 bytes} [Thu May 26 18:08:30 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:30.584042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56e978-8933-46af-a776-ef35fcf308b5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:30.590057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c47165-7324-432e-ae85-38a21f5674c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:30.591401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47165-7324-432e-ae85-38a21f5674c4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.591688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47165-7324-432e-ae85-38a21f5674c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.591967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c47165-7324-432e-ae85-38a21f5674c4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.602819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c47165-7324-432e-ae85-38a21f5674c4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:30.604273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c47165-7324-432e-ae85-38a21f5674c4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d2c47165-7324-432e-ae85-38a21f5674c4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:30.623876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:30.624809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:30.625734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:30.625734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:30.625734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:30.625734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:30.625734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 372/737] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:30.634324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b1262-aa31-433a-a8dc-007dcd8f8505 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.634324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b1262-aa31-433a-a8dc-007dcd8f8505 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.634324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761b1262-aa31-433a-a8dc-007dcd8f8505 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.634324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 373/738] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:30.634324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef030-fa17-4c29-be6d-94c9f7d13e3a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.634324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef030-fa17-4c29-be6d-94c9f7d13e3a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.634833 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4edef030-fa17-4c29-be6d-94c9f7d13e3a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.634833 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 374/739] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:30.634833 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edef030-fa17-4c29-be6d-94c9f7d13e3a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:30.671914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:30.709148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe56e978-8933-46af-a776-ef35fcf308b5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:30.712329 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:30.747194 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4edef030-fa17-4c29-be6d-94c9f7d13e3a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:30.748299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67a803-59b5-40fa-8b95-c4c8850f75be None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:30.749090 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a803-59b5-40fa-8b95-c4c8850f75be None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.749377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a803-59b5-40fa-8b95-c4c8850f75be None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.750447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b67a803-59b5-40fa-8b95-c4c8850f75be None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.783901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f361da2a-985e-4b63-a34d-fef665072973 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:30.784480 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361da2a-985e-4b63-a34d-fef665072973 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.784764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361da2a-985e-4b63-a34d-fef665072973 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.785065 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f361da2a-985e-4b63-a34d-fef665072973 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.785786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361da2a-985e-4b63-a34d-fef665072973 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:30.786095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361da2a-985e-4b63-a34d-fef665072973 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:30.787451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f361da2a-985e-4b63-a34d-fef665072973 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:30.804603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 375/740] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:30.804603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12816da7-f64b-4e37-bc7d-b18370a58023 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.804603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12816da7-f64b-4e37-bc7d-b18370a58023 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.804603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12816da7-f64b-4e37-bc7d-b18370a58023 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.819330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-12816da7-f64b-4e37-bc7d-b18370a58023 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:30.820496 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-12816da7-f64b-4e37-bc7d-b18370a58023 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:30.827973 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67a803-59b5-40fa-8b95-c4c8850f75be None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:30.829465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b67a803-59b5-40fa-8b95-c4c8850f75be None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:30.885323 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 376/741] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:30.886591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145ed8e-e83f-4ec8-9e3e-4bd7c1d63c58 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.886877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145ed8e-e83f-4ec8-9e3e-4bd7c1d63c58 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.887668 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7145ed8e-e83f-4ec8-9e3e-4bd7c1d63c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.901720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:30.903251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7145ed8e-e83f-4ec8-9e3e-4bd7c1d63c58 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:30.904438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7145ed8e-e83f-4ec8-9e3e-4bd7c1d63c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:30.936305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 366/742] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:30 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 348 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) May 26 18:08:30.936305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67a803-59b5-40fa-8b95-c4c8850f75be None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:30.960451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:30.971534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 377/743] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:30.972824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220aa68-e8b8-417c-9430-4d3fa1946004 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:30.973147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220aa68-e8b8-417c-9430-4d3fa1946004 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:30.973426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c220aa68-e8b8-417c-9430-4d3fa1946004 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:30.974673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 378/744] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:30.975344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220aa68-e8b8-417c-9430-4d3fa1946004 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.039219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b67a803-59b5-40fa-8b95-c4c8850f75be None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.071401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1d900-aaa0-4770-b3c3-946042e4e2ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.072184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1d900-aaa0-4770-b3c3-946042e4e2ea None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.072469 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1d900-aaa0-4770-b3c3-946042e4e2ea None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.072749 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a1d900-aaa0-4770-b3c3-946042e4e2ea None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.076865 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c220aa68-e8b8-417c-9430-4d3fa1946004 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.079927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1d900-aaa0-4770-b3c3-946042e4e2ea None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.081398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a1d900-aaa0-4770-b3c3-946042e4e2ea None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-14a1d900-aaa0-4770-b3c3-946042e4e2ea None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:31.095845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:31.096776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:31.097730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:31.097730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:31.097730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:31.097730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:31.097730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:31.097730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:31.097730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:31.097730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:31.097730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 367/745] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:30 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:31.098469 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1d900-aaa0-4770-b3c3-946042e4e2ea None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.114018 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b79dc1dd-2205-45b2-83ca-0c65579295ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.114680 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dc1dd-2205-45b2-83ca-0c65579295ff None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.114973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dc1dd-2205-45b2-83ca-0c65579295ff None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.115253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b79dc1dd-2205-45b2-83ca-0c65579295ff None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.115973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dc1dd-2205-45b2-83ca-0c65579295ff None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.117367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b79dc1dd-2205-45b2-83ca-0c65579295ff None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.128586 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:31.132566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 379/746] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 26 18:08:30 2022] POST /identity/v3/services => generated 251 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:31.133818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5451c8-c063-4aa6-8393-baf9154aa669 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.134108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5451c8-c063-4aa6-8393-baf9154aa669 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.134390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c5451c8-c063-4aa6-8393-baf9154aa669 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.154790 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7c5451c8-c063-4aa6-8393-baf9154aa669 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:31.156022 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7c5451c8-c063-4aa6-8393-baf9154aa669 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:31.212818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:31.219559 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a1d900-aaa0-4770-b3c3-946042e4e2ea None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.252948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 380/747] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:31 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) May 26 18:08:31.254330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5451c8-c063-4aa6-8393-baf9154aa669 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.274582 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908042df-6396-4e74-8333-3f9863057788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.276107 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908042df-6396-4e74-8333-3f9863057788 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.276597 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908042df-6396-4e74-8333-3f9863057788 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.277531 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-908042df-6396-4e74-8333-3f9863057788 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.290688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908042df-6396-4e74-8333-3f9863057788 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.292080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-908042df-6396-4e74-8333-3f9863057788 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-908042df-6396-4e74-8333-3f9863057788 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:31.310956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:31.312104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:31.312968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:31.312968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:31.312968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:31.312968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:31.312968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 368/748] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:31.312968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908042df-6396-4e74-8333-3f9863057788 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.374858 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c5451c8-c063-4aa6-8393-baf9154aa669 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.411249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadeb7f-4839-4e0c-a2cc-cb1550a5e83c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.412080 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadeb7f-4839-4e0c-a2cc-cb1550a5e83c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.412363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadeb7f-4839-4e0c-a2cc-cb1550a5e83c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.412638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcadeb7f-4839-4e0c-a2cc-cb1550a5e83c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.417285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:31.423723 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcadeb7f-4839-4e0c-a2cc-cb1550a5e83c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-fcadeb7f-4839-4e0c-a2cc-cb1550a5e83c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:31.431494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:31.432634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:31.433505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:31.433505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:31.433505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:31.433505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:31.433505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:31.433505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:31.433505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:31.433505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:31.433505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:31.433505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:31.433505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:08:31.433505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:31.433505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 381/749] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:08:31 2022] GET /identity/v3/roles/admin => generated 83 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:31.434834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadeb7f-4839-4e0c-a2cc-cb1550a5e83c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.443385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-908042df-6396-4e74-8333-3f9863057788 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.477985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:31.479920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1b5e6-e55e-4cb5-b636-c4ffa3417de1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.480588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1b5e6-e55e-4cb5-b636-c4ffa3417de1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.481019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1b5e6-e55e-4cb5-b636-c4ffa3417de1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.481722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f1b5e6-e55e-4cb5-b636-c4ffa3417de1 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.482906 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1b5e6-e55e-4cb5-b636-c4ffa3417de1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:31.483220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1b5e6-e55e-4cb5-b636-c4ffa3417de1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.484659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44f1b5e6-e55e-4cb5-b636-c4ffa3417de1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.502277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 369/750] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:31 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:31.503427 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1b5e6-e55e-4cb5-b636-c4ffa3417de1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.543983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcadeb7f-4839-4e0c-a2cc-cb1550a5e83c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.579157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e26b5-a207-4a14-85b3-ac17de558e60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.579823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e26b5-a207-4a14-85b3-ac17de558e60 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.580108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e26b5-a207-4a14-85b3-ac17de558e60 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.580386 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-510e26b5-a207-4a14-85b3-ac17de558e60 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.581148 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e26b5-a207-4a14-85b3-ac17de558e60 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.582513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-510e26b5-a207-4a14-85b3-ac17de558e60 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.609136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 382/751] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 26 18:08:31 2022] POST /identity/v3/services => generated 240 bytes in 165 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:31.609136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e26b5-a207-4a14-85b3-ac17de558e60 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.609433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f1b5e6-e55e-4cb5-b636-c4ffa3417de1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.666665 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a92c50-2819-4e82-b006-171c4303b45b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.668436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a92c50-2819-4e82-b006-171c4303b45b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.669268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a92c50-2819-4e82-b006-171c4303b45b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.669652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0a92c50-2819-4e82-b006-171c4303b45b None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.670432 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a92c50-2819-4e82-b006-171c4303b45b None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:31.670794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a92c50-2819-4e82-b006-171c4303b45b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.672250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0a92c50-2819-4e82-b006-171c4303b45b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.682721 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:31.692142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 370/752] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:31.693763 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a92c50-2819-4e82-b006-171c4303b45b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.760501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:31.766667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-510e26b5-a207-4a14-85b3-ac17de558e60 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.810480 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00624c-d200-44bb-bc94-f6728fe12a83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.810933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00624c-d200-44bb-bc94-f6728fe12a83 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.811039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00624c-d200-44bb-bc94-f6728fe12a83 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.811263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd00624c-d200-44bb-bc94-f6728fe12a83 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.813310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00624c-d200-44bb-bc94-f6728fe12a83 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:31.813310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00624c-d200-44bb-bc94-f6728fe12a83 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.814670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd00624c-d200-44bb-bc94-f6728fe12a83 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.822987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 383/753] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:08:31 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 223 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:31.823534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00624c-d200-44bb-bc94-f6728fe12a83 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.825744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0a92c50-2819-4e82-b006-171c4303b45b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:31.867032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177a37f-f0f8-4c95-9120-afd12f6497bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:31.867678 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177a37f-f0f8-4c95-9120-afd12f6497bf None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:31.868011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177a37f-f0f8-4c95-9120-afd12f6497bf None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:31.868290 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9177a37f-f0f8-4c95-9120-afd12f6497bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:31.869160 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177a37f-f0f8-4c95-9120-afd12f6497bf None admin] RBAC: Adding query filter params (role.id=ec1445be03c942a98070dd9213fd0705, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=438d065f5ec6446c824cdc4642c4ec06) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:31.869470 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177a37f-f0f8-4c95-9120-afd12f6497bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:31.870889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9177a37f-f0f8-4c95-9120-afd12f6497bf None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:31.878533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 371/754] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:31 2022] GET /identity/v3/role_assignments?user.id=438d065f5ec6446c824cdc4642c4ec06&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=ec1445be03c942a98070dd9213fd0705 => generated 259 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:31.879657 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177a37f-f0f8-4c95-9120-afd12f6497bf None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:31.979058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:31.999156 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd00624c-d200-44bb-bc94-f6728fe12a83 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:32.036422 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184d99d-efa4-4951-9088-f3d9704b990d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:32.037643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184d99d-efa4-4951-9088-f3d9704b990d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:32.038135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184d99d-efa4-4951-9088-f3d9704b990d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:32.038630 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d184d99d-efa4-4951-9088-f3d9704b990d None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:32.047151 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184d99d-efa4-4951-9088-f3d9704b990d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:32.049056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d184d99d-efa4-4951-9088-f3d9704b990d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d184d99d-efa4-4951-9088-f3d9704b990d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:32.064667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:32.065615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:32.066488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:32.066488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:32.066488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:32.066488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:32.066488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:32.066488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:32.066488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:32.066488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:32.067401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9177a37f-f0f8-4c95-9120-afd12f6497bf None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:32.069255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 384/755] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:32.074529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184d99d-efa4-4951-9088-f3d9704b990d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:32.101553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:32.174711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7285ae6-26a7-42fa-956f-a0cf149dc04c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:32.175628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285ae6-26a7-42fa-956f-a0cf149dc04c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:32.175911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285ae6-26a7-42fa-956f-a0cf149dc04c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:32.176186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7285ae6-26a7-42fa-956f-a0cf149dc04c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:32.204074 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7285ae6-26a7-42fa-956f-a0cf149dc04c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:32.205584 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7285ae6-26a7-42fa-956f-a0cf149dc04c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:32.212706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d184d99d-efa4-4951-9088-f3d9704b990d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-a7285ae6-26a7-42fa-956f-a0cf149dc04c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:32.242912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:32.243864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:32.244825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:32.244825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:32.244825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:32.244825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:32.244825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 372/756] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:32.251364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7285ae6-26a7-42fa-956f-a0cf149dc04c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:32.290997 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf279b-c8cd-41fc-8b12-7a60a0d5b34a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:32.291677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf279b-c8cd-41fc-8b12-7a60a0d5b34a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:32.292326 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf279b-c8cd-41fc-8b12-7a60a0d5b34a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:32.292602 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdf279b-c8cd-41fc-8b12-7a60a0d5b34a None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:32.293428 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf279b-c8cd-41fc-8b12-7a60a0d5b34a None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:32.294387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf279b-c8cd-41fc-8b12-7a60a0d5b34a None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:32.299686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fdf279b-c8cd-41fc-8b12-7a60a0d5b34a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:32.321513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 385/757] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:32.329286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf279b-c8cd-41fc-8b12-7a60a0d5b34a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:32.429695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7285ae6-26a7-42fa-956f-a0cf149dc04c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:32.460539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:32.475021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:32.500519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306b680-cd58-4f7b-a74e-642c4d2cec55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:32.501208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306b680-cd58-4f7b-a74e-642c4d2cec55 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:32.501490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306b680-cd58-4f7b-a74e-642c4d2cec55 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:32.501764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5306b680-cd58-4f7b-a74e-642c4d2cec55 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:32.502483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306b680-cd58-4f7b-a74e-642c4d2cec55 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:32.502787 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306b680-cd58-4f7b-a74e-642c4d2cec55 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:32.504148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5306b680-cd58-4f7b-a74e-642c4d2cec55 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:32.513776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdf279b-c8cd-41fc-8b12-7a60a0d5b34a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:32.526748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 373/758] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:32.538052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306b680-cd58-4f7b-a74e-642c4d2cec55 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:32.567785 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4d813-6e20-4f0b-b853-9bc997778b50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:32.568579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4d813-6e20-4f0b-b853-9bc997778b50 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:32.568866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4d813-6e20-4f0b-b853-9bc997778b50 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:32.569172 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f4d813-6e20-4f0b-b853-9bc997778b50 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:32.570002 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4d813-6e20-4f0b-b853-9bc997778b50 None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=9cb21a6eef0e418182b2dd755096ca77) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:32.570312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4d813-6e20-4f0b-b853-9bc997778b50 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:32.576021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f4d813-6e20-4f0b-b853-9bc997778b50 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:32.579098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 386/759] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:32 2022] GET /identity/v3/role_assignments?user.id=9cb21a6eef0e418182b2dd755096ca77&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:32.715433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5306b680-cd58-4f7b-a74e-642c4d2cec55 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:32.769679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065c283-5762-4740-83a2-ddd9fd9d831e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:32.770730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c283-5762-4740-83a2-ddd9fd9d831e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:32.771191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c283-5762-4740-83a2-ddd9fd9d831e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:32.771617 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4065c283-5762-4740-83a2-ddd9fd9d831e None admin] PATH_INFO: `/v3/users/nova` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:32.780010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065c283-5762-4740-83a2-ddd9fd9d831e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:32.781711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4065c283-5762-4740-83a2-ddd9fd9d831e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-4065c283-5762-4740-83a2-ddd9fd9d831e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:32.798726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:32.799937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:32.801153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:32.801153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:32.801153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:32.801153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:32.801153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:32.801153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:32.801153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:32.801153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:32.801153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 18:08:32.801153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:32.803403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 374/760] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 26 18:08:32 2022] GET /identity/v3/users/nova => generated 82 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:32.808836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4d813-6e20-4f0b-b853-9bc997778b50 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:32.933295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f4d813-6e20-4f0b-b853-9bc997778b50 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:32.978563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c26257-b636-4504-83b0-dd485ac62b5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:32.979529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c26257-b636-4504-83b0-dd485ac62b5f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:32.979960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c26257-b636-4504-83b0-dd485ac62b5f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:32.980381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c26257-b636-4504-83b0-dd485ac62b5f None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:32.981412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c26257-b636-4504-83b0-dd485ac62b5f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:32.981872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c26257-b636-4504-83b0-dd485ac62b5f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:32.983704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c26257-b636-4504-83b0-dd485ac62b5f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:33.007993 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 387/761] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 26 18:08:32 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:33.014155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065c283-5762-4740-83a2-ddd9fd9d831e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:33.070547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:33.166649 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4065c283-5762-4740-83a2-ddd9fd9d831e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:33.207672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459a79c-6de9-4161-b3c6-2d7153faa9eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:33.208688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459a79c-6de9-4161-b3c6-2d7153faa9eb None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:33.209147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459a79c-6de9-4161-b3c6-2d7153faa9eb None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:33.209564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6459a79c-6de9-4161-b3c6-2d7153faa9eb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:33.219803 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459a79c-6de9-4161-b3c6-2d7153faa9eb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:33.221454 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6459a79c-6de9-4161-b3c6-2d7153faa9eb None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-6459a79c-6de9-4161-b3c6-2d7153faa9eb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:33.239669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:33.240732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:33.241840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:33.241840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:33.241840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:33.241840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:33.243707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 375/762] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:33.249423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c26257-b636-4504-83b0-dd485ac62b5f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:33.265377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:33.383987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c26257-b636-4504-83b0-dd485ac62b5f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:33.435283 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59fe0039-3711-4666-99ca-6f91d42e4a37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:33.435947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0039-3711-4666-99ca-6f91d42e4a37 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:33.436225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0039-3711-4666-99ca-6f91d42e4a37 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:33.436496 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59fe0039-3711-4666-99ca-6f91d42e4a37 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:33.437300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe0039-3711-4666-99ca-6f91d42e4a37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:33.437607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe0039-3711-4666-99ca-6f91d42e4a37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:33.438955 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59fe0039-3711-4666-99ca-6f91d42e4a37 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:33.454325 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 388/763] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:33.459368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459a79c-6de9-4161-b3c6-2d7153faa9eb None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:33.591601 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03156e2a-e062-44ff-858b-d163eb6545c4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:33.592108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03156e2a-e062-44ff-858b-d163eb6545c4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:33.592185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03156e2a-e062-44ff-858b-d163eb6545c4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:33.593528 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 389/764] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:08:33.598325 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87bc82-056a-4562-84e7-4ff90e3032c8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:33.598608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87bc82-056a-4562-84e7-4ff90e3032c8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:33.598887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e87bc82-056a-4562-84e7-4ff90e3032c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:33.600543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:33.621627 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1e87bc82-056a-4562-84e7-4ff90e3032c8 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:33.622811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1e87bc82-056a-4562-84e7-4ff90e3032c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:33.630179 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6459a79c-6de9-4161-b3c6-2d7153faa9eb None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:33.687646 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084e6fa-6f4a-43d2-82e9-13a4c0783cd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:33.688443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084e6fa-6f4a-43d2-82e9-13a4c0783cd7 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:33.688721 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084e6fa-6f4a-43d2-82e9-13a4c0783cd7 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:33.689009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2084e6fa-6f4a-43d2-82e9-13a4c0783cd7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:33.703397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084e6fa-6f4a-43d2-82e9-13a4c0783cd7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:33.704838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2084e6fa-6f4a-43d2-82e9-13a4c0783cd7 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-2084e6fa-6f4a-43d2-82e9-13a4c0783cd7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:33.722702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:33.723583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:33.724463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:33.724463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:33.724463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:33.724463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:33.724463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:33.724463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:33.724463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:33.724463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:33.727591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 376/765] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:33.734435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084e6fa-6f4a-43d2-82e9-13a4c0783cd7 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:33.734995 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:33.750433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 390/766] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:33 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:33.771959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87bc82-056a-4562-84e7-4ff90e3032c8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:33.902382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2084e6fa-6f4a-43d2-82e9-13a4c0783cd7 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:33.940149 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4727577-9121-421a-9f7d-e4ebd9be41da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:33.940833 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727577-9121-421a-9f7d-e4ebd9be41da None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:33.941218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727577-9121-421a-9f7d-e4ebd9be41da None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:33.941683 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4727577-9121-421a-9f7d-e4ebd9be41da None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:33.944883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4727577-9121-421a-9f7d-e4ebd9be41da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:33.944883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4727577-9121-421a-9f7d-e4ebd9be41da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:33.945109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4727577-9121-421a-9f7d-e4ebd9be41da None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:33.960804 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 377/767] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:33.967588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4727577-9121-421a-9f7d-e4ebd9be41da None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:33.975213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e87bc82-056a-4562-84e7-4ff90e3032c8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:33.976363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:34.077711 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49d313-4db0-4190-9b96-ddd0c3c6a6a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:34.078543 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49d313-4db0-4190-9b96-ddd0c3c6a6a9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:34.078827 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49d313-4db0-4190-9b96-ddd0c3c6a6a9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:34.079099 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a49d313-4db0-4190-9b96-ddd0c3c6a6a9 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:34.079757 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49d313-4db0-4190-9b96-ddd0c3c6a6a9 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:34.080139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4727577-9121-421a-9f7d-e4ebd9be41da None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:34.081144 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a49d313-4db0-4190-9b96-ddd0c3c6a6a9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4a49d313-4db0-4190-9b96-ddd0c3c6a6a9 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:34.115703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:34.116684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 18:08:34.118232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:34.119382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b2af5-a4d2-4962-b3fb-face073da46a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:34.119474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 391/768] 10.222.0.64 () {56 vars in 1129 bytes} [Thu May 26 18:08:33 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 346 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:34.121945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b2af5-a4d2-4962-b3fb-face073da46a None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:34.122250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b2af5-a4d2-4962-b3fb-face073da46a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:34.122540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9b2af5-a4d2-4962-b3fb-face073da46a None admin] PATH_INFO: `/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/97f259ac2eb4425f8b4dcffeccdcd439/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:34.122721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49d313-4db0-4190-9b96-ddd0c3c6a6a9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:34.126355 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b2af5-a4d2-4962-b3fb-face073da46a None admin] RBAC: Authorizing `identity:create_grant(project_id=ab7fe8d932964e7ab1f442f26ef0735b, user_id=97f259ac2eb4425f8b4dcffeccdcd439, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:34.128014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9b2af5-a4d2-4962-b3fb-face073da46a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:34.160109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 378/769] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:08:33 2022] PUT /identity/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/97f259ac2eb4425f8b4dcffeccdcd439/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 193 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:34.221423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:34.253459 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a49d313-4db0-4190-9b96-ddd0c3c6a6a9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:34.291292 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fe3e3-615a-414b-a251-cf296c66c1c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:34.292205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fe3e3-615a-414b-a251-cf296c66c1c4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:34.292630 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fe3e3-615a-414b-a251-cf296c66c1c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:34.293102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a7fe3e3-615a-414b-a251-cf296c66c1c4 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:34.294025 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fe3e3-615a-414b-a251-cf296c66c1c4 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:34.294474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fe3e3-615a-414b-a251-cf296c66c1c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:34.295974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a7fe3e3-615a-414b-a251-cf296c66c1c4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:34.301382 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 392/770] 10.222.0.64 () {56 vars in 1124 bytes} [Thu May 26 18:08:34 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:34.308071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b2af5-a4d2-4962-b3fb-face073da46a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:34.442093 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:34.494049 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9b2af5-a4d2-4962-b3fb-face073da46a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:34.532123 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9910cc7b-11a3-4174-9810-52c03e56a417 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:34.532786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910cc7b-11a3-4174-9810-52c03e56a417 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:34.533158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910cc7b-11a3-4174-9810-52c03e56a417 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:34.533435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9910cc7b-11a3-4174-9810-52c03e56a417 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:34.534144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910cc7b-11a3-4174-9810-52c03e56a417 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:34.534450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910cc7b-11a3-4174-9810-52c03e56a417 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:34.535818 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9910cc7b-11a3-4174-9810-52c03e56a417 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:34.541449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 379/771] 10.222.0.64 () {56 vars in 1124 bytes} [Thu May 26 18:08:34 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:34.548089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fe3e3-615a-414b-a251-cf296c66c1c4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:34.554615 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f853140-d2a2-4548-bdc3-a211ecd6f17c None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:34.554911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f853140-d2a2-4548-bdc3-a211ecd6f17c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:34.555199 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f853140-d2a2-4548-bdc3-a211ecd6f17c None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:34.556820 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 380/772] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:34.562041 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb206a6-c586-4be5-ad67-6d2dfe26e8bd None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:34.562335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb206a6-c586-4be5-ad67-6d2dfe26e8bd None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:34.562622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abb206a6-c586-4be5-ad67-6d2dfe26e8bd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:34.581295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-abb206a6-c586-4be5-ad67-6d2dfe26e8bd None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:34.582494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-abb206a6-c586-4be5-ad67-6d2dfe26e8bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:34.685927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 381/773] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:08:34.687266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243d27-f4b9-4a69-a8c3-32cebbb48ae1 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:34.687561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243d27-f4b9-4a69-a8c3-32cebbb48ae1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:34.687842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b243d27-f4b9-4a69-a8c3-32cebbb48ae1 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:34.697348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 382/774] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:34 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:34.698967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a7fe3e3-615a-414b-a251-cf296c66c1c4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:34.714467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f345af0-cf1e-40fb-b967-3254cce4fbb4 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:34.714800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f345af0-cf1e-40fb-b967-3254cce4fbb4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:34.715027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f345af0-cf1e-40fb-b967-3254cce4fbb4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:34.724459 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:34.734718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8f345af0-cf1e-40fb-b967-3254cce4fbb4 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:34.735892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8f345af0-cf1e-40fb-b967-3254cce4fbb4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:34.743014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcca05d-3f62-4c70-972d-575c001c41c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:34.744614 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcca05d-3f62-4c70-972d-575c001c41c5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:34.745139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcca05d-3f62-4c70-972d-575c001c41c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:34.746132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dcca05d-3f62-4c70-972d-575c001c41c5 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:34.747558 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcca05d-3f62-4c70-972d-575c001c41c5 None admin] RBAC: Adding query filter params (interface=public, service_id=1f6541c21e2c442a81d128da985bf134, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:34.748112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcca05d-3f62-4c70-972d-575c001c41c5 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:34.750246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0dcca05d-3f62-4c70-972d-575c001c41c5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:34.761618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 393/775] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 26 18:08:34 2022] GET /identity/v3/endpoints?service_id=1f6541c21e2c442a81d128da985bf134&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:34.767476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcca05d-3f62-4c70-972d-575c001c41c5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:34.802339 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:34.816768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 383/776] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:34 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:08:34.818045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f345af0-cf1e-40fb-b967-3254cce4fbb4 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:34.898747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dcca05d-3f62-4c70-972d-575c001c41c5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:34.931298 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f345af0-cf1e-40fb-b967-3254cce4fbb4 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:34.940916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1d75c-0468-4387-bbfa-b0f05e939fe5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:34.942252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1d75c-0468-4387-bbfa-b0f05e939fe5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:34.942545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1d75c-0468-4387-bbfa-b0f05e939fe5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:34.942827 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fe1d75c-0468-4387-bbfa-b0f05e939fe5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:34.955841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fe1d75c-0468-4387-bbfa-b0f05e939fe5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0fe1d75c-0468-4387-bbfa-b0f05e939fe5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:34.966787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:34.967721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:34.968567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:34.968567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:34.968567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:34.968567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:34.968567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:34.968567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:34.968567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:34.968567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:34.968567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:34.968567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:34.968567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:34.968567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:34.972834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 394/777] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:34 2022] GET /identity/v3/roles/service => generated 85 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:34.973700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1d75c-0468-4387-bbfa-b0f05e939fe5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:34.975133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75c81b-e92c-4f35-a721-993242856ce4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:34.976047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c81b-e92c-4f35-a721-993242856ce4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:34.976530 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c81b-e92c-4f35-a721-993242856ce4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:34.977022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae75c81b-e92c-4f35-a721-993242856ce4 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:34.977899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75c81b-e92c-4f35-a721-993242856ce4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:34.979590 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae75c81b-e92c-4f35-a721-993242856ce4 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:34.986381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 384/778] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 26 18:08:34 2022] GET /identity/v3/services => generated 772 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:34.993099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75c81b-e92c-4f35-a721-993242856ce4 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:35.034006 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:35.094777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fe1d75c-0468-4387-bbfa-b0f05e939fe5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:35.135072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2d4fc86-0a92-4602-9fa2-e519730fe018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:35.135884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4fc86-0a92-4602-9fa2-e519730fe018 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:35.136170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4fc86-0a92-4602-9fa2-e519730fe018 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:35.136449 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2d4fc86-0a92-4602-9fa2-e519730fe018 None admin] PATH_INFO: `/v3/services/network` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:35.137175 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4fc86-0a92-4602-9fa2-e519730fe018 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:35.138836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2d4fc86-0a92-4602-9fa2-e519730fe018 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-b2d4fc86-0a92-4602-9fa2-e519730fe018 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:35.157638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:35.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:35.159567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:35.159567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:35.159567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:35.159567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:35.159567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:35.159567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:35.159567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:35.159567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:35.159567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:35.159567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:35.159567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:35.159567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:35.159567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 18:08:35.159567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:35.165424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 395/779] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:34 2022] GET /identity/v3/services/network => generated 88 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:35.166976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b61c1-0059-4a7f-8203-ab7e20041003 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:35.167268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b61c1-0059-4a7f-8203-ab7e20041003 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:35.167551 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c0b61c1-0059-4a7f-8203-ab7e20041003 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:35.175233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 396/780] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:35 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:35.176179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b61c1-0059-4a7f-8203-ab7e20041003 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:35.193378 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:35.289030 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae75c81b-e92c-4f35-a721-993242856ce4 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:35.326868 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c0b61c1-0059-4a7f-8203-ab7e20041003 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:35.341223 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:35.354334 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc17a1b1-8c3b-4556-9605-b83c56b4ec49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:35.355251 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17a1b1-8c3b-4556-9605-b83c56b4ec49 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:35.355914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17a1b1-8c3b-4556-9605-b83c56b4ec49 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:35.356816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc17a1b1-8c3b-4556-9605-b83c56b4ec49 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:35.357854 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17a1b1-8c3b-4556-9605-b83c56b4ec49 None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:35.358159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17a1b1-8c3b-4556-9605-b83c56b4ec49 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:35.360063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc17a1b1-8c3b-4556-9605-b83c56b4ec49 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:35.369258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 385/781] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:34 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:35.370542 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30852dff-8ae7-4a76-96ec-b0f7a31445df None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:35.370824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30852dff-8ae7-4a76-96ec-b0f7a31445df None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:35.371187 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30852dff-8ae7-4a76-96ec-b0f7a31445df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:35.394704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-30852dff-8ae7-4a76-96ec-b0f7a31445df None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:35.395427 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6fb83-b622-4bfd-9aa7-86abfb5d1d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:35.397301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6fb83-b622-4bfd-9aa7-86abfb5d1d39 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:35.397587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6fb83-b622-4bfd-9aa7-86abfb5d1d39 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:35.397863 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ab6fb83-b622-4bfd-9aa7-86abfb5d1d39 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:35.398506 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-30852dff-8ae7-4a76-96ec-b0f7a31445df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:35.400056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6fb83-b622-4bfd-9aa7-86abfb5d1d39 None admin] RBAC: Adding query filter params (name=network) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:35.400373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6fb83-b622-4bfd-9aa7-86abfb5d1d39 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:35.402488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ab6fb83-b622-4bfd-9aa7-86abfb5d1d39 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:35.409432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 397/782] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 26 18:08:35 2022] GET /identity/v3/services?name=network => generated 124 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:35.410228 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6fb83-b622-4bfd-9aa7-86abfb5d1d39 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:35.553015 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ab6fb83-b622-4bfd-9aa7-86abfb5d1d39 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:35.560911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 386/783] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:35 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:35.561911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30852dff-8ae7-4a76-96ec-b0f7a31445df None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:35.624018 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455a002-11dd-4e7e-a891-3d3e75f60f16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:35.624738 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455a002-11dd-4e7e-a891-3d3e75f60f16 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:35.625075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455a002-11dd-4e7e-a891-3d3e75f60f16 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:35.625357 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4455a002-11dd-4e7e-a891-3d3e75f60f16 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:35.627124 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:35.641886 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455a002-11dd-4e7e-a891-3d3e75f60f16 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:35.643812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4455a002-11dd-4e7e-a891-3d3e75f60f16 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:35.685918 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30852dff-8ae7-4a76-96ec-b0f7a31445df None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4455a002-11dd-4e7e-a891-3d3e75f60f16 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:35.688365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:35.689238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:35.690113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:35.690113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:35.690113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:35.690113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:35.694322 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 398/784] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:35.695554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455a002-11dd-4e7e-a891-3d3e75f60f16 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:35.726103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171442e-f9e8-49ec-8074-0b8005c6fd27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:35.727391 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171442e-f9e8-49ec-8074-0b8005c6fd27 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:35.727690 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171442e-f9e8-49ec-8074-0b8005c6fd27 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:35.727971 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6171442e-f9e8-49ec-8074-0b8005c6fd27 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:35.728709 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171442e-f9e8-49ec-8074-0b8005c6fd27 None admin] RBAC: Adding query filter params (type=network) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:35.729204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171442e-f9e8-49ec-8074-0b8005c6fd27 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:35.731114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6171442e-f9e8-49ec-8074-0b8005c6fd27 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:35.743057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 387/785] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 26 18:08:35 2022] GET /identity/v3/services?type=network => generated 350 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:35.743057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171442e-f9e8-49ec-8074-0b8005c6fd27 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:35.744518 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:35.823928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4455a002-11dd-4e7e-a891-3d3e75f60f16 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:35.855354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6171442e-f9e8-49ec-8074-0b8005c6fd27 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:35.861706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeac13-bf43-4dc0-aa40-e7db0ee779ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:35.862795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeac13-bf43-4dc0-aa40-e7db0ee779ea None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:35.863289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeac13-bf43-4dc0-aa40-e7db0ee779ea None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:35.863796 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8baeac13-bf43-4dc0-aa40-e7db0ee779ea None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:35.869536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:35.876379 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8baeac13-bf43-4dc0-aa40-e7db0ee779ea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8baeac13-bf43-4dc0-aa40-e7db0ee779ea None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:35.884373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:35.885751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:35.886553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:35.886553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:35.886553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:35.886553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:35.886553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:35.886553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:35.886553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:35.886553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:35.886553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:35.886553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:35.886553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:08:35.886553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:35.894997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b2a7-5b7c-412b-9efe-ddf64091093e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:35.895463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 399/786] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:08:35 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:35.895568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b2a7-5b7c-412b-9efe-ddf64091093e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:35.895760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b2a7-5b7c-412b-9efe-ddf64091093e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:35.896041 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa5b2a7-5b7c-412b-9efe-ddf64091093e None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:35.896776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5b2a7-5b7c-412b-9efe-ddf64091093e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:35.897118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5b2a7-5b7c-412b-9efe-ddf64091093e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:35.897438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeac13-bf43-4dc0-aa40-e7db0ee779ea None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:35.898613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa5b2a7-5b7c-412b-9efe-ddf64091093e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:35.911036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 388/787] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:35.911806 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b2a7-5b7c-412b-9efe-ddf64091093e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:35.987883 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:36.006153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8baeac13-bf43-4dc0-aa40-e7db0ee779ea None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:36.016976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa5b2a7-5b7c-412b-9efe-ddf64091093e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:36.043717 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec1a5-8ac2-4408-a8f0-e6d9e12c4759 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:36.044937 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec1a5-8ac2-4408-a8f0-e6d9e12c4759 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.045492 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec1a5-8ac2-4408-a8f0-e6d9e12c4759 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.045990 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07aec1a5-8ac2-4408-a8f0-e6d9e12c4759 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.047082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aec1a5-8ac2-4408-a8f0-e6d9e12c4759 None admin] RBAC: Adding query filter params (interface=public, service_id=473973cd281b439298983fed2c7e98b3, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:36.047609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aec1a5-8ac2-4408-a8f0-e6d9e12c4759 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:36.049332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07aec1a5-8ac2-4408-a8f0-e6d9e12c4759 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:36.052505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1618ecb-4965-44fd-b6c9-5867a4b86bf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:36.053223 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618ecb-4965-44fd-b6c9-5867a4b86bf6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.053515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618ecb-4965-44fd-b6c9-5867a4b86bf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.053835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1618ecb-4965-44fd-b6c9-5867a4b86bf6 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.054634 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1618ecb-4965-44fd-b6c9-5867a4b86bf6 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:36.054976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1618ecb-4965-44fd-b6c9-5867a4b86bf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:36.057019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1618ecb-4965-44fd-b6c9-5867a4b86bf6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:36.061374 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 400/788] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 26 18:08:35 2022] GET /identity/v3/endpoints?service_id=473973cd281b439298983fed2c7e98b3&interface=public®ion_id=RegionOne => generated 194 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:36.062557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec1a5-8ac2-4408-a8f0-e6d9e12c4759 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:36.070205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 389/789] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:08:35 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:36.071096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1618ecb-4965-44fd-b6c9-5867a4b86bf6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:36.103531 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:36.171685 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07aec1a5-8ac2-4408-a8f0-e6d9e12c4759 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:36.175610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1618ecb-4965-44fd-b6c9-5867a4b86bf6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:36.210058 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b91b-45fd-4c99-82e3-ef19b3861b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:36.211273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b91b-45fd-4c99-82e3-ef19b3861b97 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.211766 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b91b-45fd-4c99-82e3-ef19b3861b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.211878 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef5aac-c234-4508-9f1d-1035e8089dfe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:36.212553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef5aac-c234-4508-9f1d-1035e8089dfe None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.212844 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef5aac-c234-4508-9f1d-1035e8089dfe None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.213167 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caef5aac-c234-4508-9f1d-1035e8089dfe None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.213404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2455b91b-45fd-4c99-82e3-ef19b3861b97 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.213856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef5aac-c234-4508-9f1d-1035e8089dfe None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:36.215396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caef5aac-c234-4508-9f1d-1035e8089dfe None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:36.220941 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 390/790] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 26 18:08:36 2022] GET /identity/v3/services => generated 772 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:36.221789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef5aac-c234-4508-9f1d-1035e8089dfe None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:36.223777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455b91b-45fd-4c99-82e3-ef19b3861b97 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:36.226916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2455b91b-45fd-4c99-82e3-ef19b3861b97 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-2455b91b-45fd-4c99-82e3-ef19b3861b97 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:36.257815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:36.258820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:36.259732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:36.259732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:36.259732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:36.259732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:36.259732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:36.259732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:36.259732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:36.259732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:36.259732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 18:08:36.259732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:36.261984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 401/791] 10.222.0.64 () {56 vars in 1117 bytes} [Thu May 26 18:08:36 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:36.264698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b91b-45fd-4c99-82e3-ef19b3861b97 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:36.345402 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:36.410700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2455b91b-45fd-4c99-82e3-ef19b3861b97 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:36.454926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:36.461735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caef5aac-c234-4508-9f1d-1035e8089dfe None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:36.480592 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31c403-464b-4cad-8698-bb8638b21281 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:36.481892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31c403-464b-4cad-8698-bb8638b21281 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.482157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31c403-464b-4cad-8698-bb8638b21281 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.482432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c31c403-464b-4cad-8698-bb8638b21281 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.483536 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31c403-464b-4cad-8698-bb8638b21281 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:36.483850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31c403-464b-4cad-8698-bb8638b21281 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:36.487822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c31c403-464b-4cad-8698-bb8638b21281 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:36.509845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 402/792] 10.222.0.64 () {56 vars in 1149 bytes} [Thu May 26 18:08:36 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:36.512715 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957e954-7fb8-4f3a-b2f1-27c9cce22ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:36.513859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957e954-7fb8-4f3a-b2f1-27c9cce22ab2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.514299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957e954-7fb8-4f3a-b2f1-27c9cce22ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.514732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0957e954-7fb8-4f3a-b2f1-27c9cce22ab2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.515860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31c403-464b-4cad-8698-bb8638b21281 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:36.540026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957e954-7fb8-4f3a-b2f1-27c9cce22ab2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:36.541754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0957e954-7fb8-4f3a-b2f1-27c9cce22ab2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-0957e954-7fb8-4f3a-b2f1-27c9cce22ab2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:36.578215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:36.579177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:36.580068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:36.580068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:36.580068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:36.580068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:36.580068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 391/793] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:36.589702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957e954-7fb8-4f3a-b2f1-27c9cce22ab2 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:36.643263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:36.682174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c31c403-464b-4cad-8698-bb8638b21281 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:36.719631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece47d18-dbbb-4bf7-8d8c-ca3f5e626961 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:36.725007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece47d18-dbbb-4bf7-8d8c-ca3f5e626961 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.725007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece47d18-dbbb-4bf7-8d8c-ca3f5e626961 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.725007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece47d18-dbbb-4bf7-8d8c-ca3f5e626961 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.734666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece47d18-dbbb-4bf7-8d8c-ca3f5e626961 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:36.736349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece47d18-dbbb-4bf7-8d8c-ca3f5e626961 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ece47d18-dbbb-4bf7-8d8c-ca3f5e626961 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:36.767119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:36.768521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:36.769438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:36.769438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:36.769438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:36.769438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:36.769438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 403/794] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:36 2022] GET /identity/v3/domains/Default => generated 87 bytes in 253 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:36.770268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e8ce4-29c7-433c-b08b-9084b9733c3a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.770465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e8ce4-29c7-433c-b08b-9084b9733c3a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.773119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d6e8ce4-29c7-433c-b08b-9084b9733c3a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.773119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 404/795] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:36.773919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e8ce4-29c7-433c-b08b-9084b9733c3a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:36.789968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0957e954-7fb8-4f3a-b2f1-27c9cce22ab2 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:36.830556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad8df2cc-ad8f-426b-aa8b-9fde7c2b5f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:36.831313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df2cc-ad8f-426b-aa8b-9fde7c2b5f37 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.831661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df2cc-ad8f-426b-aa8b-9fde7c2b5f37 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.832006 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad8df2cc-ad8f-426b-aa8b-9fde7c2b5f37 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.832817 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8df2cc-ad8f-426b-aa8b-9fde7c2b5f37 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:36.833219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8df2cc-ad8f-426b-aa8b-9fde7c2b5f37 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:36.834651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad8df2cc-ad8f-426b-aa8b-9fde7c2b5f37 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:36.847250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 392/796] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:36.848583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009d8a0-ac2a-4191-a5e1-5636d701a657 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.848934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009d8a0-ac2a-4191-a5e1-5636d701a657 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.849305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8009d8a0-ac2a-4191-a5e1-5636d701a657 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.867792 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8009d8a0-ac2a-4191-a5e1-5636d701a657 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:36.869111 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8009d8a0-ac2a-4191-a5e1-5636d701a657 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:36.871312 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:36.925405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d6e8ce4-29c7-433c-b08b-9084b9733c3a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:36.949443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 393/797] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:36 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:36.949887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:36.950613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009d8a0-ac2a-4191-a5e1-5636d701a657 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:36.971205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01232e-7945-43df-991d-ebb6bd38efb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:36.972521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01232e-7945-43df-991d-ebb6bd38efb8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:36.972957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01232e-7945-43df-991d-ebb6bd38efb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:36.973415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba01232e-7945-43df-991d-ebb6bd38efb8 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:36.974474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01232e-7945-43df-991d-ebb6bd38efb8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:36.974932 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01232e-7945-43df-991d-ebb6bd38efb8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:36.976441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba01232e-7945-43df-991d-ebb6bd38efb8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:36.992179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 405/798] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:36.998305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01232e-7945-43df-991d-ebb6bd38efb8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.087976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8009d8a0-ac2a-4191-a5e1-5636d701a657 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.115841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba01232e-7945-43df-991d-ebb6bd38efb8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.134306 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29808046-0358-4cbc-b4f8-4110e1c240ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.135354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29808046-0358-4cbc-b4f8-4110e1c240ec None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.135792 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29808046-0358-4cbc-b4f8-4110e1c240ec None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.136245 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29808046-0358-4cbc-b4f8-4110e1c240ec None admin] PATH_INFO: `/v3/users/swift` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.146728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29808046-0358-4cbc-b4f8-4110e1c240ec None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.148315 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29808046-0358-4cbc-b4f8-4110e1c240ec None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.156292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:37.159735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47e5a5-b776-41bf-af0e-47d10308c3ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.160582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e5a5-b776-41bf-af0e-47d10308c3ee None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.160868 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e5a5-b776-41bf-af0e-47d10308c3ee None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.161174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c47e5a5-b776-41bf-af0e-47d10308c3ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-29808046-0358-4cbc-b4f8-4110e1c240ec None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:37.166958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:37.168101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:37.169662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:37.169662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:37.169662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:37.169662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:37.169662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:37.169662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:37.169662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:37.169662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:37.169662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 18:08:37.169662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:37.170256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 394/799] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:08:36 2022] GET /identity/v3/users/swift => generated 83 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:37.176090 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29808046-0358-4cbc-b4f8-4110e1c240ec None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.176560 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c47e5a5-b776-41bf-af0e-47d10308c3ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3c47e5a5-b776-41bf-af0e-47d10308c3ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:37.188213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:37.189395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:37.190273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:37.190273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:37.190273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:37.190273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:37.190273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:37.190273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:37.190273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:37.190273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:37.190273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:37.190273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:37.190273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:08:37.190273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:37.190273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 406/800] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:08:36 2022] GET /identity/v3/roles/admin => generated 83 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:37.190980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47e5a5-b776-41bf-af0e-47d10308c3ee None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.239375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:37.303946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c47e5a5-b776-41bf-af0e-47d10308c3ee None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.309120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29808046-0358-4cbc-b4f8-4110e1c240ec None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.343068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69050295-ae2c-48a7-94dd-f6a69054c815 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.343968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69050295-ae2c-48a7-94dd-f6a69054c815 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.344346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69050295-ae2c-48a7-94dd-f6a69054c815 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.344744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69050295-ae2c-48a7-94dd-f6a69054c815 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.345795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69050295-ae2c-48a7-94dd-f6a69054c815 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:37.346214 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69050295-ae2c-48a7-94dd-f6a69054c815 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.347842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69050295-ae2c-48a7-94dd-f6a69054c815 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.361779 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dea475-3605-4051-a513-743943bfc625 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.362813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dea475-3605-4051-a513-743943bfc625 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.363247 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dea475-3605-4051-a513-743943bfc625 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.363697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73dea475-3605-4051-a513-743943bfc625 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.372943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 407/801] 10.222.0.64 () {56 vars in 1135 bytes} [Thu May 26 18:08:37 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:37.372943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69050295-ae2c-48a7-94dd-f6a69054c815 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.377832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dea475-3605-4051-a513-743943bfc625 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.379499 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73dea475-3605-4051-a513-743943bfc625 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-73dea475-3605-4051-a513-743943bfc625 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:37.394308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:37.395299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:37.396170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:37.396170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:37.396170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:37.396170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:37.396170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:37.396170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:37.396170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:37.396170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:37.400873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 395/802] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:37 2022] GET /identity/v3/projects/service => generated 88 bytes in 225 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:37.401820 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dea475-3605-4051-a513-743943bfc625 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.464640 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:37.503938 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:37.512507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73dea475-3605-4051-a513-743943bfc625 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.512656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69050295-ae2c-48a7-94dd-f6a69054c815 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.550620 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617a712-9df9-4947-ac45-09fa3da1c9b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.551270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617a712-9df9-4947-ac45-09fa3da1c9b4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.551553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617a712-9df9-4947-ac45-09fa3da1c9b4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.551829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e617a712-9df9-4947-ac45-09fa3da1c9b4 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.552572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617a712-9df9-4947-ac45-09fa3da1c9b4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:37.552878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617a712-9df9-4947-ac45-09fa3da1c9b4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.554379 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e617a712-9df9-4947-ac45-09fa3da1c9b4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.557691 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1a62289-7f6a-4632-88ff-fb6b8eb25f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.558690 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a62289-7f6a-4632-88ff-fb6b8eb25f79 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.559155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a62289-7f6a-4632-88ff-fb6b8eb25f79 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.559672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1a62289-7f6a-4632-88ff-fb6b8eb25f79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.562810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 408/803] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:08:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:37.563807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617a712-9df9-4947-ac45-09fa3da1c9b4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.571728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a62289-7f6a-4632-88ff-fb6b8eb25f79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.573230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1a62289-7f6a-4632-88ff-fb6b8eb25f79 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-c1a62289-7f6a-4632-88ff-fb6b8eb25f79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:37.592420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:37.593331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:37.594205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:37.594205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:37.594205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:37.594205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:37.598305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 396/804] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:37.599397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81ea60-be51-40e6-b394-f47846a727c0 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.599699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81ea60-be51-40e6-b394-f47846a727c0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.599972 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f81ea60-be51-40e6-b394-f47846a727c0 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.605329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 397/805] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:37.605329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81ea60-be51-40e6-b394-f47846a727c0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.677817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e617a712-9df9-4947-ac45-09fa3da1c9b4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.712266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7777ec7-6095-4c9b-bfde-96f087cb4e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.712927 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7777ec7-6095-4c9b-bfde-96f087cb4e45 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.713233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7777ec7-6095-4c9b-bfde-96f087cb4e45 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.713515 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7777ec7-6095-4c9b-bfde-96f087cb4e45 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.714292 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7777ec7-6095-4c9b-bfde-96f087cb4e45 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:37.714602 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7777ec7-6095-4c9b-bfde-96f087cb4e45 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.716632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7777ec7-6095-4c9b-bfde-96f087cb4e45 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.720167 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f81ea60-be51-40e6-b394-f47846a727c0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.730808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:37.730933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 409/806] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:37.731734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7777ec7-6095-4c9b-bfde-96f087cb4e45 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.752072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:37.762326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c37187ee-8b5e-455f-a23b-9adff7c827f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.763422 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37187ee-8b5e-455f-a23b-9adff7c827f1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.763794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37187ee-8b5e-455f-a23b-9adff7c827f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.764040 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c37187ee-8b5e-455f-a23b-9adff7c827f1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.775369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37187ee-8b5e-455f-a23b-9adff7c827f1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.776884 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c37187ee-8b5e-455f-a23b-9adff7c827f1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-c37187ee-8b5e-455f-a23b-9adff7c827f1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:37.795233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:37.796125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:37.797015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:37.797015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:37.797015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:37.797015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:37.797015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 398/807] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:37.797832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e73fc-fe32-46d9-88bf-0d9a6a49f065 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.797832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e73fc-fe32-46d9-88bf-0d9a6a49f065 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.798092 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2e73fc-fe32-46d9-88bf-0d9a6a49f065 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.815122 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ea2e73fc-fe32-46d9-88bf-0d9a6a49f065 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:37.816281 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ea2e73fc-fe32-46d9-88bf-0d9a6a49f065 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:37.843846 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7777ec7-6095-4c9b-bfde-96f087cb4e45 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:37.877801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674a17e-3223-44bb-ba30-89f1624d3ed4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:37.878467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674a17e-3223-44bb-ba30-89f1624d3ed4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:37.878748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674a17e-3223-44bb-ba30-89f1624d3ed4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:37.879025 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5674a17e-3223-44bb-ba30-89f1624d3ed4 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:37.879742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674a17e-3223-44bb-ba30-89f1624d3ed4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:37.880052 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674a17e-3223-44bb-ba30-89f1624d3ed4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:37.881470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5674a17e-3223-44bb-ba30-89f1624d3ed4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:37.889136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 399/808] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:37 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:37.890413 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e73fc-fe32-46d9-88bf-0d9a6a49f065 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.904862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 410/809] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:37.905849 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674a17e-3223-44bb-ba30-89f1624d3ed4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:37.987869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:37.992595 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:38.003436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2e73fc-fe32-46d9-88bf-0d9a6a49f065 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.014121 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5674a17e-3223-44bb-ba30-89f1624d3ed4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.040052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2601c-b869-402c-ad20-772afbec5add None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.040937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2601c-b869-402c-ad20-772afbec5add None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.041470 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2601c-b869-402c-ad20-772afbec5add None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.041582 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2601c-b869-402c-ad20-772afbec5add None admin] PATH_INFO: `/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/438d065f5ec6446c824cdc4642c4ec06/roles/ec1445be03c942a98070dd9213fd0705` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.053426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833000f-a75f-4a77-a948-74842528282e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.054100 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833000f-a75f-4a77-a948-74842528282e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.054391 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833000f-a75f-4a77-a948-74842528282e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.054677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f833000f-a75f-4a77-a948-74842528282e None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.055407 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833000f-a75f-4a77-a948-74842528282e None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:38.055724 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833000f-a75f-4a77-a948-74842528282e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.057128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f833000f-a75f-4a77-a948-74842528282e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.058034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2601c-b869-402c-ad20-772afbec5add None admin] RBAC: Authorizing `identity:create_grant(project_id=ab7fe8d932964e7ab1f442f26ef0735b, user_id=438d065f5ec6446c824cdc4642c4ec06, role_id=ec1445be03c942a98070dd9213fd0705)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.060305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2601c-b869-402c-ad20-772afbec5add None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.071228 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 411/810] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:38.072294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833000f-a75f-4a77-a948-74842528282e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.078227 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 400/811] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:08:37 2022] PUT /identity/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/438d065f5ec6446c824cdc4642c4ec06/roles/ec1445be03c942a98070dd9213fd0705 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:38.079225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2601c-b869-402c-ad20-772afbec5add None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.211575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2601c-b869-402c-ad20-772afbec5add None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.227377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f833000f-a75f-4a77-a948-74842528282e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.252028 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529d883-3a01-4a21-8110-01d80ee6918c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.253031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d883-3a01-4a21-8110-01d80ee6918c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.253326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d883-3a01-4a21-8110-01d80ee6918c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.253603 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529d883-3a01-4a21-8110-01d80ee6918c None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.254608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529d883-3a01-4a21-8110-01d80ee6918c None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.255900 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a529d883-3a01-4a21-8110-01d80ee6918c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-a529d883-3a01-4a21-8110-01d80ee6918c None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:38.272561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:38.273791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. May 26 18:08:38.274710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:38.275486 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 401/812] 10.222.0.64 () {56 vars in 1129 bytes} [Thu May 26 18:08:38 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:38.276262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529d883-3a01-4a21-8110-01d80ee6918c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.278318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ee507-79d3-4f82-b5db-8aee772bd0c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.279330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ee507-79d3-4f82-b5db-8aee772bd0c5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.279773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ee507-79d3-4f82-b5db-8aee772bd0c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.280505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093ee507-79d3-4f82-b5db-8aee772bd0c5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.288490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:38.292744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ee507-79d3-4f82-b5db-8aee772bd0c5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.294423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-093ee507-79d3-4f82-b5db-8aee772bd0c5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.296515 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-093ee507-79d3-4f82-b5db-8aee772bd0c5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:38.312236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:38.313190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:38.314073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:38.314073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:38.314073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:38.314073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:38.314073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:38.314073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:38.314073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:38.314073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:38.320030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 412/813] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:38 2022] GET /identity/v3/projects/service => generated 88 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:38.320030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ee507-79d3-4f82-b5db-8aee772bd0c5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.397803 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529d883-3a01-4a21-8110-01d80ee6918c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.433856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380269c-2811-4203-96d9-e0ec638c9c01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.435202 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380269c-2811-4203-96d9-e0ec638c9c01 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.435538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380269c-2811-4203-96d9-e0ec638c9c01 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.435814 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e380269c-2811-4203-96d9-e0ec638c9c01 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.443887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380269c-2811-4203-96d9-e0ec638c9c01 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.445362 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e380269c-2811-4203-96d9-e0ec638c9c01 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-e380269c-2811-4203-96d9-e0ec638c9c01 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:38.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:38.461572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:38.462719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:38.462719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:38.462719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:38.462719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:38.462719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:38.462719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:38.462719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:38.462719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:38.462719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 18:08:38.462719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:38.462719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 402/814] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 26 18:08:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:38.462719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380269c-2811-4203-96d9-e0ec638c9c01 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.469839 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093ee507-79d3-4f82-b5db-8aee772bd0c5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.512964 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da442d0a-a4f5-4683-85f8-2c18129b7e6c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.513808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da442d0a-a4f5-4683-85f8-2c18129b7e6c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.513930 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da442d0a-a4f5-4683-85f8-2c18129b7e6c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.514186 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da442d0a-a4f5-4683-85f8-2c18129b7e6c None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.514978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da442d0a-a4f5-4683-85f8-2c18129b7e6c None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:38.515189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da442d0a-a4f5-4683-85f8-2c18129b7e6c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.516604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da442d0a-a4f5-4683-85f8-2c18129b7e6c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.526282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 413/815] 10.222.0.64 () {56 vars in 1124 bytes} [Thu May 26 18:08:38 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 206 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:38.526282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da442d0a-a4f5-4683-85f8-2c18129b7e6c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.549368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:38.588622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:38.592856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e380269c-2811-4203-96d9-e0ec638c9c01 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.630519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afca3b-b6f1-4367-8f5f-70132bff0c15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.631312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da442d0a-a4f5-4683-85f8-2c18129b7e6c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.631673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afca3b-b6f1-4367-8f5f-70132bff0c15 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.632123 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afca3b-b6f1-4367-8f5f-70132bff0c15 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.632571 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05afca3b-b6f1-4367-8f5f-70132bff0c15 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.634458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afca3b-b6f1-4367-8f5f-70132bff0c15 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:38.634933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afca3b-b6f1-4367-8f5f-70132bff0c15 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.636541 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05afca3b-b6f1-4367-8f5f-70132bff0c15 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.652104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 403/816] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:38 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:38.653326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afca3b-b6f1-4367-8f5f-70132bff0c15 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.664560 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f03d46bc-6141-47c1-bdcf-29ade7a1c00d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.665267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d46bc-6141-47c1-bdcf-29ade7a1c00d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.665547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d46bc-6141-47c1-bdcf-29ade7a1c00d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.665820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f03d46bc-6141-47c1-bdcf-29ade7a1c00d None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.666645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d46bc-6141-47c1-bdcf-29ade7a1c00d None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:38.666952 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d46bc-6141-47c1-bdcf-29ade7a1c00d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.668366 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f03d46bc-6141-47c1-bdcf-29ade7a1c00d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.687300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 414/817] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 26 18:08:38 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:38.688385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4049b6-12f7-4561-83b6-519f892156b4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.688667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4049b6-12f7-4561-83b6-519f892156b4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.688939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee4049b6-12f7-4561-83b6-519f892156b4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.694436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 415/818] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:38.694436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4049b6-12f7-4561-83b6-519f892156b4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.783536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05afca3b-b6f1-4367-8f5f-70132bff0c15 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.803199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee4049b6-12f7-4561-83b6-519f892156b4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:38.814109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:38.824075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99197e24-05f8-4a99-bc8c-feec8bef06ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.824749 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99197e24-05f8-4a99-bc8c-feec8bef06ad None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.825093 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99197e24-05f8-4a99-bc8c-feec8bef06ad None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.825376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99197e24-05f8-4a99-bc8c-feec8bef06ad None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.826087 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99197e24-05f8-4a99-bc8c-feec8bef06ad None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:38.826387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:38.826518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99197e24-05f8-4a99-bc8c-feec8bef06ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.828031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99197e24-05f8-4a99-bc8c-feec8bef06ad None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.834304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 404/819] 10.222.0.64 () {56 vars in 1124 bytes} [Thu May 26 18:08:38 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:38.835121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99197e24-05f8-4a99-bc8c-feec8bef06ad None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.846858 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ada610e3-6b7d-4a56-9614-39202c87571e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:38.848317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada610e3-6b7d-4a56-9614-39202c87571e None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.848769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada610e3-6b7d-4a56-9614-39202c87571e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.849255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ada610e3-6b7d-4a56-9614-39202c87571e None admin] PATH_INFO: `/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/9cb21a6eef0e418182b2dd755096ca77/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.851280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada610e3-6b7d-4a56-9614-39202c87571e None admin] RBAC: Authorizing `identity:create_grant(project_id=ab7fe8d932964e7ab1f442f26ef0735b, user_id=9cb21a6eef0e418182b2dd755096ca77, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:38.853021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ada610e3-6b7d-4a56-9614-39202c87571e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:38.877017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 416/820] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:08:38 2022] PUT /identity/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/9cb21a6eef0e418182b2dd755096ca77/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:38.877017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ff226-8b01-4d3d-b497-9436ad7865a7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:38.877017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ff226-8b01-4d3d-b497-9436ad7865a7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:38.877017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d8ff226-8b01-4d3d-b497-9436ad7865a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:38.887275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8d8ff226-8b01-4d3d-b497-9436ad7865a7 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:38.888543 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8d8ff226-8b01-4d3d-b497-9436ad7865a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:38.966242 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 417/821] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:38 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:38.967138 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ff226-8b01-4d3d-b497-9436ad7865a7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:38.980211 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99197e24-05f8-4a99-bc8c-feec8bef06ad None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:39.028914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60b8a3-09d1-478a-ad5f-6d20b667b9f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:39.029941 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60b8a3-09d1-478a-ad5f-6d20b667b9f2 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:39.030219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60b8a3-09d1-478a-ad5f-6d20b667b9f2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:39.030492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c60b8a3-09d1-478a-ad5f-6d20b667b9f2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:39.087206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d8ff226-8b01-4d3d-b497-9436ad7865a7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:39.100447 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:39.114584 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:39.130094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60b8a3-09d1-478a-ad5f-6d20b667b9f2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:39.131389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c60b8a3-09d1-478a-ad5f-6d20b667b9f2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:39.141751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c3bc-c03f-439d-afba-fef6aca7a18b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:39.142995 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c3bc-c03f-439d-afba-fef6aca7a18b None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:39.143636 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c3bc-c03f-439d-afba-fef6aca7a18b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:39.144305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec19c3bc-c03f-439d-afba-fef6aca7a18b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:39.145731 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19c3bc-c03f-439d-afba-fef6aca7a18b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:39.148696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec19c3bc-c03f-439d-afba-fef6aca7a18b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:39.175023 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 418/822] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 26 18:08:38 2022] POST /identity/v3/endpoints => generated 346 bytes in 208 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:39.176191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c3bc-c03f-439d-afba-fef6aca7a18b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:39.322902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec19c3bc-c03f-439d-afba-fef6aca7a18b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:39.338542 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 405/823] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:38 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 504 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:08:39.344874 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60b8a3-09d1-478a-ad5f-6d20b667b9f2 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:39.365335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2916a-8af6-450a-8725-dcb7bfd90f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:39.367170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2916a-8af6-450a-8725-dcb7bfd90f06 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:39.367685 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2916a-8af6-450a-8725-dcb7bfd90f06 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:39.368291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a2916a-8af6-450a-8725-dcb7bfd90f06 None admin] PATH_INFO: `/v3/services/network` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:39.369221 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2916a-8af6-450a-8725-dcb7bfd90f06 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:39.370922 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a2916a-8af6-450a-8725-dcb7bfd90f06 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-50a2916a-8af6-450a-8725-dcb7bfd90f06 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:39.385739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:39.386813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:39.388169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:39.388169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:39.388169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:39.388169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:39.388169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:39.388169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:39.388169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:39.388169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:39.388169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:39.388169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:39.388169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:39.388169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:39.388169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. May 26 18:08:39.388169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:39.395452 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 419/824] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:39 2022] GET /identity/v3/services/network => generated 88 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:39.398031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2916a-8af6-450a-8725-dcb7bfd90f06 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:39.434335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:39.529626 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a2916a-8af6-450a-8725-dcb7bfd90f06 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:39.549265 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:39.561178 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c60b8a3-09d1-478a-ad5f-6d20b667b9f2 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:39.571027 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1faaa-4628-4cac-a8ac-32321a5b497d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:39.571972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1faaa-4628-4cac-a8ac-32321a5b497d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:39.572798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1faaa-4628-4cac-a8ac-32321a5b497d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:39.573455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b1faaa-4628-4cac-a8ac-32321a5b497d None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:39.574816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1faaa-4628-4cac-a8ac-32321a5b497d None admin] RBAC: Adding query filter params (name=network) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:39.576002 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1faaa-4628-4cac-a8ac-32321a5b497d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:39.577735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b1faaa-4628-4cac-a8ac-32321a5b497d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:39.583849 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 420/825] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 26 18:08:39 2022] GET /identity/v3/services?name=network => generated 124 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:39.589439 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1faaa-4628-4cac-a8ac-32321a5b497d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:39.599826 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759b50b-23ac-422a-9745-9940c9b84488 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:39.600678 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759b50b-23ac-422a-9745-9940c9b84488 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:39.600967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759b50b-23ac-422a-9745-9940c9b84488 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:39.603007 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1759b50b-23ac-422a-9745-9940c9b84488 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:39.615138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759b50b-23ac-422a-9745-9940c9b84488 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:39.616445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1759b50b-23ac-422a-9745-9940c9b84488 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-1759b50b-23ac-422a-9745-9940c9b84488 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:39.635778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:39.636700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:39.638186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:39.638186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:39.638186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:39.638186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:39.638186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 406/826] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:39.644045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759b50b-23ac-422a-9745-9940c9b84488 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:39.691642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:39.703818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b1faaa-4628-4cac-a8ac-32321a5b497d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:39.738666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b763099-2c4d-450d-aa0f-7bfc5b22f5ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:39.739697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b763099-2c4d-450d-aa0f-7bfc5b22f5ec None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:39.740207 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b763099-2c4d-450d-aa0f-7bfc5b22f5ec None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:39.740720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b763099-2c4d-450d-aa0f-7bfc5b22f5ec None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:39.741646 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b763099-2c4d-450d-aa0f-7bfc5b22f5ec None admin] RBAC: Adding query filter params (type=network) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:39.742178 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b763099-2c4d-450d-aa0f-7bfc5b22f5ec None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:39.743732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b763099-2c4d-450d-aa0f-7bfc5b22f5ec None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:39.749946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 421/827] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 26 18:08:39 2022] GET /identity/v3/services?type=network => generated 350 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:39.755481 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b763099-2c4d-450d-aa0f-7bfc5b22f5ec None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:39.757037 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1759b50b-23ac-422a-9745-9940c9b84488 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:39.795163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaf3dd-adce-4870-bc77-7df2af368e91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:39.795881 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf3dd-adce-4870-bc77-7df2af368e91 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:39.796165 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf3dd-adce-4870-bc77-7df2af368e91 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:39.796440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbaf3dd-adce-4870-bc77-7df2af368e91 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:39.797292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaf3dd-adce-4870-bc77-7df2af368e91 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:39.797603 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaf3dd-adce-4870-bc77-7df2af368e91 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:39.798991 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfbaf3dd-adce-4870-bc77-7df2af368e91 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:39.812856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 407/828] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:39.817799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaf3dd-adce-4870-bc77-7df2af368e91 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:39.820837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:39.862928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b763099-2c4d-450d-aa0f-7bfc5b22f5ec None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:39.898706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ef23c-0344-4cc1-9e39-d90de3e4ac0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:39.899626 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ef23c-0344-4cc1-9e39-d90de3e4ac0f None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:39.900052 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ef23c-0344-4cc1-9e39-d90de3e4ac0f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:39.900470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c5ef23c-0344-4cc1-9e39-d90de3e4ac0f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:39.901392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ef23c-0344-4cc1-9e39-d90de3e4ac0f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:39.902891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c5ef23c-0344-4cc1-9e39-d90de3e4ac0f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:39.931967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbaf3dd-adce-4870-bc77-7df2af368e91 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:39.947153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 422/829] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 26 18:08:39 2022] POST /identity/v3/endpoints => generated 327 bytes in 192 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:39.978082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208d8f1-e754-402a-9caf-454437c98f5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:39.979107 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d8f1-e754-402a-9caf-454437c98f5b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:39.979495 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d8f1-e754-402a-9caf-454437c98f5b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:39.979869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1208d8f1-e754-402a-9caf-454437c98f5b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:39.988699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208d8f1-e754-402a-9caf-454437c98f5b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:39.990338 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1208d8f1-e754-402a-9caf-454437c98f5b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-1208d8f1-e754-402a-9caf-454437c98f5b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:40.006835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:40.007788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:40.008716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:40.008716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:40.008716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:40.008716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:40.008716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:40.008716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:40.008716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:40.008716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:40.008716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 408/830] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:39 2022] GET /identity/v3/projects/service => generated 88 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:40.013917 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ef23c-0344-4cc1-9e39-d90de3e4ac0f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:40.042853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:40.167006 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c5ef23c-0344-4cc1-9e39-d90de3e4ac0f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:40.217158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bdff218-73b3-422f-acb5-ac3e1d21be20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:40.217832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdff218-73b3-422f-acb5-ac3e1d21be20 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:40.218108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdff218-73b3-422f-acb5-ac3e1d21be20 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:40.218384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bdff218-73b3-422f-acb5-ac3e1d21be20 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:40.219169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdff218-73b3-422f-acb5-ac3e1d21be20 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:40.219481 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdff218-73b3-422f-acb5-ac3e1d21be20 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:40.220971 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bdff218-73b3-422f-acb5-ac3e1d21be20 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:40.242752 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 423/831] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:40 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:40.248871 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208d8f1-e754-402a-9caf-454437c98f5b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:40.332464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:40.377973 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1208d8f1-e754-402a-9caf-454437c98f5b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:40.413297 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60a2aaf9-f260-476b-85ce-611e6bd1fd29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:40.413889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2aaf9-f260-476b-85ce-611e6bd1fd29 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:40.414237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2aaf9-f260-476b-85ce-611e6bd1fd29 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:40.414513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60a2aaf9-f260-476b-85ce-611e6bd1fd29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:40.415412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2aaf9-f260-476b-85ce-611e6bd1fd29 None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=97f259ac2eb4425f8b4dcffeccdcd439) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:40.415736 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2aaf9-f260-476b-85ce-611e6bd1fd29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:40.417339 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60a2aaf9-f260-476b-85ce-611e6bd1fd29 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:40.425234 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 409/832] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:40 2022] GET /identity/v3/role_assignments?user.id=97f259ac2eb4425f8b4dcffeccdcd439&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:40.622579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df088005-f18a-4f0b-98a9-05006c00ac5d None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:40.622952 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df088005-f18a-4f0b-98a9-05006c00ac5d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:40.623134 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df088005-f18a-4f0b-98a9-05006c00ac5d None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:40.624768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 424/833] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:40.630020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2f581-ee67-43f5-b160-e980e37e2f7a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:40.630477 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2f581-ee67-43f5-b160-e980e37e2f7a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:40.630553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b2f581-ee67-43f5-b160-e980e37e2f7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:40.649141 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-35b2f581-ee67-43f5-b160-e980e37e2f7a None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:40.650331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-35b2f581-ee67-43f5-b160-e980e37e2f7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:40.723829 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 410/834] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:40 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:08:40.746348 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df088005-f18a-4f0b-98a9-05006c00ac5d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:40.821694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:40.856413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df088005-f18a-4f0b-98a9-05006c00ac5d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:40.892672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e7eef-da19-44d4-b6d8-8ca52e66f915 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:40.893502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e7eef-da19-44d4-b6d8-8ca52e66f915 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:40.893781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e7eef-da19-44d4-b6d8-8ca52e66f915 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:40.894055 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885e7eef-da19-44d4-b6d8-8ca52e66f915 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:40.904921 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885e7eef-da19-44d4-b6d8-8ca52e66f915 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-885e7eef-da19-44d4-b6d8-8ca52e66f915 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:40.912776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:40.913749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:40.915475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:40.915475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:40.915475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:40.915475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:40.915475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:40.915475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:40.915475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:40.915475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:40.915475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:40.915475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:40.915475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:08:40.915475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:40.915475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 425/835] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:08:40 2022] GET /identity/v3/roles/service => generated 85 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:40.922084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2f581-ee67-43f5-b160-e980e37e2f7a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:40.979211 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:41.028603 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35b2f581-ee67-43f5-b160-e980e37e2f7a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:41.063926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca0b18-667f-4584-b9e9-aa7cfe2f5169 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:41.064922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca0b18-667f-4584-b9e9-aa7cfe2f5169 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:41.065403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca0b18-667f-4584-b9e9-aa7cfe2f5169 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:41.065856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dca0b18-667f-4584-b9e9-aa7cfe2f5169 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:41.066766 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca0b18-667f-4584-b9e9-aa7cfe2f5169 None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:41.067245 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca0b18-667f-4584-b9e9-aa7cfe2f5169 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:41.068858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dca0b18-667f-4584-b9e9-aa7cfe2f5169 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:41.078527 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 411/836] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:08:40 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:41.084353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e7eef-da19-44d4-b6d8-8ca52e66f915 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:41.193548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885e7eef-da19-44d4-b6d8-8ca52e66f915 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:41.225367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:41.227896 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41665788-e23b-4b4d-8714-c03e8b87e2f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:41.228695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41665788-e23b-4b4d-8714-c03e8b87e2f7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:41.228974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41665788-e23b-4b4d-8714-c03e8b87e2f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:41.229333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41665788-e23b-4b4d-8714-c03e8b87e2f7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:41.240522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41665788-e23b-4b4d-8714-c03e8b87e2f7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:41.241982 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41665788-e23b-4b4d-8714-c03e8b87e2f7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-41665788-e23b-4b4d-8714-c03e8b87e2f7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:41.259831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:41.260754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:41.261884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:41.261884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:41.261884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:41.261884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:41.261884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 426/837] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:41.267633 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca0b18-667f-4584-b9e9-aa7cfe2f5169 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:41.328446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5adc45-5762-48a0-95b2-aa27f7816a52 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:41.328769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5adc45-5762-48a0-95b2-aa27f7816a52 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:41.329044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5adc45-5762-48a0-95b2-aa27f7816a52 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:41.330721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 427/838] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:41.337516 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618bf94-1074-41f5-94a9-fdb87bd21a23 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:41.338070 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618bf94-1074-41f5-94a9-fdb87bd21a23 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:41.338546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4618bf94-1074-41f5-94a9-fdb87bd21a23 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:41.363057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4618bf94-1074-41f5-94a9-fdb87bd21a23 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:41.364716 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4618bf94-1074-41f5-94a9-fdb87bd21a23 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:41.378476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dca0b18-667f-4584-b9e9-aa7cfe2f5169 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:41.394450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:41.418270 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dc14c-2aa1-4be7-802b-73a7b6ba0942 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:41.419932 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dc14c-2aa1-4be7-802b-73a7b6ba0942 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:41.420433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dc14c-2aa1-4be7-802b-73a7b6ba0942 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:41.420936 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f66dc14c-2aa1-4be7-802b-73a7b6ba0942 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:41.421978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dc14c-2aa1-4be7-802b-73a7b6ba0942 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:41.422481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dc14c-2aa1-4be7-802b-73a7b6ba0942 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:41.424182 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f66dc14c-2aa1-4be7-802b-73a7b6ba0942 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:41.439284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 412/839] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:41 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:41.444899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dc14c-2aa1-4be7-802b-73a7b6ba0942 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:41.461085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 428/840] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:41 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:08:41.479256 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618bf94-1074-41f5-94a9-fdb87bd21a23 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:41.569722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f66dc14c-2aa1-4be7-802b-73a7b6ba0942 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:41.588733 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4618bf94-1074-41f5-94a9-fdb87bd21a23 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:41.603591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:41.618152 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efaef4f-6df9-4523-b178-336aa0ce53a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:41.619900 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaef4f-6df9-4523-b178-336aa0ce53a6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:41.620390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaef4f-6df9-4523-b178-336aa0ce53a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:41.621125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2efaef4f-6df9-4523-b178-336aa0ce53a6 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:41.627049 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd22f2-92a1-4cb8-a320-4b3112ee70c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:41.627914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd22f2-92a1-4cb8-a320-4b3112ee70c0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:41.628198 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd22f2-92a1-4cb8-a320-4b3112ee70c0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:41.628466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dd22f2-92a1-4cb8-a320-4b3112ee70c0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:41.632173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efaef4f-6df9-4523-b178-336aa0ce53a6 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:41.634660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2efaef4f-6df9-4523-b178-336aa0ce53a6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:41.640070 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dd22f2-92a1-4cb8-a320-4b3112ee70c0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c1dd22f2-92a1-4cb8-a320-4b3112ee70c0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:41.648126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:41.649167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:41.650067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:41.650067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:41.650067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:41.650067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:41.650067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:41.650067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:41.650067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:41.650067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:41.650067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:41.650067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:41.650067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:08:41.650067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:41.653367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 429/841] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:08:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:41.655517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd22f2-92a1-4cb8-a320-4b3112ee70c0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-2efaef4f-6df9-4523-b178-336aa0ce53a6 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:41.656548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:41.657456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:41.658370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:41.658370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:41.658370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:41.658370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:41.658370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:41.658370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:41.658370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:41.658370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:41.658370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 18:08:41.658370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:41.661829 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 413/842] 10.222.0.64 () {56 vars in 1117 bytes} [Thu May 26 18:08:41 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 217 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:41.667395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efaef4f-6df9-4523-b178-336aa0ce53a6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:41.715397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:41.765892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dd22f2-92a1-4cb8-a320-4b3112ee70c0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:41.802752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2efaef4f-6df9-4523-b178-336aa0ce53a6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:41.821111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ccb76-1b47-42bd-91c7-f77763b90524 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:41.822400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ccb76-1b47-42bd-91c7-f77763b90524 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:41.822887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ccb76-1b47-42bd-91c7-f77763b90524 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:41.823802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e23ccb76-1b47-42bd-91c7-f77763b90524 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:41.824763 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ccb76-1b47-42bd-91c7-f77763b90524 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:41.825344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ccb76-1b47-42bd-91c7-f77763b90524 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:41.827497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e23ccb76-1b47-42bd-91c7-f77763b90524 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:41.840128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 430/843] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:08:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:41.842273 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c488cf-655c-40a2-a71a-095e341fa767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:41.843199 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c488cf-655c-40a2-a71a-095e341fa767 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:41.843681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c488cf-655c-40a2-a71a-095e341fa767 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:41.844157 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c488cf-655c-40a2-a71a-095e341fa767 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:41.845549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c488cf-655c-40a2-a71a-095e341fa767 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:41.845746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ccb76-1b47-42bd-91c7-f77763b90524 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:41.846288 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c488cf-655c-40a2-a71a-095e341fa767 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:41.847931 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c488cf-655c-40a2-a71a-095e341fa767 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:41.877447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 414/844] 10.222.0.64 () {56 vars in 1149 bytes} [Thu May 26 18:08:41 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 210 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:41.878404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c488cf-655c-40a2-a71a-095e341fa767 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:41.887673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:41.958589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e23ccb76-1b47-42bd-91c7-f77763b90524 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:41.993570 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:41.998287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f033f83-3c9f-4bba-8f9e-82c8fd2fa879 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:41.999089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f033f83-3c9f-4bba-8f9e-82c8fd2fa879 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:41.999405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f033f83-3c9f-4bba-8f9e-82c8fd2fa879 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:41.999764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f033f83-3c9f-4bba-8f9e-82c8fd2fa879 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.002633 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c488cf-655c-40a2-a71a-095e341fa767 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:42.011241 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f033f83-3c9f-4bba-8f9e-82c8fd2fa879 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:42.012706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f033f83-3c9f-4bba-8f9e-82c8fd2fa879 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-0f033f83-3c9f-4bba-8f9e-82c8fd2fa879 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:42.030503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:42.031579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:42.032478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:42.032478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:42.032478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:42.032478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:42.032478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 431/845] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 186 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:42.032894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297694f-934a-4d12-a007-40b7e9ff671a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.033195 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297694f-934a-4d12-a007-40b7e9ff671a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.033474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8297694f-934a-4d12-a007-40b7e9ff671a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.037022 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 432/846] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:42.037362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297694f-934a-4d12-a007-40b7e9ff671a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:42.047295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620a7ed-dc6b-4335-b8e5-44b59557ce72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:42.047692 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a7ed-dc6b-4335-b8e5-44b59557ce72 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.047976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a7ed-dc6b-4335-b8e5-44b59557ce72 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.048255 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2620a7ed-dc6b-4335-b8e5-44b59557ce72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.123822 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620a7ed-dc6b-4335-b8e5-44b59557ce72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:42.125972 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2620a7ed-dc6b-4335-b8e5-44b59557ce72 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:42.129190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:42.148263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8297694f-934a-4d12-a007-40b7e9ff671a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:42.185591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a084e85-d2a9-4fca-9f60-0bdf3a24017f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:42.186453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084e85-d2a9-4fca-9f60-0bdf3a24017f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.186567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084e85-d2a9-4fca-9f60-0bdf3a24017f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.186811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a084e85-d2a9-4fca-9f60-0bdf3a24017f None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.187545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a084e85-d2a9-4fca-9f60-0bdf3a24017f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:42.187837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a084e85-d2a9-4fca-9f60-0bdf3a24017f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:42.189287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a084e85-d2a9-4fca-9f60-0bdf3a24017f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:42.202233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 433/847] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:42.203241 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f054615-fbab-4adf-a791-46faa3c4938b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.203531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f054615-fbab-4adf-a791-46faa3c4938b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.203809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f054615-fbab-4adf-a791-46faa3c4938b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.221106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8f054615-fbab-4adf-a791-46faa3c4938b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:42.222284 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8f054615-fbab-4adf-a791-46faa3c4938b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:42.244190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:42.254929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 415/848] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:41 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 377 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 18:08:42.255823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620a7ed-dc6b-4335-b8e5-44b59557ce72 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:42.298778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 434/849] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:42 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:42.299793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f054615-fbab-4adf-a791-46faa3c4938b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:42.373375 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2620a7ed-dc6b-4335-b8e5-44b59557ce72 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:42.386984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:42.413202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f054615-fbab-4adf-a791-46faa3c4938b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:42.415248 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb841d-7779-4cb4-8a5b-bd4b0b8b8ee4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:42.417105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb841d-7779-4cb4-8a5b-bd4b0b8b8ee4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.417623 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb841d-7779-4cb4-8a5b-bd4b0b8b8ee4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.418104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27fb841d-7779-4cb4-8a5b-bd4b0b8b8ee4 None admin] PATH_INFO: `/v3/users/swift` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.427671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb841d-7779-4cb4-8a5b-bd4b0b8b8ee4 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:42.429835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27fb841d-7779-4cb4-8a5b-bd4b0b8b8ee4 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-27fb841d-7779-4cb4-8a5b-bd4b0b8b8ee4 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:42.444794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:42.445894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:42.446865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:42.446865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:42.446865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:42.446865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:42.446865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:42.446865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:42.446865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:42.446865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:42.446865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. May 26 18:08:42.446865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:42.446865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 416/850] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:08:42 2022] GET /identity/v3/users/swift => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:42.446865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb841d-7779-4cb4-8a5b-bd4b0b8b8ee4 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:42.453090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3404d3-70c2-4715-b642-2b232c869ad5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:42.453895 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3404d3-70c2-4715-b642-2b232c869ad5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.454177 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3404d3-70c2-4715-b642-2b232c869ad5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.454455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3404d3-70c2-4715-b642-2b232c869ad5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.465198 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3404d3-70c2-4715-b642-2b232c869ad5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:42.467209 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3404d3-70c2-4715-b642-2b232c869ad5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-cf3404d3-70c2-4715-b642-2b232c869ad5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:42.485253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:42.486269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:42.491974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:42.491974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:42.491974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:42.491974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:42.491974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 435/851] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:42 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:42.491974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3404d3-70c2-4715-b642-2b232c869ad5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:42.507864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:42.558798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27fb841d-7779-4cb4-8a5b-bd4b0b8b8ee4 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:42.597971 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3404d3-70c2-4715-b642-2b232c869ad5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:42.600962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ff88e-03a8-479b-812c-17d31c5f1574 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:42.601788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ff88e-03a8-479b-812c-17d31c5f1574 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.602074 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ff88e-03a8-479b-812c-17d31c5f1574 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.602354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6ff88e-03a8-479b-812c-17d31c5f1574 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.603007 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ff88e-03a8-479b-812c-17d31c5f1574 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:42.604376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6ff88e-03a8-479b-812c-17d31c5f1574 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-cf6ff88e-03a8-479b-812c-17d31c5f1574 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:42.617307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:42.618279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:42.619086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 417/852] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:08:42 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:42.619862 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ff88e-03a8-479b-812c-17d31c5f1574 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:42.630564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:42.639771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c339701-5d3e-4e00-ad3f-40357bf19ac9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:42.640389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c339701-5d3e-4e00-ad3f-40357bf19ac9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.640676 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c339701-5d3e-4e00-ad3f-40357bf19ac9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.640948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c339701-5d3e-4e00-ad3f-40357bf19ac9 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.641827 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c339701-5d3e-4e00-ad3f-40357bf19ac9 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:42.642144 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c339701-5d3e-4e00-ad3f-40357bf19ac9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:42.643574 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c339701-5d3e-4e00-ad3f-40357bf19ac9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:42.665697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 436/853] 10.222.0.64 () {56 vars in 1135 bytes} [Thu May 26 18:08:42 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:42.665697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c339701-5d3e-4e00-ad3f-40357bf19ac9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:42.729865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6ff88e-03a8-479b-812c-17d31c5f1574 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:42.746848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:42.765154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c339701-5d3e-4e00-ad3f-40357bf19ac9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:42.766888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3383afd-8b52-400a-a95c-b2f699c34bd1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:42.767562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3383afd-8b52-400a-a95c-b2f699c34bd1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.767841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3383afd-8b52-400a-a95c-b2f699c34bd1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.768120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3383afd-8b52-400a-a95c-b2f699c34bd1 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.768837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3383afd-8b52-400a-a95c-b2f699c34bd1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:42.769179 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3383afd-8b52-400a-a95c-b2f699c34bd1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:42.770553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3383afd-8b52-400a-a95c-b2f699c34bd1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:42.782230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 418/854] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:42.783013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3383afd-8b52-400a-a95c-b2f699c34bd1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:42.802440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b94586f-a752-48e7-a1c2-fba56011b599 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:42.803108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94586f-a752-48e7-a1c2-fba56011b599 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.803398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94586f-a752-48e7-a1c2-fba56011b599 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.803679 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b94586f-a752-48e7-a1c2-fba56011b599 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.804383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94586f-a752-48e7-a1c2-fba56011b599 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:42.804694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94586f-a752-48e7-a1c2-fba56011b599 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:42.806107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b94586f-a752-48e7-a1c2-fba56011b599 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:42.811011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 437/855] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:08:42 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:42.812192 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8d80-81a8-4031-9cc5-ec6eb6db49c5 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.812479 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8d80-81a8-4031-9cc5-ec6eb6db49c5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.812761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38be8d80-81a8-4031-9cc5-ec6eb6db49c5 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.814154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 438/856] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:42 2022] GET /identity => generated 270 bytes in 2 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:42.817885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be8d80-81a8-4031-9cc5-ec6eb6db49c5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:42.869649 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:42.886763 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3383afd-8b52-400a-a95c-b2f699c34bd1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:42.920539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38be8d80-81a8-4031-9cc5-ec6eb6db49c5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:42.920868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-129eee3a-ae72-4301-8048-b7cf34fc2533 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:42.921540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129eee3a-ae72-4301-8048-b7cf34fc2533 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.921824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129eee3a-ae72-4301-8048-b7cf34fc2533 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.922097 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-129eee3a-ae72-4301-8048-b7cf34fc2533 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.955057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a4402-bdd5-435e-ae37-74a156605456 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:42.955842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a4402-bdd5-435e-ae37-74a156605456 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:42.956126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a4402-bdd5-435e-ae37-74a156605456 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:42.956399 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-915a4402-bdd5-435e-ae37-74a156605456 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:42.963091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a4402-bdd5-435e-ae37-74a156605456 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:42.964531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-915a4402-bdd5-435e-ae37-74a156605456 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:42.965212 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-915a4402-bdd5-435e-ae37-74a156605456 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:42.978376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:42.979436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:42.980338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:42.980338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:42.980338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:42.980338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:42.980338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:42.980338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:42.980338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:42.980338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:42.980338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 439/857] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:42 2022] GET /identity/v3/projects/service => generated 88 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:42.980817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a4402-bdd5-435e-ae37-74a156605456 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:42.992648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129eee3a-ae72-4301-8048-b7cf34fc2533 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:42.994212 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-129eee3a-ae72-4301-8048-b7cf34fc2533 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:43.079651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-915a4402-bdd5-435e-ae37-74a156605456 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:43.089900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:43.090698 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 419/858] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:42 2022] GET /identity/v3/auth/tokens => generated 1151 bytes in 308 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:08:43.092048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698556f3-0b72-4999-8b3c-5c632fef2f05 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:43.092337 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698556f3-0b72-4999-8b3c-5c632fef2f05 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:43.092613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698556f3-0b72-4999-8b3c-5c632fef2f05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:43.109831 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-698556f3-0b72-4999-8b3c-5c632fef2f05 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:43.111130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-698556f3-0b72-4999-8b3c-5c632fef2f05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:43.116806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07da4d-b6ed-46d5-9a28-2bf3ddd48f45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:43.117511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07da4d-b6ed-46d5-9a28-2bf3ddd48f45 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:43.117798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07da4d-b6ed-46d5-9a28-2bf3ddd48f45 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:43.118077 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a07da4d-b6ed-46d5-9a28-2bf3ddd48f45 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:43.118784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07da4d-b6ed-46d5-9a28-2bf3ddd48f45 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:43.119092 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07da4d-b6ed-46d5-9a28-2bf3ddd48f45 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:43.120457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a07da4d-b6ed-46d5-9a28-2bf3ddd48f45 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:43.125938 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 440/859] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:08:42 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:43.126716 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07da4d-b6ed-46d5-9a28-2bf3ddd48f45 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:43.194328 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 420/860] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:43 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:43.195846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698556f3-0b72-4999-8b3c-5c632fef2f05 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:43.207462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:43.255551 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a07da4d-b6ed-46d5-9a28-2bf3ddd48f45 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:43.295380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09c83b-cc1f-4798-a173-da759724fd87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:43.296367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09c83b-cc1f-4798-a173-da759724fd87 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:43.296658 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09c83b-cc1f-4798-a173-da759724fd87 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:43.296935 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c09c83b-cc1f-4798-a173-da759724fd87 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:43.297770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09c83b-cc1f-4798-a173-da759724fd87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:43.298085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09c83b-cc1f-4798-a173-da759724fd87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:43.299537 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c09c83b-cc1f-4798-a173-da759724fd87 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:43.311505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698556f3-0b72-4999-8b3c-5c632fef2f05 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:43.314094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 441/861] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:43.315033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09c83b-cc1f-4798-a173-da759724fd87 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:43.352614 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:43.353161 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e4b5b-f0d1-4c5d-b831-7536a1de5514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:43.354146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e4b5b-f0d1-4c5d-b831-7536a1de5514 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:43.354318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e4b5b-f0d1-4c5d-b831-7536a1de5514 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:43.354601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000e4b5b-f0d1-4c5d-b831-7536a1de5514 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:43.366767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e4b5b-f0d1-4c5d-b831-7536a1de5514 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:43.368798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000e4b5b-f0d1-4c5d-b831-7536a1de5514 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-000e4b5b-f0d1-4c5d-b831-7536a1de5514 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:43.386424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:43.387620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:43.388748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:43.388748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:43.388748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:43.388748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:43.393999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 421/862] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:43 2022] GET /identity/v3/domains/Default => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:43.393999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e4b5b-f0d1-4c5d-b831-7536a1de5514 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:43.431129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c09c83b-cc1f-4798-a173-da759724fd87 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:43.453269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:43.466459 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba95344-5d1f-4349-a703-4175ba2bbc8e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:43.467280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba95344-5d1f-4349-a703-4175ba2bbc8e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:43.467565 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba95344-5d1f-4349-a703-4175ba2bbc8e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:43.467841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ba95344-5d1f-4349-a703-4175ba2bbc8e None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:43.468495 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba95344-5d1f-4349-a703-4175ba2bbc8e None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:43.469898 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ba95344-5d1f-4349-a703-4175ba2bbc8e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3ba95344-5d1f-4349-a703-4175ba2bbc8e None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:43.483132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:43.484076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:43.484900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 442/863] 10.222.0.64 () {56 vars in 1132 bytes} [Thu May 26 18:08:43 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 170 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:43.485758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba95344-5d1f-4349-a703-4175ba2bbc8e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:43.499868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000e4b5b-f0d1-4c5d-b831-7536a1de5514 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:43.536568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a587f-83ea-45c8-8df0-6ad60d8eee20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:43.537328 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a587f-83ea-45c8-8df0-6ad60d8eee20 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:43.537613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a587f-83ea-45c8-8df0-6ad60d8eee20 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:43.537886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58a587f-83ea-45c8-8df0-6ad60d8eee20 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:43.538713 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a587f-83ea-45c8-8df0-6ad60d8eee20 None admin] RBAC: Adding query filter params (role.id=ec1445be03c942a98070dd9213fd0705, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=438d065f5ec6446c824cdc4642c4ec06) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:43.539025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a587f-83ea-45c8-8df0-6ad60d8eee20 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:43.540453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58a587f-83ea-45c8-8df0-6ad60d8eee20 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:43.557036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 422/864] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:43 2022] GET /identity/v3/role_assignments?user.id=438d065f5ec6446c824cdc4642c4ec06&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=ec1445be03c942a98070dd9213fd0705 => generated 608 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:43.557036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a587f-83ea-45c8-8df0-6ad60d8eee20 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:43.603915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:43.609174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ba95344-5d1f-4349-a703-4175ba2bbc8e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:43.649899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707ed94-6e52-44e6-b395-4e8442b65179 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:43.650694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707ed94-6e52-44e6-b395-4e8442b65179 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:43.651030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707ed94-6e52-44e6-b395-4e8442b65179 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:43.651376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9707ed94-6e52-44e6-b395-4e8442b65179 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:43.652178 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707ed94-6e52-44e6-b395-4e8442b65179 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:43.652559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707ed94-6e52-44e6-b395-4e8442b65179 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:43.654636 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9707ed94-6e52-44e6-b395-4e8442b65179 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:43.668201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 443/865] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:43 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:43.673814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707ed94-6e52-44e6-b395-4e8442b65179 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:43.699434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58a587f-83ea-45c8-8df0-6ad60d8eee20 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:43.737847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:43.755632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9d637-c126-4572-b60a-b7c64a6f0873 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:43.756517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9d637-c126-4572-b60a-b7c64a6f0873 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:43.756873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9d637-c126-4572-b60a-b7c64a6f0873 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:43.757251 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13e9d637-c126-4572-b60a-b7c64a6f0873 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:43.758044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9d637-c126-4572-b60a-b7c64a6f0873 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:43.758422 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9d637-c126-4572-b60a-b7c64a6f0873 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:43.760171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13e9d637-c126-4572-b60a-b7c64a6f0873 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:43.772943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 423/866] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 26 18:08:43 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:43.773592 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9d637-c126-4572-b60a-b7c64a6f0873 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:43.808364 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9707ed94-6e52-44e6-b395-4e8442b65179 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:43.851378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b6f15-5640-4277-8d07-564e74f59976 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:43.852194 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b6f15-5640-4277-8d07-564e74f59976 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:43.852473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b6f15-5640-4277-8d07-564e74f59976 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:43.852743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d4b6f15-5640-4277-8d07-564e74f59976 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:43.862265 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b6f15-5640-4277-8d07-564e74f59976 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:43.863718 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d4b6f15-5640-4277-8d07-564e74f59976 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-7d4b6f15-5640-4277-8d07-564e74f59976 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:43.882083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:43.883046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:43.883919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:43.883919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:43.883919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:43.883919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:43.883919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:43.883919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:43.883919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:43.883919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:43.889087 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 444/867] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:43 2022] GET /identity/v3/projects/service => generated 88 bytes in 213 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:43.891980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b6f15-5640-4277-8d07-564e74f59976 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:43.892261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13e9d637-c126-4572-b60a-b7c64a6f0873 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:43.914912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:43.943677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6aa32c-c250-4795-b683-c3b364314718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:43.944713 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa32c-c250-4795-b683-c3b364314718 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:43.945049 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa32c-c250-4795-b683-c3b364314718 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:43.945348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab6aa32c-c250-4795-b683-c3b364314718 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:43.946066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6aa32c-c250-4795-b683-c3b364314718 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:43.946678 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6aa32c-c250-4795-b683-c3b364314718 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:43.948885 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab6aa32c-c250-4795-b683-c3b364314718 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:43.955521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 424/868] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 26 18:08:43 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:44.012339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d4b6f15-5640-4277-8d07-564e74f59976 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:44.052640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2dd7c60f-a81e-4691-8f54-60c65d9e0e32 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:44.053351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7c60f-a81e-4691-8f54-60c65d9e0e32 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:44.053702 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7c60f-a81e-4691-8f54-60c65d9e0e32 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:44.053982 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2dd7c60f-a81e-4691-8f54-60c65d9e0e32 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:44.054855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7c60f-a81e-4691-8f54-60c65d9e0e32 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:44.055174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7c60f-a81e-4691-8f54-60c65d9e0e32 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:44.056656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2dd7c60f-a81e-4691-8f54-60c65d9e0e32 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:44.075952 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 445/869] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:43 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:44.077490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6aa32c-c250-4795-b683-c3b364314718 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:44.133945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:44.193447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab6aa32c-c250-4795-b683-c3b364314718 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:44.228752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aee507ee-57c8-4df4-bac1-89fdd053e94e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:44.229772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee507ee-57c8-4df4-bac1-89fdd053e94e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:44.230201 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee507ee-57c8-4df4-bac1-89fdd053e94e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:44.230621 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee507ee-57c8-4df4-bac1-89fdd053e94e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:44.231665 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee507ee-57c8-4df4-bac1-89fdd053e94e None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=9cb21a6eef0e418182b2dd755096ca77) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:44.231982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee507ee-57c8-4df4-bac1-89fdd053e94e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:44.233708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aee507ee-57c8-4df4-bac1-89fdd053e94e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:44.244671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 425/870] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:44 2022] GET /identity/v3/role_assignments?user.id=9cb21a6eef0e418182b2dd755096ca77&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 608 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:45.335054 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca9959-d23c-465d-837c-6a52dfaefd77 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.335590 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca9959-d23c-465d-837c-6a52dfaefd77 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.335590 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56ca9959-d23c-465d-837c-6a52dfaefd77 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:45.337294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 446/871] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:45.342359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cda77-d8ce-412b-b711-905f2e3b9f75 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.343181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cda77-d8ce-412b-b711-905f2e3b9f75 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.343664 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f7cda77-d8ce-412b-b711-905f2e3b9f75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:45.361295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6f7cda77-d8ce-412b-b711-905f2e3b9f75 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:45.362737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6f7cda77-d8ce-412b-b711-905f2e3b9f75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:45.431810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 426/872] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:45 2022] POST /identity/v3/auth/tokens => generated 1151 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:08:45.454651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca9959-d23c-465d-837c-6a52dfaefd77 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:45.541632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:45.565677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56ca9959-d23c-465d-837c-6a52dfaefd77 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:45.600913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89a9e983-f471-469b-8de9-fc80375f8170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:45.601618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9e983-f471-469b-8de9-fc80375f8170 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.601902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9e983-f471-469b-8de9-fc80375f8170 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.602179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89a9e983-f471-469b-8de9-fc80375f8170 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:45.602910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9e983-f471-469b-8de9-fc80375f8170 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:45.604275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89a9e983-f471-469b-8de9-fc80375f8170 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:45.621701 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 447/873] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 26 18:08:45 2022] POST /identity/v3/services => generated 251 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:45.986861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195c77e-d950-4818-b1f9-3c3d36170ff1 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.987653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195c77e-d950-4818-b1f9-3c3d36170ff1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.988135 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5195c77e-d950-4818-b1f9-3c3d36170ff1 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:45.989988 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 427/874] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:45.994885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d70fe6-cfc3-4fe4-886d-f92597acfde5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:45.995184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d70fe6-cfc3-4fe4-886d-f92597acfde5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:45.995462 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65d70fe6-cfc3-4fe4-886d-f92597acfde5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:46.012183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-65d70fe6-cfc3-4fe4-886d-f92597acfde5 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:46.013913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-65d70fe6-cfc3-4fe4-886d-f92597acfde5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:46.099693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 448/875] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:45 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:46.122587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195c77e-d950-4818-b1f9-3c3d36170ff1 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:46.180281 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:46.237270 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5195c77e-d950-4818-b1f9-3c3d36170ff1 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:46.249167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac6cf6-1ea6-41c0-b8e8-fd6a2b036c5e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:46.249758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac6cf6-1ea6-41c0-b8e8-fd6a2b036c5e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:46.250231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ac6cf6-1ea6-41c0-b8e8-fd6a2b036c5e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:46.252125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 449/876] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:08:46.257366 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e7886-0210-4e3d-b737-ca0775caf372 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:46.257888 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e7886-0210-4e3d-b737-ca0775caf372 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:46.258360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404e7886-0210-4e3d-b737-ca0775caf372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:46.273280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26587e-1b73-4cb1-8aab-5d5dac2bef7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:46.274083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26587e-1b73-4cb1-8aab-5d5dac2bef7c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:46.274364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26587e-1b73-4cb1-8aab-5d5dac2bef7c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:46.274638 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd26587e-1b73-4cb1-8aab-5d5dac2bef7c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:46.279809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-404e7886-0210-4e3d-b737-ca0775caf372 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:46.281465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-404e7886-0210-4e3d-b737-ca0775caf372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:46.285444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd26587e-1b73-4cb1-8aab-5d5dac2bef7c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-bd26587e-1b73-4cb1-8aab-5d5dac2bef7c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:46.294024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:46.294950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:46.295765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:46.295765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:46.295765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:46.295765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:46.295765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:46.295765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:46.295765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:46.295765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:46.295765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:46.295765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:46.295765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 18:08:46.295765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:46.295765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 428/877] 10.222.0.64 () {56 vars in 1120 bytes} [Thu May 26 18:08:46 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:46.301942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26587e-1b73-4cb1-8aab-5d5dac2bef7c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:46.350791 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:46.368950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 450/878] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:46 2022] POST /identity/v3/auth/tokens => generated 1252 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:08:46.390768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e7886-0210-4e3d-b737-ca0775caf372 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:46.418276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd26587e-1b73-4cb1-8aab-5d5dac2bef7c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:46.422686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:46.466883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625015d-4a43-45fe-925e-4008ed6d0f7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:46.467896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625015d-4a43-45fe-925e-4008ed6d0f7e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:46.468360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625015d-4a43-45fe-925e-4008ed6d0f7e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:46.468816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2625015d-4a43-45fe-925e-4008ed6d0f7e None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:46.469791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625015d-4a43-45fe-925e-4008ed6d0f7e None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:46.470304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625015d-4a43-45fe-925e-4008ed6d0f7e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:46.471896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2625015d-4a43-45fe-925e-4008ed6d0f7e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:46.485773 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 429/879] 10.222.0.64 () {56 vars in 1115 bytes} [Thu May 26 18:08:46 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:46.486966 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625015d-4a43-45fe-925e-4008ed6d0f7e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:46.525467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404e7886-0210-4e3d-b737-ca0775caf372 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:46.572501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8754c9e7-b57c-48d3-8681-4e57e5b328db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:46.573820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754c9e7-b57c-48d3-8681-4e57e5b328db None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:46.574787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754c9e7-b57c-48d3-8681-4e57e5b328db None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:46.575813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8754c9e7-b57c-48d3-8681-4e57e5b328db None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:46.576944 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754c9e7-b57c-48d3-8681-4e57e5b328db None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:46.579170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8754c9e7-b57c-48d3-8681-4e57e5b328db None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:46.596052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2625015d-4a43-45fe-925e-4008ed6d0f7e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:46.605285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 451/880] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 26 18:08:46 2022] POST /identity/v3/services => generated 269 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:08:46.628922 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b57d51-a066-4238-b401-efd01ce4617a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:46.629251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b57d51-a066-4238-b401-efd01ce4617a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:46.629526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35b57d51-a066-4238-b401-efd01ce4617a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:46.635161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 452/881] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:08:46.637108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2146e-d296-411a-ba5f-ee81b3e2d2d1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:46.637403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2146e-d296-411a-ba5f-ee81b3e2d2d1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:46.638239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bc2146e-d296-411a-ba5f-ee81b3e2d2d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:46.650452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fd629-71ea-408c-911c-0868a0160ebf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:46.651272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fd629-71ea-408c-911c-0868a0160ebf None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:46.651660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fd629-71ea-408c-911c-0868a0160ebf None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:46.651941 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d51fd629-71ea-408c-911c-0868a0160ebf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:46.655986 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1bc2146e-d296-411a-ba5f-ee81b3e2d2d1 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:46.657238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1bc2146e-d296-411a-ba5f-ee81b3e2d2d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:46.663725 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fd629-71ea-408c-911c-0868a0160ebf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:46.665511 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d51fd629-71ea-408c-911c-0868a0160ebf None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-d51fd629-71ea-408c-911c-0868a0160ebf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:46.686502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:46.687466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:46.688322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:46.688322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:46.688322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:46.688322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:46.688322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 430/882] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:46 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:46.695594 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fd629-71ea-408c-911c-0868a0160ebf None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:46.716999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:46.728454 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:46.761373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 453/883] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:46 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:46.777635 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2146e-d296-411a-ba5f-ee81b3e2d2d1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:46.832358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d51fd629-71ea-408c-911c-0868a0160ebf None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:46.878596 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762b7a7-b961-4f37-871a-74141f8dd5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:46.879278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762b7a7-b961-4f37-871a-74141f8dd5d5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:46.879559 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762b7a7-b961-4f37-871a-74141f8dd5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:46.879832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0762b7a7-b961-4f37-871a-74141f8dd5d5 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:46.880552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762b7a7-b961-4f37-871a-74141f8dd5d5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:46.880857 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762b7a7-b961-4f37-871a-74141f8dd5d5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:46.882255 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0762b7a7-b961-4f37-871a-74141f8dd5d5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:46.896324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 431/884] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:46.902736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bc2146e-d296-411a-ba5f-ee81b3e2d2d1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:46.910044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762b7a7-b961-4f37-871a-74141f8dd5d5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:46.940582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b91af-9697-41db-bc39-d7fadb738767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:46.941604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b91af-9697-41db-bc39-d7fadb738767 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:46.941891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b91af-9697-41db-bc39-d7fadb738767 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:46.942282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b6b91af-9697-41db-bc39-d7fadb738767 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:46.943049 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b91af-9697-41db-bc39-d7fadb738767 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:46.944427 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b6b91af-9697-41db-bc39-d7fadb738767 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-8b6b91af-9697-41db-bc39-d7fadb738767 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:46.957202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:46.958200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:46.959034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 454/885] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 26 18:08:46 2022] GET /identity/v3/services/object-store => generated 93 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:46.966389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b91af-9697-41db-bc39-d7fadb738767 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:47.002738 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:47.030466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0762b7a7-b961-4f37-871a-74141f8dd5d5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:47.033719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:47.068186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6ea07-d134-48ad-896c-15f5a9c2d6ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:47.069184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6ea07-d134-48ad-896c-15f5a9c2d6ec None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:47.069563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6ea07-d134-48ad-896c-15f5a9c2d6ec None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:47.069951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c6ea07-d134-48ad-896c-15f5a9c2d6ec None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:47.077715 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6ea07-d134-48ad-896c-15f5a9c2d6ec None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:47.079365 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19c6ea07-d134-48ad-896c-15f5a9c2d6ec None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-19c6ea07-d134-48ad-896c-15f5a9c2d6ec None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:47.096272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:47.097482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:47.098676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:47.098676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:47.098676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:47.098676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:47.098676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:47.098676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:47.098676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:47.098676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:47.098676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 18:08:47.098676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:47.104776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 432/886] 10.222.0.64 () {56 vars in 1117 bytes} [Thu May 26 18:08:46 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:47.104898 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b6b91af-9697-41db-bc39-d7fadb738767 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:47.105592 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6ea07-d134-48ad-896c-15f5a9c2d6ec None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:47.147231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf78844-ae90-4b0b-8b66-226c69d884c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:47.148152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf78844-ae90-4b0b-8b66-226c69d884c4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:47.149058 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf78844-ae90-4b0b-8b66-226c69d884c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:47.149547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cf78844-ae90-4b0b-8b66-226c69d884c4 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:47.150825 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf78844-ae90-4b0b-8b66-226c69d884c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:47.151376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf78844-ae90-4b0b-8b66-226c69d884c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:47.154141 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cf78844-ae90-4b0b-8b66-226c69d884c4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:47.160909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 455/887] 10.222.0.64 () {56 vars in 1122 bytes} [Thu May 26 18:08:46 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:47.166699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf78844-ae90-4b0b-8b66-226c69d884c4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:47.225355 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c6ea07-d134-48ad-896c-15f5a9c2d6ec None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:47.264293 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8ed4d-249b-4f24-ac38-d43fea449db9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:47.265135 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8ed4d-249b-4f24-ac38-d43fea449db9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:47.265537 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8ed4d-249b-4f24-ac38-d43fea449db9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:47.265881 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43a8ed4d-249b-4f24-ac38-d43fea449db9 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:47.266893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8ed4d-249b-4f24-ac38-d43fea449db9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:47.267270 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8ed4d-249b-4f24-ac38-d43fea449db9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:47.268765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43a8ed4d-249b-4f24-ac38-d43fea449db9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:47.270730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:47.278894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cf78844-ae90-4b0b-8b66-226c69d884c4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:47.290479 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 433/888] 10.222.0.64 () {56 vars in 1149 bytes} [Thu May 26 18:08:47 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:47.291916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:47.298198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8ed4d-249b-4f24-ac38-d43fea449db9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:47.315534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c892e3-8332-4b51-aa42-d91f39c42934 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:47.316249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c892e3-8332-4b51-aa42-d91f39c42934 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:47.316528 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c892e3-8332-4b51-aa42-d91f39c42934 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:47.316801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c892e3-8332-4b51-aa42-d91f39c42934 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:47.317546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c892e3-8332-4b51-aa42-d91f39c42934 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:47.317853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c892e3-8332-4b51-aa42-d91f39c42934 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:47.319207 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c892e3-8332-4b51-aa42-d91f39c42934 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:47.324307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 456/889] 10.222.0.64 () {56 vars in 1122 bytes} [Thu May 26 18:08:47 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:47.419179 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43a8ed4d-249b-4f24-ac38-d43fea449db9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:47.457880 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883fdb7-3f96-4115-a05a-ef76e05b89b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:47.458551 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883fdb7-3f96-4115-a05a-ef76e05b89b9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:47.458833 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883fdb7-3f96-4115-a05a-ef76e05b89b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:47.459106 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b883fdb7-3f96-4115-a05a-ef76e05b89b9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:47.524437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:47.537197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883fdb7-3f96-4115-a05a-ef76e05b89b9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:47.538655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b883fdb7-3f96-4115-a05a-ef76e05b89b9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:47.642553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 434/890] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:47 2022] GET /identity/v3/auth/tokens => generated 1362 bytes in 346 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:08:47.649014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c892e3-8332-4b51-aa42-d91f39c42934 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:47.755806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c892e3-8332-4b51-aa42-d91f39c42934 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:47.790648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be19afe4-5d39-4293-9acb-9d72e3357bcb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:47.791802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19afe4-5d39-4293-9acb-9d72e3357bcb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:47.792297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19afe4-5d39-4293-9acb-9d72e3357bcb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:47.792788 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be19afe4-5d39-4293-9acb-9d72e3357bcb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:47.803959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19afe4-5d39-4293-9acb-9d72e3357bcb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:47.805865 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be19afe4-5d39-4293-9acb-9d72e3357bcb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-be19afe4-5d39-4293-9acb-9d72e3357bcb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:47.824007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:47.824979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:47.826542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:47.826542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:47.826542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:47.826542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:47.828800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 457/891] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:47.836627 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883fdb7-3f96-4115-a05a-ef76e05b89b9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:47.913939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680eb93-752b-4479-bf41-86da304b93df None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:47.914570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680eb93-752b-4479-bf41-86da304b93df None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:47.915084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c680eb93-752b-4479-bf41-86da304b93df None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:47.916924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 458/892] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:08:47.921765 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200361cf-eb25-4bef-a60e-0695e189a25e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:47.922053 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200361cf-eb25-4bef-a60e-0695e189a25e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:47.922331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-200361cf-eb25-4bef-a60e-0695e189a25e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:47.933163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:47.941095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-200361cf-eb25-4bef-a60e-0695e189a25e None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:47.942276 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-200361cf-eb25-4bef-a60e-0695e189a25e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:47.943282 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b883fdb7-3f96-4115-a05a-ef76e05b89b9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:47.967517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:47.978518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24539b7-6ee7-4568-ae68-891fc4f8dfb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:47.979191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24539b7-6ee7-4568-ae68-891fc4f8dfb5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:47.979474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24539b7-6ee7-4568-ae68-891fc4f8dfb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:47.979755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b24539b7-6ee7-4568-ae68-891fc4f8dfb5 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:47.980466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24539b7-6ee7-4568-ae68-891fc4f8dfb5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:47.980774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24539b7-6ee7-4568-ae68-891fc4f8dfb5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:47.982214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b24539b7-6ee7-4568-ae68-891fc4f8dfb5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:47.994464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 435/893] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:47.999978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24539b7-6ee7-4568-ae68-891fc4f8dfb5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:48.029026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 459/894] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:47 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:08:48.045416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200361cf-eb25-4bef-a60e-0695e189a25e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:48.114321 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b24539b7-6ee7-4568-ae68-891fc4f8dfb5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:48.149751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-200361cf-eb25-4bef-a60e-0695e189a25e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:48.151545 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbeaa7-431f-479a-8b34-d122e8176c78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:48.152420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbeaa7-431f-479a-8b34-d122e8176c78 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:48.152763 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbeaa7-431f-479a-8b34-d122e8176c78 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:48.153080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7fbeaa7-431f-479a-8b34-d122e8176c78 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:48.160412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbeaa7-431f-479a-8b34-d122e8176c78 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:48.162005 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7fbeaa7-431f-479a-8b34-d122e8176c78 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-f7fbeaa7-431f-479a-8b34-d122e8176c78 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:48.177846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:48.178737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:48.179604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:48.179604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:48.179604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:48.179604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:48.179604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:48.179604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:48.179604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:48.179604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:48.183757 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 436/895] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:47 2022] GET /identity/v3/projects/service => generated 88 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:48.185412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbeaa7-431f-479a-8b34-d122e8176c78 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:48.189374 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94c48a-762b-4e67-b6f9-6f9f7c1f5aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:48.190183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94c48a-762b-4e67-b6f9-6f9f7c1f5aae None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:48.190465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94c48a-762b-4e67-b6f9-6f9f7c1f5aae None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:48.190740 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a94c48a-762b-4e67-b6f9-6f9f7c1f5aae None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:48.191391 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94c48a-762b-4e67-b6f9-6f9f7c1f5aae None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:48.192930 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a94c48a-762b-4e67-b6f9-6f9f7c1f5aae None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:48.201053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5a94c48a-762b-4e67-b6f9-6f9f7c1f5aae None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:48.205128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:48.207389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:48.209222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 460/896] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:08:48 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:48.216092 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94c48a-762b-4e67-b6f9-6f9f7c1f5aae None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:48.245552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:48.310194 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7fbeaa7-431f-479a-8b34-d122e8176c78 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:48.346012 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a94c48a-762b-4e67-b6f9-6f9f7c1f5aae None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:48.347217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf8acc-75e1-4ce3-834a-29290c3f77c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:48.348343 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf8acc-75e1-4ce3-834a-29290c3f77c6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:48.348848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf8acc-75e1-4ce3-834a-29290c3f77c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:48.349345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8faf8acc-75e1-4ce3-834a-29290c3f77c6 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:48.350329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf8acc-75e1-4ce3-834a-29290c3f77c6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:48.350850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf8acc-75e1-4ce3-834a-29290c3f77c6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:48.352479 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8faf8acc-75e1-4ce3-834a-29290c3f77c6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:48.366382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 437/897] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:48.372888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf8acc-75e1-4ce3-834a-29290c3f77c6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:48.389835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95984c-9f79-4f09-9b0a-deb30678810c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:48.390773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95984c-9f79-4f09-9b0a-deb30678810c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:48.391058 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95984c-9f79-4f09-9b0a-deb30678810c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:48.391333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f95984c-9f79-4f09-9b0a-deb30678810c None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:48.392039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95984c-9f79-4f09-9b0a-deb30678810c None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:48.392342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95984c-9f79-4f09-9b0a-deb30678810c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:48.394004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f95984c-9f79-4f09-9b0a-deb30678810c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:48.405066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 461/898] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:08:48 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:48.407187 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95984c-9f79-4f09-9b0a-deb30678810c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:48.467162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:48.507735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8faf8acc-75e1-4ce3-834a-29290c3f77c6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:48.522472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:48.546260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f95984c-9f79-4f09-9b0a-deb30678810c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:48.554080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce2235-3f6a-439a-9710-d64a128e9b36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:48.555279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce2235-3f6a-439a-9710-d64a128e9b36 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:48.555573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce2235-3f6a-439a-9710-d64a128e9b36 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:48.555857 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ce2235-3f6a-439a-9710-d64a128e9b36 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:48.556758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce2235-3f6a-439a-9710-d64a128e9b36 None admin] RBAC: Adding query filter params (role.id=eb196236bdeb4a6f8f5f05fdbee6f00c, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=438d065f5ec6446c824cdc4642c4ec06) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:48.557109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce2235-3f6a-439a-9710-d64a128e9b36 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:48.559049 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ce2235-3f6a-439a-9710-d64a128e9b36 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:48.573125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 438/899] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:48 2022] GET /identity/v3/role_assignments?user.id=438d065f5ec6446c824cdc4642c4ec06&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=eb196236bdeb4a6f8f5f05fdbee6f00c => generated 259 bytes in 196 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:48.588824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed0712-cf4b-4384-8f8e-4894995b50c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:48.589952 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed0712-cf4b-4384-8f8e-4894995b50c7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:48.590492 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed0712-cf4b-4384-8f8e-4894995b50c7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:48.591529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ed0712-cf4b-4384-8f8e-4894995b50c7 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:48.592474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed0712-cf4b-4384-8f8e-4894995b50c7 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:48.593079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed0712-cf4b-4384-8f8e-4894995b50c7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:48.594782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ed0712-cf4b-4384-8f8e-4894995b50c7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:48.605452 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 462/900] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:08:48 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:48.608570 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce2235-3f6a-439a-9710-d64a128e9b36 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:48.725745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ce2235-3f6a-439a-9710-d64a128e9b36 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:48.764027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4661ccae-7623-4ad2-848f-ba9b265fa8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:48.764703 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661ccae-7623-4ad2-848f-ba9b265fa8fc None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:48.765004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661ccae-7623-4ad2-848f-ba9b265fa8fc None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:48.765290 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4661ccae-7623-4ad2-848f-ba9b265fa8fc None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:48.766088 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661ccae-7623-4ad2-848f-ba9b265fa8fc None admin] RBAC: Adding query filter params (interface=public, service_id=af827f5680bd47ebb2b6c3ac20d5c200, region_id=RegionOne) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:48.766402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661ccae-7623-4ad2-848f-ba9b265fa8fc None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:48.767792 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4661ccae-7623-4ad2-848f-ba9b265fa8fc None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:48.773058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:48.777518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 439/901] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 26 18:08:48 2022] GET /identity/v3/endpoints?service_id=af827f5680bd47ebb2b6c3ac20d5c200&interface=public®ion_id=RegionOne => generated 194 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:48.783419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed0712-cf4b-4384-8f8e-4894995b50c7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:48.901845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ed0712-cf4b-4384-8f8e-4894995b50c7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:48.937150 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9534e2d-00ea-4652-af7f-c39530ee6592 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:48.937831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534e2d-00ea-4652-af7f-c39530ee6592 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:48.938114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534e2d-00ea-4652-af7f-c39530ee6592 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:48.938393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9534e2d-00ea-4652-af7f-c39530ee6592 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:48.939075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9534e2d-00ea-4652-af7f-c39530ee6592 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:48.940546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9534e2d-00ea-4652-af7f-c39530ee6592 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:48.946992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 463/902] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 26 18:08:48 2022] GET /identity/v3/services => generated 1268 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:49.004266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde16ee-dfc7-454f-a343-6af4556d57ac None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:49.004563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde16ee-dfc7-454f-a343-6af4556d57ac None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:49.004754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbde16ee-dfc7-454f-a343-6af4556d57ac None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:49.006488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 440/903] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:49.012322 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1736b0-a25e-4e22-b1c6-aa9213982329 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:49.012617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1736b0-a25e-4e22-b1c6-aa9213982329 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:49.013450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1736b0-a25e-4e22-b1c6-aa9213982329 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:49.032013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3c1736b0-a25e-4e22-b1c6-aa9213982329 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:49.033246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3c1736b0-a25e-4e22-b1c6-aa9213982329 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:49.044572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:49.110675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 464/904] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:49.133066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde16ee-dfc7-454f-a343-6af4556d57ac None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:49.252968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbde16ee-dfc7-454f-a343-6af4556d57ac None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:49.288151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ce74c-07dc-4c9a-ba97-9e5e37aafbd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:49.288886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ce74c-07dc-4c9a-ba97-9e5e37aafbd6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:49.289188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ce74c-07dc-4c9a-ba97-9e5e37aafbd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:49.289459 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-203ce74c-07dc-4c9a-ba97-9e5e37aafbd6 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:49.290102 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ce74c-07dc-4c9a-ba97-9e5e37aafbd6 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:49.291491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-203ce74c-07dc-4c9a-ba97-9e5e37aafbd6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-203ce74c-07dc-4c9a-ba97-9e5e37aafbd6 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:49.303868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:49.304808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:49.305651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 441/905] 10.222.0.64 () {56 vars in 1132 bytes} [Thu May 26 18:08:49 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:49.314355 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1736b0-a25e-4e22-b1c6-aa9213982329 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:49.419526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1736b0-a25e-4e22-b1c6-aa9213982329 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:49.458866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aa57118-db3b-48d2-a475-dc07b797229c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:49.459541 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa57118-db3b-48d2-a475-dc07b797229c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:49.459824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa57118-db3b-48d2-a475-dc07b797229c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:49.460103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aa57118-db3b-48d2-a475-dc07b797229c None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:49.460814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa57118-db3b-48d2-a475-dc07b797229c None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:49.461151 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa57118-db3b-48d2-a475-dc07b797229c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:49.462576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aa57118-db3b-48d2-a475-dc07b797229c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:49.468449 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 465/906] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 26 18:08:49 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:49.474006 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ce74c-07dc-4c9a-ba97-9e5e37aafbd6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:49.542737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:49.583486 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-203ce74c-07dc-4c9a-ba97-9e5e37aafbd6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:49.609730 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f055791-1f5f-4eab-a4aa-b22dc786a095 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:49.610064 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f055791-1f5f-4eab-a4aa-b22dc786a095 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:49.610291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f055791-1f5f-4eab-a4aa-b22dc786a095 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:49.611716 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 466/907] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:49.617886 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9275e-76e4-47c2-8294-c1c11a5d1631 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:49.618175 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9275e-76e4-47c2-8294-c1c11a5d1631 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:49.618450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30a9275e-76e4-47c2-8294-c1c11a5d1631 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:49.625150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113f475-0802-4c50-913b-ebe9162e8abb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:49.626110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113f475-0802-4c50-913b-ebe9162e8abb None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:49.626395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113f475-0802-4c50-913b-ebe9162e8abb None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:49.626674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2113f475-0802-4c50-913b-ebe9162e8abb None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:49.627383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113f475-0802-4c50-913b-ebe9162e8abb None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:49.627693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113f475-0802-4c50-913b-ebe9162e8abb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:49.629106 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2113f475-0802-4c50-913b-ebe9162e8abb None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:49.639178 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 442/908] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 26 18:08:49 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:49.640347 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113f475-0802-4c50-913b-ebe9162e8abb None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:49.644881 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-30a9275e-76e4-47c2-8294-c1c11a5d1631 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:49.646318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-30a9275e-76e4-47c2-8294-c1c11a5d1631 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:49.648537 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:49.734602 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 467/909] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:49 2022] POST /identity/v3/auth/tokens => generated 1362 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:08:49.751992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2113f475-0802-4c50-913b-ebe9162e8abb None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:49.760341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9275e-76e4-47c2-8294-c1c11a5d1631 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:49.783698 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:49.792447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29627e3-0350-442a-af9b-4c1aa4a0b772 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:49.793656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29627e3-0350-442a-af9b-4c1aa4a0b772 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:49.794491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29627e3-0350-442a-af9b-4c1aa4a0b772 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:49.794709 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b29627e3-0350-442a-af9b-4c1aa4a0b772 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:49.795775 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29627e3-0350-442a-af9b-4c1aa4a0b772 None admin] RBAC: Adding query filter params (interface=public, service_id=dd9f5ed7c52b4686bcb160d806b6b562, region_id=RegionOne) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:49.796146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29627e3-0350-442a-af9b-4c1aa4a0b772 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:49.797882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b29627e3-0350-442a-af9b-4c1aa4a0b772 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:49.803803 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 443/910] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 26 18:08:49 2022] GET /identity/v3/endpoints?service_id=dd9f5ed7c52b4686bcb160d806b6b562&interface=public®ion_id=RegionOne => generated 194 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:49.813523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29627e3-0350-442a-af9b-4c1aa4a0b772 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:49.873831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30a9275e-76e4-47c2-8294-c1c11a5d1631 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:49.912724 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-255fe7c2-f0c7-4fea-bcbe-ae3937d97b58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:49.914316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fe7c2-f0c7-4fea-bcbe-ae3937d97b58 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:49.914756 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fe7c2-f0c7-4fea-bcbe-ae3937d97b58 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:49.915451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-255fe7c2-f0c7-4fea-bcbe-ae3937d97b58 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:49.916363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fe7c2-f0c7-4fea-bcbe-ae3937d97b58 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:49.918836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-255fe7c2-f0c7-4fea-bcbe-ae3937d97b58 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:49.920443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b29627e3-0350-442a-af9b-4c1aa4a0b772 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:49.932678 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:49.944116 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 468/911] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 26 18:08:49 2022] POST /identity/v3/services => generated 241 bytes in 184 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:08:49.977007 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b964ab7f-5c8a-419a-ba9f-32eff8cd5310 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:49.977996 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964ab7f-5c8a-419a-ba9f-32eff8cd5310 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:49.978439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964ab7f-5c8a-419a-ba9f-32eff8cd5310 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:49.978968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b964ab7f-5c8a-419a-ba9f-32eff8cd5310 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:49.979915 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964ab7f-5c8a-419a-ba9f-32eff8cd5310 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:49.981551 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b964ab7f-5c8a-419a-ba9f-32eff8cd5310 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:49.989800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 444/912] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 26 18:08:49 2022] GET /identity/v3/services => generated 1497 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:50.902249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189e5a9-9ea5-4b11-b717-fbb35f9d1309 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:50.902774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189e5a9-9ea5-4b11-b717-fbb35f9d1309 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:50.902877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b189e5a9-9ea5-4b11-b717-fbb35f9d1309 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:50.905828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 469/913] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:50.911365 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437da999-0ea9-4cce-b758-a9c9cd48602f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:50.911768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437da999-0ea9-4cce-b758-a9c9cd48602f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:50.911933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-437da999-0ea9-4cce-b758-a9c9cd48602f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:50.929767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-437da999-0ea9-4cce-b758-a9c9cd48602f None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:50.930966 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-437da999-0ea9-4cce-b758-a9c9cd48602f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:50.983045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:51.009096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 445/914] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:50 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:51.026810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189e5a9-9ea5-4b11-b717-fbb35f9d1309 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:51.140662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b189e5a9-9ea5-4b11-b717-fbb35f9d1309 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:51.177409 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e767936b-4eb9-4cf8-a95d-28c36bf4e9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:51.180763 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767936b-4eb9-4cf8-a95d-28c36bf4e9bb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:51.180763 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767936b-4eb9-4cf8-a95d-28c36bf4e9bb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:51.180763 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e767936b-4eb9-4cf8-a95d-28c36bf4e9bb None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:51.190773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e767936b-4eb9-4cf8-a95d-28c36bf4e9bb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e767936b-4eb9-4cf8-a95d-28c36bf4e9bb None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:51.199570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:51.201039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:51.201875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:51.201875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:51.201875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:51.201875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:51.201875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:51.201875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:51.201875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:51.201875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:51.201875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:51.201875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:51.201875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 18:08:51.201875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:51.201875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 470/915] 10.222.0.64 () {56 vars in 1120 bytes} [Thu May 26 18:08:51 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 175 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:51.207400 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437da999-0ea9-4cce-b758-a9c9cd48602f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:51.271309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b936c4-a004-48d2-a961-f332e7bcff92 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:51.272148 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b936c4-a004-48d2-a961-f332e7bcff92 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:51.273018 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30b936c4-a004-48d2-a961-f332e7bcff92 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:51.275072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 471/916] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:51.280778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0ab06-f30e-42d9-b8c3-99ad6a4bf792 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:51.281293 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0ab06-f30e-42d9-b8c3-99ad6a4bf792 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:51.281748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3a0ab06-f30e-42d9-b8c3-99ad6a4bf792 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:51.300243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a3a0ab06-f30e-42d9-b8c3-99ad6a4bf792 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:51.301472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a3a0ab06-f30e-42d9-b8c3-99ad6a4bf792 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:51.314885 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-437da999-0ea9-4cce-b758-a9c9cd48602f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:51.353504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e31609-3f3c-4816-911a-391826070ad6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:51.354513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e31609-3f3c-4816-911a-391826070ad6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:51.354992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e31609-3f3c-4816-911a-391826070ad6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:51.355329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e31609-3f3c-4816-911a-391826070ad6 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:51.356078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e31609-3f3c-4816-911a-391826070ad6 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:51.356385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e31609-3f3c-4816-911a-391826070ad6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:51.357812 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e31609-3f3c-4816-911a-391826070ad6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:51.371127 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 446/917] 10.222.0.64 () {56 vars in 1115 bytes} [Thu May 26 18:08:51 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:51.372734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e31609-3f3c-4816-911a-391826070ad6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:51.373243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:51.397181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 472/918] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:51 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:08:51.413566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0ab06-f30e-42d9-b8c3-99ad6a4bf792 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:51.424040 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:51.481866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e31609-3f3c-4816-911a-391826070ad6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:51.528208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c8c62-1c23-4a55-846a-3a46af74e210 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:51.529709 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c8c62-1c23-4a55-846a-3a46af74e210 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:51.530462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c8c62-1c23-4a55-846a-3a46af74e210 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:51.531734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c79c8c62-1c23-4a55-846a-3a46af74e210 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:51.533846 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3a0ab06-f30e-42d9-b8c3-99ad6a4bf792 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:51.546287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c8c62-1c23-4a55-846a-3a46af74e210 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:51.549782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c79c8c62-1c23-4a55-846a-3a46af74e210 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:51.576084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13f321-8087-4868-8b1b-93157a2daaee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:51.576880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13f321-8087-4868-8b1b-93157a2daaee None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:51.577204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13f321-8087-4868-8b1b-93157a2daaee None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:51.577483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db13f321-8087-4868-8b1b-93157a2daaee None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-c79c8c62-1c23-4a55-846a-3a46af74e210 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:51.577797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:51.578652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:51.579555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:51.579555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:51.579555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:51.579555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:51.579783 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13f321-8087-4868-8b1b-93157a2daaee None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:51.579783 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db13f321-8087-4868-8b1b-93157a2daaee None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:51.586835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 447/919] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 211 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:51.588384 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c8c62-1c23-4a55-846a-3a46af74e210 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-db13f321-8087-4868-8b1b-93157a2daaee None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:51.597957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:51.598983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:51.600466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 473/920] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:08:51 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:51.604830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13f321-8087-4868-8b1b-93157a2daaee None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:51.682738 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:51.694461 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:51.701610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c79c8c62-1c23-4a55-846a-3a46af74e210 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:51.738890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92de61-f32b-4117-9392-bcbcbd1ea393 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:51.739474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92de61-f32b-4117-9392-bcbcbd1ea393 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:51.739756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92de61-f32b-4117-9392-bcbcbd1ea393 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:51.740030 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d92de61-f32b-4117-9392-bcbcbd1ea393 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:51.740754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92de61-f32b-4117-9392-bcbcbd1ea393 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:51.741104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92de61-f32b-4117-9392-bcbcbd1ea393 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:51.742477 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d92de61-f32b-4117-9392-bcbcbd1ea393 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:51.750751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db13f321-8087-4868-8b1b-93157a2daaee None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:51.759903 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 448/921] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:51.761890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92de61-f32b-4117-9392-bcbcbd1ea393 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:51.794565 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6948c1-26c6-45b2-826d-6019e8cbcd78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:51.795495 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6948c1-26c6-45b2-826d-6019e8cbcd78 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:51.795782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6948c1-26c6-45b2-826d-6019e8cbcd78 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:51.796060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e6948c1-26c6-45b2-826d-6019e8cbcd78 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:51.797282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6948c1-26c6-45b2-826d-6019e8cbcd78 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:51.797647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6948c1-26c6-45b2-826d-6019e8cbcd78 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:51.799564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e6948c1-26c6-45b2-826d-6019e8cbcd78 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:51.812170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 474/922] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:08:51 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:51.813827 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6948c1-26c6-45b2-826d-6019e8cbcd78 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:51.890062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d92de61-f32b-4117-9392-bcbcbd1ea393 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:51.926038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad51cc2-5aa3-4dbe-b2b4-fd3e6a37c27a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:51.926933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad51cc2-5aa3-4dbe-b2b4-fd3e6a37c27a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:51.927219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad51cc2-5aa3-4dbe-b2b4-fd3e6a37c27a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:51.927498 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad51cc2-5aa3-4dbe-b2b4-fd3e6a37c27a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:51.936625 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad51cc2-5aa3-4dbe-b2b4-fd3e6a37c27a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:51.938287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad51cc2-5aa3-4dbe-b2b4-fd3e6a37c27a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:51.953893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e6948c1-26c6-45b2-826d-6019e8cbcd78 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5ad51cc2-5aa3-4dbe-b2b4-fd3e6a37c27a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:51.954416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:51.955284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:51.956704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:51.956704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:51.956704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:51.956704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:51.956704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:51.956704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:51.956704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:51.956704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:51.956704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 18:08:51.956704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:51.959876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 449/923] 10.222.0.64 () {56 vars in 1117 bytes} [Thu May 26 18:08:51 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:51.961105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad51cc2-5aa3-4dbe-b2b4-fd3e6a37c27a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:51.980439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:51.981047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:52.007387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5f3fe-ebb9-4477-8f97-448fc0161068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:52.008877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5f3fe-ebb9-4477-8f97-448fc0161068 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.009416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5f3fe-ebb9-4477-8f97-448fc0161068 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.009912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece5f3fe-ebb9-4477-8f97-448fc0161068 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.011173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5f3fe-ebb9-4477-8f97-448fc0161068 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:52.012011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5f3fe-ebb9-4477-8f97-448fc0161068 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:52.014007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece5f3fe-ebb9-4477-8f97-448fc0161068 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:52.026691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 475/924] 10.222.0.64 () {56 vars in 1114 bytes} [Thu May 26 18:08:51 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:52.028773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5f3fe-ebb9-4477-8f97-448fc0161068 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:52.081785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad51cc2-5aa3-4dbe-b2b4-fd3e6a37c27a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:52.122300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b7f1f-49f6-446d-a322-f8dea6663497 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:52.123677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b7f1f-49f6-446d-a322-f8dea6663497 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.124185 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b7f1f-49f6-446d-a322-f8dea6663497 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.124944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de5b7f1f-49f6-446d-a322-f8dea6663497 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.126920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b7f1f-49f6-446d-a322-f8dea6663497 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:52.127452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b7f1f-49f6-446d-a322-f8dea6663497 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:52.129220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de5b7f1f-49f6-446d-a322-f8dea6663497 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:52.163747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece5f3fe-ebb9-4477-8f97-448fc0161068 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:52.164138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 450/925] 10.222.0.64 () {56 vars in 1149 bytes} [Thu May 26 18:08:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:52.170902 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b7f1f-49f6-446d-a322-f8dea6663497 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:52.205160 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-502f8131-f9c0-47aa-8647-955a7a6f506b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:52.205903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8131-f9c0-47aa-8647-955a7a6f506b None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.206188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8131-f9c0-47aa-8647-955a7a6f506b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.206520 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-502f8131-f9c0-47aa-8647-955a7a6f506b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.207265 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f8131-f9c0-47aa-8647-955a7a6f506b None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:52.208691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-502f8131-f9c0-47aa-8647-955a7a6f506b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:52.231452 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 476/926] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 26 18:08:52 2022] POST /identity/v3/endpoints => generated 346 bytes in 204 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:08:52.232760 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71933fa9-0998-42e9-ac9e-b276223a04a7 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.233095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71933fa9-0998-42e9-ac9e-b276223a04a7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.233632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71933fa9-0998-42e9-ac9e-b276223a04a7 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.235149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 477/927] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:52.242859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aecc5f-b42d-45cc-8ce6-476862422f38 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.243197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aecc5f-b42d-45cc-8ce6-476862422f38 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.243484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71aecc5f-b42d-45cc-8ce6-476862422f38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.258687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:52.262502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-71aecc5f-b42d-45cc-8ce6-476862422f38 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:52.264348 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-71aecc5f-b42d-45cc-8ce6-476862422f38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:52.287716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de5b7f1f-49f6-446d-a322-f8dea6663497 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:52.297928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:52.340974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c2fae-e3b1-4b92-b49a-3c9420e02552 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:52.341809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c2fae-e3b1-4b92-b49a-3c9420e02552 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.342216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c2fae-e3b1-4b92-b49a-3c9420e02552 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.342469 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d86c2fae-e3b1-4b92-b49a-3c9420e02552 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.357007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 478/928] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:08:52.357007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7425b30-67e1-4ebf-a1d3-62201194d907 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.357007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7425b30-67e1-4ebf-a1d3-62201194d907 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.357007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7425b30-67e1-4ebf-a1d3-62201194d907 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.357007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 479/929] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:52.357475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c2fae-e3b1-4b92-b49a-3c9420e02552 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:52.357475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d86c2fae-e3b1-4b92-b49a-3c9420e02552 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:52.358670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45860ece-bcdd-46df-a65a-2b9974d77f66 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.358956 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45860ece-bcdd-46df-a65a-2b9974d77f66 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.359232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45860ece-bcdd-46df-a65a-2b9974d77f66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-d86c2fae-e3b1-4b92-b49a-3c9420e02552 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:52.380562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:52.381628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:52.387559 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:52.387559 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:52.387559 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:52.387559 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:52.387559 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 451/930] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:52.387559 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c2fae-e3b1-4b92-b49a-3c9420e02552 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:52.388518 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-45860ece-bcdd-46df-a65a-2b9974d77f66 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:52.391333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-45860ece-bcdd-46df-a65a-2b9974d77f66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:52.471362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 480/931] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:52 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:08:52.472205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45860ece-bcdd-46df-a65a-2b9974d77f66 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:52.500506 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d86c2fae-e3b1-4b92-b49a-3c9420e02552 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:52.524866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:52.538402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfc1c0-304a-4f58-8b7e-28f1a429e44c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:52.539204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc1c0-304a-4f58-8b7e-28f1a429e44c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.539491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc1c0-304a-4f58-8b7e-28f1a429e44c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.539769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cfc1c0-304a-4f58-8b7e-28f1a429e44c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.540422 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfc1c0-304a-4f58-8b7e-28f1a429e44c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:52.541832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cfc1c0-304a-4f58-8b7e-28f1a429e44c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-66cfc1c0-304a-4f58-8b7e-28f1a429e44c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:52.554134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:52.555138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:52.561767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 452/932] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 26 18:08:52 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:52.562576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfc1c0-304a-4f58-8b7e-28f1a429e44c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:52.584515 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:52.591522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45860ece-bcdd-46df-a65a-2b9974d77f66 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:52.627914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2b09b-ff2e-4aaf-b78a-f8ac0bab538c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:52.628575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2b09b-ff2e-4aaf-b78a-f8ac0bab538c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.628855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2b09b-ff2e-4aaf-b78a-f8ac0bab538c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.629158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e2b09b-ff2e-4aaf-b78a-f8ac0bab538c None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.630030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2b09b-ff2e-4aaf-b78a-f8ac0bab538c None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:52.630331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2b09b-ff2e-4aaf-b78a-f8ac0bab538c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:52.632184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7e2b09b-ff2e-4aaf-b78a-f8ac0bab538c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:52.644729 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 481/933] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:52.645451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2b09b-ff2e-4aaf-b78a-f8ac0bab538c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:52.672559 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cfc1c0-304a-4f58-8b7e-28f1a429e44c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:52.710969 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f131e6-6370-4a25-a599-6c957852f9ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:52.711792 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f131e6-6370-4a25-a599-6c957852f9ae None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.712078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f131e6-6370-4a25-a599-6c957852f9ae None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.712352 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0f131e6-6370-4a25-a599-6c957852f9ae None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.713003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f131e6-6370-4a25-a599-6c957852f9ae None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:52.714647 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0f131e6-6370-4a25-a599-6c957852f9ae None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-b0f131e6-6370-4a25-a599-6c957852f9ae None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:52.727399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:52.728547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:52.729610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 453/934] 10.222.0.64 () {56 vars in 1132 bytes} [Thu May 26 18:08:52 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:52.730438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f131e6-6370-4a25-a599-6c957852f9ae None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:52.755407 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e2b09b-ff2e-4aaf-b78a-f8ac0bab538c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:52.784357 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:52.793790 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbbed8-c2a7-4daf-bda5-a9ea30576060 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:52.795096 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbbed8-c2a7-4daf-bda5-a9ea30576060 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.795732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbbed8-c2a7-4daf-bda5-a9ea30576060 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.795732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60fbbed8-c2a7-4daf-bda5-a9ea30576060 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.796693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbbed8-c2a7-4daf-bda5-a9ea30576060 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:52.796979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbbed8-c2a7-4daf-bda5-a9ea30576060 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:52.798427 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60fbbed8-c2a7-4daf-bda5-a9ea30576060 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:52.803702 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 482/935] 10.222.0.64 () {56 vars in 1122 bytes} [Thu May 26 18:08:52 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:52.804610 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbbed8-c2a7-4daf-bda5-a9ea30576060 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:52.827863 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:52.843490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0f131e6-6370-4a25-a599-6c957852f9ae None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:52.880163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86222eba-1112-4f38-a2c6-7450755963de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:52.880958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222eba-1112-4f38-a2c6-7450755963de None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.881272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222eba-1112-4f38-a2c6-7450755963de None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.881552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86222eba-1112-4f38-a2c6-7450755963de None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.889521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86222eba-1112-4f38-a2c6-7450755963de None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:52.890980 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86222eba-1112-4f38-a2c6-7450755963de None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-86222eba-1112-4f38-a2c6-7450755963de None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:52.905110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:52.906166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:52.907062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:52.907062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:52.907062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:52.907062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:52.907062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:52.907062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:52.907062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:52.907062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:52.907062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 454/936] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 177 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:52.907547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86222eba-1112-4f38-a2c6-7450755963de None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:52.913280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60fbbed8-c2a7-4daf-bda5-a9ea30576060 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:52.950347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c315113-868b-439e-97a6-128389c36022 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:52.951016 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315113-868b-439e-97a6-128389c36022 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:52.951300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315113-868b-439e-97a6-128389c36022 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:52.951574 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c315113-868b-439e-97a6-128389c36022 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:52.952347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c315113-868b-439e-97a6-128389c36022 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:52.952580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c315113-868b-439e-97a6-128389c36022 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:52.953988 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c315113-868b-439e-97a6-128389c36022 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:52.963337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 483/937] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 26 18:08:52 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:52.963337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c315113-868b-439e-97a6-128389c36022 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:53.019843 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86222eba-1112-4f38-a2c6-7450755963de None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:53.032613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:53.058780 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158021d-63c9-4b2b-9f6b-5222bbc22446 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:53.059354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158021d-63c9-4b2b-9f6b-5222bbc22446 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:53.059672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158021d-63c9-4b2b-9f6b-5222bbc22446 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:53.059950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f158021d-63c9-4b2b-9f6b-5222bbc22446 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:53.060656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158021d-63c9-4b2b-9f6b-5222bbc22446 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:53.060965 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158021d-63c9-4b2b-9f6b-5222bbc22446 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:53.062415 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f158021d-63c9-4b2b-9f6b-5222bbc22446 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:53.063353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:53.067723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 455/938] 10.222.0.64 () {56 vars in 1122 bytes} [Thu May 26 18:08:52 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:53.070664 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158021d-63c9-4b2b-9f6b-5222bbc22446 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:53.081748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c315113-868b-439e-97a6-128389c36022 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:53.118271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fa556-414e-4658-989b-929e0dd9717f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:53.118938 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fa556-414e-4658-989b-929e0dd9717f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:53.119219 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fa556-414e-4658-989b-929e0dd9717f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:53.119493 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-816fa556-414e-4658-989b-929e0dd9717f None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:53.120273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fa556-414e-4658-989b-929e0dd9717f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:53.120584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fa556-414e-4658-989b-929e0dd9717f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:53.122044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-816fa556-414e-4658-989b-929e0dd9717f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:53.135019 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 484/939] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:53.136381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fa556-414e-4658-989b-929e0dd9717f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:53.183675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f158021d-63c9-4b2b-9f6b-5222bbc22446 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:53.218379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6a386-afaf-4179-9df9-973e5e84b343 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:53.219046 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6a386-afaf-4179-9df9-973e5e84b343 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:53.219336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6a386-afaf-4179-9df9-973e5e84b343 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:53.219617 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a6a386-afaf-4179-9df9-973e5e84b343 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:53.220322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6a386-afaf-4179-9df9-973e5e84b343 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:53.220636 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6a386-afaf-4179-9df9-973e5e84b343 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:53.222038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36a6a386-afaf-4179-9df9-973e5e84b343 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:53.231376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 456/940] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 26 18:08:53 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:53.231376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6a386-afaf-4179-9df9-973e5e84b343 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:53.252867 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-816fa556-414e-4658-989b-929e0dd9717f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:53.266409 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:53.291382 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734c7da-5462-4fb6-b6b2-a4970c39a207 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:53.292199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c7da-5462-4fb6-b6b2-a4970c39a207 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:53.292588 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c7da-5462-4fb6-b6b2-a4970c39a207 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:53.292944 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e734c7da-5462-4fb6-b6b2-a4970c39a207 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:53.293822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734c7da-5462-4fb6-b6b2-a4970c39a207 None admin] RBAC: Adding query filter params (interface=public, service_id=d8cc88fb1228410ca71f9bcef46606e1, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:53.294249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734c7da-5462-4fb6-b6b2-a4970c39a207 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:53.295619 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e734c7da-5462-4fb6-b6b2-a4970c39a207 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:53.301604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 485/941] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 26 18:08:53 2022] GET /identity/v3/endpoints?service_id=d8cc88fb1228410ca71f9bcef46606e1&interface=public®ion_id=RegionOne => generated 194 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:53.302363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734c7da-5462-4fb6-b6b2-a4970c39a207 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:53.317209 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:53.332536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a6a386-afaf-4179-9df9-973e5e84b343 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:53.370078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad02423-d211-4324-8c2f-8dd751b511c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:53.371035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad02423-d211-4324-8c2f-8dd751b511c8 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:53.371399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad02423-d211-4324-8c2f-8dd751b511c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:53.371722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ad02423-d211-4324-8c2f-8dd751b511c8 None admin] PATH_INFO: `/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/438d065f5ec6446c824cdc4642c4ec06/roles/eb196236bdeb4a6f8f5f05fdbee6f00c` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:53.374525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad02423-d211-4324-8c2f-8dd751b511c8 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab7fe8d932964e7ab1f442f26ef0735b, user_id=438d065f5ec6446c824cdc4642c4ec06, role_id=eb196236bdeb4a6f8f5f05fdbee6f00c)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:53.376050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ad02423-d211-4324-8c2f-8dd751b511c8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:53.400105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 457/942] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:08:53 2022] PUT /identity/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/438d065f5ec6446c824cdc4642c4ec06/roles/eb196236bdeb4a6f8f5f05fdbee6f00c => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:08:53.409020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad02423-d211-4324-8c2f-8dd751b511c8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:53.422890 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e734c7da-5462-4fb6-b6b2-a4970c39a207 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:53.465179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd071a23-312c-4338-9093-63fcee706274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:53.466345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd071a23-312c-4338-9093-63fcee706274 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:53.466706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd071a23-312c-4338-9093-63fcee706274 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:53.467054 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd071a23-312c-4338-9093-63fcee706274 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:53.467893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd071a23-312c-4338-9093-63fcee706274 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:53.469659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd071a23-312c-4338-9093-63fcee706274 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:53.500497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 486/943] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 26 18:08:53 2022] POST /identity/v3/endpoints => generated 347 bytes in 198 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:53.548769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:53.553475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ad02423-d211-4324-8c2f-8dd751b511c8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:53.605481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee9d12-5c3c-4dde-83a1-f117d5cbd153 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:53.606075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee9d12-5c3c-4dde-83a1-f117d5cbd153 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:53.606355 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee9d12-5c3c-4dde-83a1-f117d5cbd153 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:53.607162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee9d12-5c3c-4dde-83a1-f117d5cbd153 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:53.607899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee9d12-5c3c-4dde-83a1-f117d5cbd153 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:53.609598 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee9d12-5c3c-4dde-83a1-f117d5cbd153 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:53.616663 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 458/944] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 26 18:08:53 2022] GET /identity/v3/services => generated 1497 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:08:54.485465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856582b6-0603-40fc-a83d-f4406cb43038 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:54.485961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856582b6-0603-40fc-a83d-f4406cb43038 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:54.485961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-856582b6-0603-40fc-a83d-f4406cb43038 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:54.487526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 487/945] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:54.492788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000ec1-c511-4b25-8b63-c776503aff28 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:54.493375 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000ec1-c511-4b25-8b63-c776503aff28 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:54.493375 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7000ec1-c511-4b25-8b63-c776503aff28 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:54.510841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c7000ec1-c511-4b25-8b63-c776503aff28 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:54.511659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c7000ec1-c511-4b25-8b63-c776503aff28 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:54.582812 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 459/946] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:54 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:08:54.605750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856582b6-0603-40fc-a83d-f4406cb43038 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:54.671362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:54.713181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-856582b6-0603-40fc-a83d-f4406cb43038 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:54.748646 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d1f28-7ad7-469f-8760-40206572a197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:54.749258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d1f28-7ad7-469f-8760-40206572a197 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:54.749538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d1f28-7ad7-469f-8760-40206572a197 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:54.749812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-959d1f28-7ad7-469f-8760-40206572a197 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:54.750526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d1f28-7ad7-469f-8760-40206572a197 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:54.752020 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-959d1f28-7ad7-469f-8760-40206572a197 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:54.753477 dv-cinder-843493-1-smb devstack@keystone.service[80231]: WARNING keystone.server.flask.common [None req-959d1f28-7ad7-469f-8760-40206572a197 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. May 26 18:08:54.774559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.sql.core [None req-959d1f28-7ad7-469f-8760-40206572a197 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 18:08:54.774559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 18:08:54.774559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [parameters: {'id': 'bc11fdbccf2d4ce08f4c3d9d32dec603', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 18:08:54.774559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80231) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 18:08:54.791778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-959d1f28-7ad7-469f-8760-40206572a197 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc11fdbccf2d4ce08f4c3d9d32dec603.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc11fdbccf2d4ce08f4c3d9d32dec603. May 26 18:08:54.791778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:54.791778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 18:08:54.791778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 18:08:54.791778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 18:08:54.791778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 18:08:54.791778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 18:08:54.791778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) May 26 18:08:54.791778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 18:08:54.791778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) May 26 18:08:54.791778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 18:08:54.791778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 18:08:54.791778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project May 26 18:08:54.793878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return project_ref.to_dict() May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application yield resource May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.rollback() May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.force_reraise() May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise self.value May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application session.commit() May 26 18:08:54.796373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._prepare_impl() May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.flush() May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._flush(objects) May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application compat.raise_( May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application flush_context.execute() May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 18:08:54.801324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rec.execute(self) May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application c = connection._execute_20( May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 18:08:54.802226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 18:08:54.802998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [parameters: {'id': 'bc11fdbccf2d4ce08f4c3d9d32dec603', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:54.803843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:54.804771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:54.805758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:54.805758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post May 26 18:08:54.805758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( May 26 18:08:54.805758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:54.805758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:54.805758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project May 26 18:08:54.805758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.Conflict( May 26 18:08:54.805758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id bc11fdbccf2d4ce08f4c3d9d32dec603. May 26 18:08:54.805758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:54.805758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 488/947] 10.222.0.64 () {60 vars in 1140 bytes} [Thu May 26 18:08:54 2022] POST /identity/v3/projects => generated 262 bytes in 188 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:54.807342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7000ec1-c511-4b25-8b63-c776503aff28 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:54.899811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:54.912272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7000ec1-c511-4b25-8b63-c776503aff28 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:54.949007 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9797ae7-2cf2-42a5-9892-4702f8ebb710 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:54.949965 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9797ae7-2cf2-42a5-9892-4702f8ebb710 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:54.950793 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9797ae7-2cf2-42a5-9892-4702f8ebb710 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:54.951141 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9797ae7-2cf2-42a5-9892-4702f8ebb710 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:54.958051 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9797ae7-2cf2-42a5-9892-4702f8ebb710 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:54.959490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9797ae7-2cf2-42a5-9892-4702f8ebb710 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-f9797ae7-2cf2-42a5-9892-4702f8ebb710 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:54.973727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:54.974641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:54.975505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:54.975505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:54.975505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:54.975505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:54.975505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:54.975505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:54.975505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:54.975505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:54.975505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 460/948] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 168 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:54.982254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d1f28-7ad7-469f-8760-40206572a197 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:55.089903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-959d1f28-7ad7-469f-8760-40206572a197 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:55.112906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:55.128274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48f4b934-8df4-49cc-8ea4-f7709de7aaa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:55.129333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4b934-8df4-49cc-8ea4-f7709de7aaa5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:55.129825 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4b934-8df4-49cc-8ea4-f7709de7aaa5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:55.130277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48f4b934-8df4-49cc-8ea4-f7709de7aaa5 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:55.131197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4b934-8df4-49cc-8ea4-f7709de7aaa5 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:55.131665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4b934-8df4-49cc-8ea4-f7709de7aaa5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:55.133621 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48f4b934-8df4-49cc-8ea4-f7709de7aaa5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:55.158755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 489/949] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 26 18:08:54 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:55.718325 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6eb023-b18a-46b4-bab1-636782f89a96 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:55.718893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6eb023-b18a-46b4-bab1-636782f89a96 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:55.718893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6eb023-b18a-46b4-bab1-636782f89a96 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:55.720628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 461/950] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:55.726618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce723e5c-de48-40f2-81ee-c0f626f492d1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:55.727166 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce723e5c-de48-40f2-81ee-c0f626f492d1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:55.727166 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce723e5c-de48-40f2-81ee-c0f626f492d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:55.745586 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ce723e5c-de48-40f2-81ee-c0f626f492d1 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:55.747147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ce723e5c-de48-40f2-81ee-c0f626f492d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:55.815357 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 490/951] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:55.823589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033af6b1-57e5-4ff7-ae40-411c6afda907 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:55.823883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033af6b1-57e5-4ff7-ae40-411c6afda907 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:55.824170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-033af6b1-57e5-4ff7-ae40-411c6afda907 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:55.826237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 462/952] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:55.831313 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b55bdc-261c-42a2-9911-60279a0dc3dc None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:55.831608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b55bdc-261c-42a2-9911-60279a0dc3dc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:55.831894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45b55bdc-261c-42a2-9911-60279a0dc3dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:55.843775 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033af6b1-57e5-4ff7-ae40-411c6afda907 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:55.849173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-45b55bdc-261c-42a2-9911-60279a0dc3dc None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:55.850350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-45b55bdc-261c-42a2-9911-60279a0dc3dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:55.922090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 491/953] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:55.930654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432e37-c990-417e-8075-67457bcac5d4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:55.930946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432e37-c990-417e-8075-67457bcac5d4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:55.931227 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf432e37-c990-417e-8075-67457bcac5d4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:55.937109 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 492/954] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:55 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:55.938700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c2263-31ad-4a18-bc75-b7b03a98e238 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:55.939318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c2263-31ad-4a18-bc75-b7b03a98e238 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:55.939806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-742c2263-31ad-4a18-bc75-b7b03a98e238 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:55.956970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-742c2263-31ad-4a18-bc75-b7b03a98e238 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:55.958178 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-742c2263-31ad-4a18-bc75-b7b03a98e238 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:55.967159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-033af6b1-57e5-4ff7-ae40-411c6afda907 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:55.994924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:56.007218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395007e-a112-4c25-a9f5-8718f201eb5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.007929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395007e-a112-4c25-a9f5-8718f201eb5c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.008210 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395007e-a112-4c25-a9f5-8718f201eb5c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.008484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9395007e-a112-4c25-a9f5-8718f201eb5c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.020519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9395007e-a112-4c25-a9f5-8718f201eb5c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-9395007e-a112-4c25-a9f5-8718f201eb5c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:08:56.028635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:56.029774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:56.038197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:56.038197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:56.038197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:56.038197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:56.038197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:08:56.038197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:08:56.038197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:08:56.038197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:08:56.038197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:08:56.038197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:08:56.038197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 18:08:56.038197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:56.038197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 463/955] 10.222.0.64 () {56 vars in 1120 bytes} [Thu May 26 18:08:55 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:56.038919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 493/956] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:55 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:08:56.039002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395007e-a112-4c25-a9f5-8718f201eb5c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.041945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c2263-31ad-4a18-bc75-b7b03a98e238 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.044625 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:56.145314 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9395007e-a112-4c25-a9f5-8718f201eb5c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.152217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-742c2263-31ad-4a18-bc75-b7b03a98e238 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.184122 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f71af-b4f9-496c-afff-a767b3151283 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.185462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f71af-b4f9-496c-afff-a767b3151283 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.185762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f71af-b4f9-496c-afff-a767b3151283 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.186025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a02f71af-b4f9-496c-afff-a767b3151283 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.186743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f71af-b4f9-496c-afff-a767b3151283 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.187899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4722e-d807-4e66-b96e-77d75edb7258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.188280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a02f71af-b4f9-496c-afff-a767b3151283 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.188569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4722e-d807-4e66-b96e-77d75edb7258 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.188853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4722e-d807-4e66-b96e-77d75edb7258 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.189162 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d4722e-d807-4e66-b96e-77d75edb7258 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.189903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4722e-d807-4e66-b96e-77d75edb7258 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:56.190217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4722e-d807-4e66-b96e-77d75edb7258 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.191561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d4722e-d807-4e66-b96e-77d75edb7258 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.199777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 494/957] 10.222.0.64 () {56 vars in 1115 bytes} [Thu May 26 18:08:56 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:56.201188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4722e-d807-4e66-b96e-77d75edb7258 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-a02f71af-b4f9-496c-afff-a767b3151283 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:56.203018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:56.204065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:56.210118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 464/958] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:56 2022] GET /identity/v3/services/compute => generated 88 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:56.211001 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f71af-b4f9-496c-afff-a767b3151283 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.239057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:56.286760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:56.317566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d4722e-d807-4e66-b96e-77d75edb7258 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.317765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a02f71af-b4f9-496c-afff-a767b3151283 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.354751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bde83f-6325-4fdf-80e1-56010fb86886 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.355555 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bde83f-6325-4fdf-80e1-56010fb86886 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.355839 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bde83f-6325-4fdf-80e1-56010fb86886 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.356115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2bde83f-6325-4fdf-80e1-56010fb86886 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.356814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bde83f-6325-4fdf-80e1-56010fb86886 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.358197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2bde83f-6325-4fdf-80e1-56010fb86886 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.362860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a1445-f78a-4691-904e-34a4ffbc106a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.363649 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a1445-f78a-4691-904e-34a4ffbc106a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.363928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a1445-f78a-4691-904e-34a4ffbc106a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.364206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-051a1445-f78a-4691-904e-34a4ffbc106a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d2bde83f-6325-4fdf-80e1-56010fb86886 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:56.371188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:56.372880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:56.373816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 495/959] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 26 18:08:56 2022] GET /identity/v3/services/object-store => generated 93 bytes in 173 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:56.375053 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bde83f-6325-4fdf-80e1-56010fb86886 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.380389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a1445-f78a-4691-904e-34a4ffbc106a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.381877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-051a1445-f78a-4691-904e-34a4ffbc106a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-051a1445-f78a-4691-904e-34a4ffbc106a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:56.401401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:56.402326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:56.403189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:56.403189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:56.403189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:56.403189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:56.403189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 465/960] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:56 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:56.404065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a1445-f78a-4691-904e-34a4ffbc106a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.498497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:56.504719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2bde83f-6325-4fdf-80e1-56010fb86886 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.516967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-051a1445-f78a-4691-904e-34a4ffbc106a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.539591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1dff3-40d2-4408-803b-f80b61122fb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.540189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1dff3-40d2-4408-803b-f80b61122fb6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.540469 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1dff3-40d2-4408-803b-f80b61122fb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.540744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ce1dff3-40d2-4408-803b-f80b61122fb6 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.541582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1dff3-40d2-4408-803b-f80b61122fb6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:56.541887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1dff3-40d2-4408-803b-f80b61122fb6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.542425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:56.544677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ce1dff3-40d2-4408-803b-f80b61122fb6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.555175 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 496/961] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 26 18:08:56 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:56.555175 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1dff3-40d2-4408-803b-f80b61122fb6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.558527 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0778624-03d8-43cc-a8ad-f2fe81a02345 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.559187 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0778624-03d8-43cc-a8ad-f2fe81a02345 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.559468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0778624-03d8-43cc-a8ad-f2fe81a02345 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.560304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0778624-03d8-43cc-a8ad-f2fe81a02345 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.561092 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0778624-03d8-43cc-a8ad-f2fe81a02345 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:56.561407 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0778624-03d8-43cc-a8ad-f2fe81a02345 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.562775 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0778624-03d8-43cc-a8ad-f2fe81a02345 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.572458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 466/962] 10.222.0.64 () {56 vars in 1122 bytes} [Thu May 26 18:08:56 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:56.572458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0778624-03d8-43cc-a8ad-f2fe81a02345 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.660259 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ce1dff3-40d2-4408-803b-f80b61122fb6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.672081 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0778624-03d8-43cc-a8ad-f2fe81a02345 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.696278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7669dd2-c4ed-465a-8eb7-9e0bf40714b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.696933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7669dd2-c4ed-465a-8eb7-9e0bf40714b1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.697350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7669dd2-c4ed-465a-8eb7-9e0bf40714b1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.697621 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7669dd2-c4ed-465a-8eb7-9e0bf40714b1 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.698441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7669dd2-c4ed-465a-8eb7-9e0bf40714b1 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:56.698745 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7669dd2-c4ed-465a-8eb7-9e0bf40714b1 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.700088 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7669dd2-c4ed-465a-8eb7-9e0bf40714b1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.705623 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573a8a3-c305-4cb2-a6e9-f6581cbac4df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.706282 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573a8a3-c305-4cb2-a6e9-f6581cbac4df None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.706567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573a8a3-c305-4cb2-a6e9-f6581cbac4df None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.706914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c573a8a3-c305-4cb2-a6e9-f6581cbac4df None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.707540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573a8a3-c305-4cb2-a6e9-f6581cbac4df None admin] RBAC: Adding query filter params (type=compute) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:56.707849 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573a8a3-c305-4cb2-a6e9-f6581cbac4df None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.709358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c573a8a3-c305-4cb2-a6e9-f6581cbac4df None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.712264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 497/963] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:56 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:56.717182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7669dd2-c4ed-465a-8eb7-9e0bf40714b1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.717266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 467/964] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 26 18:08:56 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:56.717941 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573a8a3-c305-4cb2-a6e9-f6581cbac4df None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.759798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:56.799590 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:56.861859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7669dd2-c4ed-465a-8eb7-9e0bf40714b1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.874322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c573a8a3-c305-4cb2-a6e9-f6581cbac4df None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:56.901822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036a835-3522-47e3-9e53-7e4886d63413 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.902671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036a835-3522-47e3-9e53-7e4886d63413 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.903053 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036a835-3522-47e3-9e53-7e4886d63413 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.903965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0036a835-3522-47e3-9e53-7e4886d63413 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.904790 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036a835-3522-47e3-9e53-7e4886d63413 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:56.905229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036a835-3522-47e3-9e53-7e4886d63413 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.906730 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0036a835-3522-47e3-9e53-7e4886d63413 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.914440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 498/965] 10.222.0.64 () {56 vars in 1122 bytes} [Thu May 26 18:08:56 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:56.918709 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f93f05-2f70-4581-9d18-f699a2f6ee1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:56.920094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f93f05-2f70-4581-9d18-f699a2f6ee1a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:56.920377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f93f05-2f70-4581-9d18-f699a2f6ee1a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:56.920650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f93f05-2f70-4581-9d18-f699a2f6ee1a None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:56.921476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036a835-3522-47e3-9e53-7e4886d63413 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:56.932482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f93f05-2f70-4581-9d18-f699a2f6ee1a None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:56.933516 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72f93f05-2f70-4581-9d18-f699a2f6ee1a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-72f93f05-2f70-4581-9d18-f699a2f6ee1a None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:56.953589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:56.954607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:56.955764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:56.955764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:56.955764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:56.955764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:56.955764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:56.955764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:56.955764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:56.955764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:56.955764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. May 26 18:08:56.955764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:56.955764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 468/966] 10.222.0.64 () {56 vars in 1117 bytes} [Thu May 26 18:08:56 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 237 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:56.961061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f93f05-2f70-4581-9d18-f699a2f6ee1a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:57.029695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:57.051377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0036a835-3522-47e3-9e53-7e4886d63413 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:57.095108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72f93f05-2f70-4581-9d18-f699a2f6ee1a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:57.096251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eed5a8-5610-4561-aec4-499b9d77f0ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:57.097149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eed5a8-5610-4561-aec4-499b9d77f0ce None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.097581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eed5a8-5610-4561-aec4-499b9d77f0ce None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.098006 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1eed5a8-5610-4561-aec4-499b9d77f0ce None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.098890 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eed5a8-5610-4561-aec4-499b9d77f0ce None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:57.100403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1eed5a8-5610-4561-aec4-499b9d77f0ce None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:57.110205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:57.137245 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 499/967] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 26 18:08:56 2022] POST /identity/v3/endpoints => generated 349 bytes in 209 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:57.154219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89ba89e-7c00-42f8-ad98-951c8f8b3c4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:57.154976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ba89e-7c00-42f8-ad98-951c8f8b3c4a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.155265 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ba89e-7c00-42f8-ad98-951c8f8b3c4a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.155540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89ba89e-7c00-42f8-ad98-951c8f8b3c4a None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.156440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ba89e-7c00-42f8-ad98-951c8f8b3c4a None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:57.156753 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ba89e-7c00-42f8-ad98-951c8f8b3c4a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:57.158325 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89ba89e-7c00-42f8-ad98-951c8f8b3c4a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:57.184919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 469/968] 10.222.0.64 () {56 vars in 1149 bytes} [Thu May 26 18:08:56 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:57.190695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eed5a8-5610-4561-aec4-499b9d77f0ce None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:57.318927 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1eed5a8-5610-4561-aec4-499b9d77f0ce None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:57.358738 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561eb6d-c75f-4555-890b-7f6f2e62f5ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:57.359777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561eb6d-c75f-4555-890b-7f6f2e62f5ab None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.360288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561eb6d-c75f-4555-890b-7f6f2e62f5ab None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.360822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d561eb6d-c75f-4555-890b-7f6f2e62f5ab None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.373241 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:57.437109 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561eb6d-c75f-4555-890b-7f6f2e62f5ab None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:57.438625 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d561eb6d-c75f-4555-890b-7f6f2e62f5ab None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:57.452298 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96905a-30cb-4ef5-8289-9c7ba5b342d7 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.452620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96905a-30cb-4ef5-8289-9c7ba5b342d7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.452865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe96905a-30cb-4ef5-8289-9c7ba5b342d7 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.454308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 470/969] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:08:57.459684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3e366-9a12-4d87-b034-7c6c0e9840a2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.459970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3e366-9a12-4d87-b034-7c6c0e9840a2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.460250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4a3e366-9a12-4d87-b034-7c6c0e9840a2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.483286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e4a3e366-9a12-4d87-b034-7c6c0e9840a2 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:57.484737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e4a3e366-9a12-4d87-b034-7c6c0e9840a2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:57.556634 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 471/970] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:57 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (3 switches on core 0) May 26 18:08:57.568132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 500/971] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:08:57 2022] GET /identity/v3/auth/tokens => generated 1464 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:08:57.573635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3e366-9a12-4d87-b034-7c6c0e9840a2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:57.585566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561eb6d-c75f-4555-890b-7f6f2e62f5ab None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:57.631324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:57.673158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:57.679023 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4a3e366-9a12-4d87-b034-7c6c0e9840a2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:57.699026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d561eb6d-c75f-4555-890b-7f6f2e62f5ab None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:57.716173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9affeda-d450-4ba1-9e17-adac489b3ed1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:57.717071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9affeda-d450-4ba1-9e17-adac489b3ed1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.717429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9affeda-d450-4ba1-9e17-adac489b3ed1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.717778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9affeda-d450-4ba1-9e17-adac489b3ed1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.728228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9affeda-d450-4ba1-9e17-adac489b3ed1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:57.729835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9affeda-d450-4ba1-9e17-adac489b3ed1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:57.742308 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51efdba-9381-4a85-a8c6-5ee661907990 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:57.742979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51efdba-9381-4a85-a8c6-5ee661907990 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.743255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51efdba-9381-4a85-a8c6-5ee661907990 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.743524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51efdba-9381-4a85-a8c6-5ee661907990 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.744221 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51efdba-9381-4a85-a8c6-5ee661907990 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:57.745649 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51efdba-9381-4a85-a8c6-5ee661907990 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-e9affeda-d450-4ba1-9e17-adac489b3ed1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:08:57.757853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:57.758870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:57.759752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:08:57.759752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:08:57.759752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:08:57.759752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:57.759968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.sql.core [None req-a51efdba-9381-4a85-a8c6-5ee661907990 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 18:08:57.759968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 18:08:57.759968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [parameters: {'user_id': 'ed6e33d76dcc4a40aa010555e05b9f6a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 18:08:57.759968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=80231) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} May 26 18:08:57.762336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 472/972] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:08:57 2022] GET /identity/v3/domains/Default => generated 87 bytes in 189 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:57.768462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9affeda-d450-4ba1-9e17-adac489b3ed1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-a51efdba-9381-4a85-a8c6-5ee661907990 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() May 26 18:08:57.770844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return method(*args, **kwargs) May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 18:08:57.771727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application yield resource May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application next(self.gen) May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.rollback() May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.force_reraise() May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise self.value May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application session.commit() May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1435, in commit May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) May 26 18:08:57.772714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._prepare_impl() May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.session.flush() May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3367, in flush May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._flush(objects) May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3507, in _flush May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application compat.raise_( May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3467, in _flush May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application flush_context.execute() May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rec.execute(self) May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute May 26 18:08:57.773643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application _emit_insert_statements( May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = connection._execute_20( May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1631, in _execute_20 May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 325, in _execute_on_connection May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return connection._execute_clauseelement( May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1498, in _execute_clauseelement May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ret = self._execute_context( May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1862, in _execute_context May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._handle_dbapi_exception( May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2041, in _handle_dbapi_exception May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 207, in raise_ May 26 18:08:57.774531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1819, in _execute_context May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self.dialect.do_execute( May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result = self._query(query) May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application conn.query(q) May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application result.read() May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet May 26 18:08:57.775398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application packet.raise_for_error() May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise errorclass(errno, errval) May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [parameters: {'user_id': 'ed6e33d76dcc4a40aa010555e05b9f6a', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:57.776220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user May 26 18:08:57.778297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) May 26 18:08:57.780579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects May 26 18:08:57.780579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) May 26 18:08:57.780579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper May 26 18:08:57.780579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, May 26 18:08:57.780579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. May 26 18:08:57.780579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:57.780579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 501/973] 10.222.0.64 () {60 vars in 1131 bytes} [Thu May 26 18:08:57 2022] POST /identity/v3/users => generated 160 bytes in 189 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) May 26 18:08:57.786053 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51efdba-9381-4a85-a8c6-5ee661907990 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:57.882145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9affeda-d450-4ba1-9e17-adac489b3ed1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:57.895301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51efdba-9381-4a85-a8c6-5ee661907990 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:57.897515 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:57.919503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90299a5-2f28-4458-9e55-ffda87722479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:57.920274 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90299a5-2f28-4458-9e55-ffda87722479 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.920784 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90299a5-2f28-4458-9e55-ffda87722479 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.921108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90299a5-2f28-4458-9e55-ffda87722479 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.921867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90299a5-2f28-4458-9e55-ffda87722479 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:57.922181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90299a5-2f28-4458-9e55-ffda87722479 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:57.924322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90299a5-2f28-4458-9e55-ffda87722479 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:57.943823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 473/974] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:08:57 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:57.944945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90299a5-2f28-4458-9e55-ffda87722479 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:57.945669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa173a8-3ed7-4cde-b1d2-c67351c4ca8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:57.946505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa173a8-3ed7-4cde-b1d2-c67351c4ca8c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:57.946787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa173a8-3ed7-4cde-b1d2-c67351c4ca8c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:57.947061 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa173a8-3ed7-4cde-b1d2-c67351c4ca8c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:57.956403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa173a8-3ed7-4cde-b1d2-c67351c4ca8c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:57.958592 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fa173a8-3ed7-4cde-b1d2-c67351c4ca8c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:57.959315 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5fa173a8-3ed7-4cde-b1d2-c67351c4ca8c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:08:57.975968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:57.977363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:57.978295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:57.978295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:57.978295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:08:57.978295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:08:57.978295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:08:57.978295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:08:57.978295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:08:57.978295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:08:57.978295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. May 26 18:08:57.978295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:57.980752 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 502/975] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:08:57 2022] GET /identity/v3/users/cinder => generated 84 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:57.988439 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa173a8-3ed7-4cde-b1d2-c67351c4ca8c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:58.063311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90299a5-2f28-4458-9e55-ffda87722479 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:58.097129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa173a8-3ed7-4cde-b1d2-c67351c4ca8c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:58.099159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4651630-7d37-4af0-ae06-a57f945ebd92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:58.099965 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4651630-7d37-4af0-ae06-a57f945ebd92 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:58.100274 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4651630-7d37-4af0-ae06-a57f945ebd92 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:58.101019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4651630-7d37-4af0-ae06-a57f945ebd92 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:58.108133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4651630-7d37-4af0-ae06-a57f945ebd92 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:58.110008 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4651630-7d37-4af0-ae06-a57f945ebd92 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-c4651630-7d37-4af0-ae06-a57f945ebd92 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:08:58.125677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:58.126532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:58.127401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:08:58.127401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:08:58.127401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:08:58.127401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:08:58.127401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:08:58.127401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:08:58.127401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:08:58.127401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:08:58.127401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 474/976] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:08:57 2022] GET /identity/v3/projects/service => generated 88 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:58.133661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4651630-7d37-4af0-ae06-a57f945ebd92 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:58.140136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875a47d-9ad8-4245-abd2-1178ffc685a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:58.140813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a47d-9ad8-4245-abd2-1178ffc685a8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:58.141136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a47d-9ad8-4245-abd2-1178ffc685a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:58.141509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2875a47d-9ad8-4245-abd2-1178ffc685a8 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:58.142321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875a47d-9ad8-4245-abd2-1178ffc685a8 None admin] RBAC: Adding query filter params (name=cinder) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:58.142631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875a47d-9ad8-4245-abd2-1178ffc685a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:58.144056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2875a47d-9ad8-4245-abd2-1178ffc685a8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:58.192378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 503/977] 10.222.0.64 () {56 vars in 1101 bytes} [Thu May 26 18:08:57 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:58.218417 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:58.256886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4651630-7d37-4af0-ae06-a57f945ebd92 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:58.295994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b86fb3d-6d78-4c6c-8a62-43380590a9c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:58.296683 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86fb3d-6d78-4c6c-8a62-43380590a9c5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:58.296970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86fb3d-6d78-4c6c-8a62-43380590a9c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:58.297338 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b86fb3d-6d78-4c6c-8a62-43380590a9c5 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:58.298138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86fb3d-6d78-4c6c-8a62-43380590a9c5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:58.298504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86fb3d-6d78-4c6c-8a62-43380590a9c5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:58.299970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b86fb3d-6d78-4c6c-8a62-43380590a9c5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:58.313672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 475/978] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:08:58 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:08:58.319616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875a47d-9ad8-4245-abd2-1178ffc685a8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:58.348785 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:58.435090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2875a47d-9ad8-4245-abd2-1178ffc685a8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:58.472084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a713d3-c8ef-49f6-8d27-35ae1cea1fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:58.472745 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a713d3-c8ef-49f6-8d27-35ae1cea1fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:58.473057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a713d3-c8ef-49f6-8d27-35ae1cea1fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:58.473325 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a713d3-c8ef-49f6-8d27-35ae1cea1fc3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:58.474188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a713d3-c8ef-49f6-8d27-35ae1cea1fc3 None admin] RBAC: Adding query filter params (role.id=eb196236bdeb4a6f8f5f05fdbee6f00c, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=438d065f5ec6446c824cdc4642c4ec06) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:58.474502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a713d3-c8ef-49f6-8d27-35ae1cea1fc3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:58.475896 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a713d3-c8ef-49f6-8d27-35ae1cea1fc3 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:58.482951 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 504/979] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:08:58 2022] GET /identity/v3/role_assignments?user.id=438d065f5ec6446c824cdc4642c4ec06&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=eb196236bdeb4a6f8f5f05fdbee6f00c => generated 608 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:59.033687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364cb00-87d9-48bf-a806-76930d94403f None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:59.034205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364cb00-87d9-48bf-a806-76930d94403f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:59.034284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f364cb00-87d9-48bf-a806-76930d94403f None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:59.035646 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 476/980] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:59.040907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc1231-f992-4793-89cf-d69825bb6404 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:59.041335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc1231-f992-4793-89cf-d69825bb6404 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:59.041497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0dc1231-f992-4793-89cf-d69825bb6404 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:59.058591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f0dc1231-f992-4793-89cf-d69825bb6404 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:59.060141 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f0dc1231-f992-4793-89cf-d69825bb6404 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:59.137273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 505/981] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:59 2022] POST /identity/v3/auth/tokens => generated 1464 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:59.155336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364cb00-87d9-48bf-a806-76930d94403f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:59.260453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f364cb00-87d9-48bf-a806-76930d94403f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:59.290597 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:59.300316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a28488-f632-4e78-8737-b6d8e21623a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:59.301006 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a28488-f632-4e78-8737-b6d8e21623a2 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:59.301294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a28488-f632-4e78-8737-b6d8e21623a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:59.301572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a28488-f632-4e78-8737-b6d8e21623a2 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:59.302304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a28488-f632-4e78-8737-b6d8e21623a2 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:59.303685 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0a28488-f632-4e78-8737-b6d8e21623a2 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:59.318706 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 477/982] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 26 18:08:59 2022] POST /identity/v3/services => generated 242 bytes in 164 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:08:59.461238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323af406-b971-4c86-a622-0c3be79dd6d7 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:59.461570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323af406-b971-4c86-a622-0c3be79dd6d7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:59.461802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323af406-b971-4c86-a622-0c3be79dd6d7 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:59.463409 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 506/983] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:08:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:08:59.469636 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f369a-d9f9-43f6-9633-6164d8377519 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:59.469927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f369a-d9f9-43f6-9633-6164d8377519 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:59.470206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b5f369a-d9f9-43f6-9633-6164d8377519 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:59.488158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2b5f369a-d9f9-43f6-9633-6164d8377519 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:08:59.489575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2b5f369a-d9f9-43f6-9633-6164d8377519 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:08:59.565844 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 478/984] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:08:59 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:08:59.587997 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323af406-b971-4c86-a622-0c3be79dd6d7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:59.604547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:59.693526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323af406-b971-4c86-a622-0c3be79dd6d7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:59.728044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f05be-1a97-4f77-8c81-a013cb93df26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:59.728850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f05be-1a97-4f77-8c81-a013cb93df26 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:59.729167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f05be-1a97-4f77-8c81-a013cb93df26 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:59.729446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df3f05be-1a97-4f77-8c81-a013cb93df26 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:59.730098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f05be-1a97-4f77-8c81-a013cb93df26 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:59.731461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df3f05be-1a97-4f77-8c81-a013cb93df26 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-df3f05be-1a97-4f77-8c81-a013cb93df26 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:08:59.743581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:08:59.744549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:08:59.746204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 507/985] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 26 18:08:59 2022] GET /identity/v3/services/object-store => generated 93 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:08:59.751192 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f369a-d9f9-43f6-9633-6164d8377519 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:59.851014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b5f369a-d9f9-43f6-9633-6164d8377519 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:08:59.868192 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:08:59.891547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06857c2-d874-4440-a239-ba8ee43a750d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:08:59.892297 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06857c2-d874-4440-a239-ba8ee43a750d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:08:59.892654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06857c2-d874-4440-a239-ba8ee43a750d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:08:59.893016 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f06857c2-d874-4440-a239-ba8ee43a750d None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:08:59.893799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06857c2-d874-4440-a239-ba8ee43a750d None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:08:59.894178 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06857c2-d874-4440-a239-ba8ee43a750d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:08:59.895614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f06857c2-d874-4440-a239-ba8ee43a750d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:08:59.904876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 479/986] 10.222.0.64 () {56 vars in 1122 bytes} [Thu May 26 18:08:59 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:08:59.906291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f05be-1a97-4f77-8c81-a013cb93df26 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:08:59.984258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:00.007335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df3f05be-1a97-4f77-8c81-a013cb93df26 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:00.041955 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fcb36-a3f2-4909-99e3-86e17b1be72b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:00.042758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fcb36-a3f2-4909-99e3-86e17b1be72b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:00.043144 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fcb36-a3f2-4909-99e3-86e17b1be72b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:00.043540 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34fcb36-a3f2-4909-99e3-86e17b1be72b None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:00.044395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fcb36-a3f2-4909-99e3-86e17b1be72b None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:00.044842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fcb36-a3f2-4909-99e3-86e17b1be72b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:00.046320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34fcb36-a3f2-4909-99e3-86e17b1be72b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:00.056385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 508/987] 10.222.0.64 () {56 vars in 1122 bytes} [Thu May 26 18:08:59 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:00.057466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06857c2-d874-4440-a239-ba8ee43a750d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:00.163751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f06857c2-d874-4440-a239-ba8ee43a750d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:00.201420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63856107-8eb7-449f-a6d5-32a981d4992b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:00.202084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856107-8eb7-449f-a6d5-32a981d4992b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:00.202368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856107-8eb7-449f-a6d5-32a981d4992b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:00.202644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63856107-8eb7-449f-a6d5-32a981d4992b None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:00.203435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63856107-8eb7-449f-a6d5-32a981d4992b None admin] RBAC: Adding query filter params (interface=admin, service_id=d8cc88fb1228410ca71f9bcef46606e1, region_id=RegionOne) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:00.203754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63856107-8eb7-449f-a6d5-32a981d4992b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:00.205422 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63856107-8eb7-449f-a6d5-32a981d4992b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:00.215575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 480/988] 10.222.0.64 () {56 vars in 1249 bytes} [Thu May 26 18:09:00 2022] GET /identity/v3/endpoints?service_id=d8cc88fb1228410ca71f9bcef46606e1&interface=admin®ion_id=RegionOne => generated 193 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:00.216735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fcb36-a3f2-4909-99e3-86e17b1be72b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:00.317198 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34fcb36-a3f2-4909-99e3-86e17b1be72b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:00.349615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b75a197c-4269-4f80-9bde-91fd306c7a90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:00.350276 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a197c-4269-4f80-9bde-91fd306c7a90 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:00.350560 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a197c-4269-4f80-9bde-91fd306c7a90 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:00.350832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b75a197c-4269-4f80-9bde-91fd306c7a90 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:00.351499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a197c-4269-4f80-9bde-91fd306c7a90 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:00.352845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b75a197c-4269-4f80-9bde-91fd306c7a90 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:00.365211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 509/989] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 26 18:09:00 2022] GET /identity/v3/services => generated 1727 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:00.746300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea418-b2f8-44e7-83a5-11f0003d9782 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:00.746622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea418-b2f8-44e7-83a5-11f0003d9782 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:00.746873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed6ea418-b2f8-44e7-83a5-11f0003d9782 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:00.748418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 481/990] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:00.753369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64187-1234-49aa-a9dd-cbcdbd65a597 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:00.753664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64187-1234-49aa-a9dd-cbcdbd65a597 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:00.753946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33a64187-1234-49aa-a9dd-cbcdbd65a597 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:00.765504 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:00.771356 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-33a64187-1234-49aa-a9dd-cbcdbd65a597 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:00.772527 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-33a64187-1234-49aa-a9dd-cbcdbd65a597 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:00.839933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 510/991] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:00 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:00.861547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ea418-b2f8-44e7-83a5-11f0003d9782 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:00.907346 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:00.966324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed6ea418-b2f8-44e7-83a5-11f0003d9782 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:01.000744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6c56c-eba9-4e85-b417-9511100d79d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:01.001487 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6c56c-eba9-4e85-b417-9511100d79d9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:01.001770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6c56c-eba9-4e85-b417-9511100d79d9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:01.002041 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b6c56c-eba9-4e85-b417-9511100d79d9 None admin] PATH_INFO: `/v3/services/image` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:01.002684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6c56c-eba9-4e85-b417-9511100d79d9 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:01.011628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b6c56c-eba9-4e85-b417-9511100d79d9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-78b6c56c-eba9-4e85-b417-9511100d79d9 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:01.025946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:01.027026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:01.027935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:01.027935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:01.027935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:01.027935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:01.027935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:01.027935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:01.027935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:01.027935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:01.027935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:01.027935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:01.027935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:09:01.027935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:09:01.027935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 18:09:01.027935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:01.035249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 482/992] 10.222.0.64 () {56 vars in 1105 bytes} [Thu May 26 18:09:00 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:01.035402 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a64187-1234-49aa-a9dd-cbcdbd65a597 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:01.148777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33a64187-1234-49aa-a9dd-cbcdbd65a597 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:01.188947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebad971a-e373-4982-a356-d735af87e4b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:01.189643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad971a-e373-4982-a356-d735af87e4b8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:01.189924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad971a-e373-4982-a356-d735af87e4b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:01.190200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebad971a-e373-4982-a356-d735af87e4b8 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:01.190906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad971a-e373-4982-a356-d735af87e4b8 None admin] RBAC: Adding query filter params (name=image) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:01.191214 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad971a-e373-4982-a356-d735af87e4b8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:01.192578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebad971a-e373-4982-a356-d735af87e4b8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:01.194406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:01.201148 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 511/993] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:01 2022] GET /identity/v3/services?name=image => generated 122 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:01.204426 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6c56c-eba9-4e85-b417-9511100d79d9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:01.305822 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b6c56c-eba9-4e85-b417-9511100d79d9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:01.312584 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:01.339766 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c02dfff1-cd26-47f7-8e15-6a0d82ceadc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:01.340423 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dfff1-cd26-47f7-8e15-6a0d82ceadc1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:01.340705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dfff1-cd26-47f7-8e15-6a0d82ceadc1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:01.341506 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c02dfff1-cd26-47f7-8e15-6a0d82ceadc1 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:01.342223 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02dfff1-cd26-47f7-8e15-6a0d82ceadc1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:01.342516 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02dfff1-cd26-47f7-8e15-6a0d82ceadc1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:01.343885 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c02dfff1-cd26-47f7-8e15-6a0d82ceadc1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:01.357488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 483/994] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:01 2022] GET /identity/v3/services?type=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:01.574100 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa909cc-093f-4253-8e86-2cd5d1a74a20 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:01.574440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa909cc-093f-4253-8e86-2cd5d1a74a20 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:01.574621 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aa909cc-093f-4253-8e86-2cd5d1a74a20 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:01.576154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 512/995] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:01.581374 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dae2ca-43e2-4787-affb-bd87eadf77ed None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:01.581672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dae2ca-43e2-4787-affb-bd87eadf77ed None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:01.581956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7dae2ca-43e2-4787-affb-bd87eadf77ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:01.599076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d7dae2ca-43e2-4787-affb-bd87eadf77ed None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:01.600263 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d7dae2ca-43e2-4787-affb-bd87eadf77ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:01.668143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 484/996] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:01 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:01.690151 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa909cc-093f-4253-8e86-2cd5d1a74a20 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:01.792250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aa909cc-093f-4253-8e86-2cd5d1a74a20 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:01.826451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70679cb-fa11-4bef-b802-37f0bcb2c638 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:01.827163 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70679cb-fa11-4bef-b802-37f0bcb2c638 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:01.827448 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70679cb-fa11-4bef-b802-37f0bcb2c638 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:01.827724 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f70679cb-fa11-4bef-b802-37f0bcb2c638 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:01.828372 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70679cb-fa11-4bef-b802-37f0bcb2c638 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:01.829750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f70679cb-fa11-4bef-b802-37f0bcb2c638 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-f70679cb-fa11-4bef-b802-37f0bcb2c638 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:01.842060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:01.843082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:01.843977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:01.843977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:09:01.843977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:01.843977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:01.843977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:01.843977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:01.843977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:01.843977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:01.843977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:01.843977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:01.843977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:09:01.843977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:09:01.843977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 18:09:01.843977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:01.848239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 513/997] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:09:01 2022] GET /identity/v3/services/compute => generated 88 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:01.849512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dae2ca-43e2-4787-affb-bd87eadf77ed None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:01.946440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:01.950757 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7dae2ca-43e2-4787-affb-bd87eadf77ed None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:01.985463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb6610-7ada-43e6-8467-2c68c47e9ce0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:01.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb6610-7ada-43e6-8467-2c68c47e9ce0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:01.986416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb6610-7ada-43e6-8467-2c68c47e9ce0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:01.986694 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caeb6610-7ada-43e6-8467-2c68c47e9ce0 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:01.987395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb6610-7ada-43e6-8467-2c68c47e9ce0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:01.987705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb6610-7ada-43e6-8467-2c68c47e9ce0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:01.989104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caeb6610-7ada-43e6-8467-2c68c47e9ce0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:01.999163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 485/998] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 26 18:09:01 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:02.000314 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70679cb-fa11-4bef-b802-37f0bcb2c638 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:02.062455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:02.102429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f70679cb-fa11-4bef-b802-37f0bcb2c638 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:02.136294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c58a03-efe5-4341-8662-f74b589a69d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:02.136965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c58a03-efe5-4341-8662-f74b589a69d5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:02.137287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c58a03-efe5-4341-8662-f74b589a69d5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:02.137570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c58a03-efe5-4341-8662-f74b589a69d5 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:02.138906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c58a03-efe5-4341-8662-f74b589a69d5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:02.139218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c58a03-efe5-4341-8662-f74b589a69d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:02.140575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c58a03-efe5-4341-8662-f74b589a69d5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:02.149495 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 514/999] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 26 18:09:01 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:02.155031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb6610-7ada-43e6-8467-2c68c47e9ce0 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:02.262429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caeb6610-7ada-43e6-8467-2c68c47e9ce0 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:02.296803 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-913542b6-65c4-40af-936e-89406b4e694d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:02.297488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913542b6-65c4-40af-936e-89406b4e694d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:02.297773 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913542b6-65c4-40af-936e-89406b4e694d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:02.298051 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-913542b6-65c4-40af-936e-89406b4e694d None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:02.298879 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913542b6-65c4-40af-936e-89406b4e694d None admin] RBAC: Adding query filter params (interface=public, service_id=6f4dede610524bbbb955498078c24f94, region_id=RegionOne) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:02.299198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913542b6-65c4-40af-936e-89406b4e694d None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:02.300613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-913542b6-65c4-40af-936e-89406b4e694d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:02.310624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 486/1000] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 26 18:09:02 2022] GET /identity/v3/endpoints?service_id=6f4dede610524bbbb955498078c24f94&interface=public®ion_id=RegionOne => generated 194 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:02.312155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c58a03-efe5-4341-8662-f74b589a69d5 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:02.417336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c58a03-efe5-4341-8662-f74b589a69d5 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:02.445142 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:02.455759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a61f097f-eddc-4809-aa8e-e345acce7bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:02.456440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f097f-eddc-4809-aa8e-e345acce7bb9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:02.456723 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f097f-eddc-4809-aa8e-e345acce7bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:02.457014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a61f097f-eddc-4809-aa8e-e345acce7bb9 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:02.457746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f097f-eddc-4809-aa8e-e345acce7bb9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:02.459099 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a61f097f-eddc-4809-aa8e-e345acce7bb9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:02.473273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 515/1001] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 26 18:09:02 2022] GET /identity/v3/services => generated 1727 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:09:02.554342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f702-f3f3-4bd5-ba07-cc40e0615a12 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:02.554678 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f702-f3f3-4bd5-ba07-cc40e0615a12 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:02.554902 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1b7f702-f3f3-4bd5-ba07-cc40e0615a12 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:02.556455 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 487/1002] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:02.562604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929483a8-0785-45f3-9670-0794aab5b0df None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:02.562918 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929483a8-0785-45f3-9670-0794aab5b0df None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:02.563171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929483a8-0785-45f3-9670-0794aab5b0df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:02.580753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-929483a8-0785-45f3-9670-0794aab5b0df None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:02.582010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-929483a8-0785-45f3-9670-0794aab5b0df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:02.657253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 516/1003] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:02 2022] POST /identity/v3/auth/tokens => generated 1560 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:02.681638 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7f702-f3f3-4bd5-ba07-cc40e0615a12 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:02.711108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:02.787233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1b7f702-f3f3-4bd5-ba07-cc40e0615a12 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:02.822163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1a8d5-9dcc-4801-b602-55d2029ca822 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:02.823017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1a8d5-9dcc-4801-b602-55d2029ca822 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:02.823304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1a8d5-9dcc-4801-b602-55d2029ca822 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:02.823577 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6d1a8d5-9dcc-4801-b602-55d2029ca822 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:02.824225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1a8d5-9dcc-4801-b602-55d2029ca822 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:02.825751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6d1a8d5-9dcc-4801-b602-55d2029ca822 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-a6d1a8d5-9dcc-4801-b602-55d2029ca822 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:02.837945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:02.838938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:02.845283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 488/1004] 10.222.0.64 () {56 vars in 1126 bytes} [Thu May 26 18:09:02 2022] GET /identity/v3/services/object-store => generated 93 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:02.847477 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929483a8-0785-45f3-9670-0794aab5b0df None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:02.955108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929483a8-0785-45f3-9670-0794aab5b0df None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:02.979494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:02.992600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027e0f4-f97d-4b33-b164-3894e1fa7903 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:02.993375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027e0f4-f97d-4b33-b164-3894e1fa7903 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:02.993664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027e0f4-f97d-4b33-b164-3894e1fa7903 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:02.993941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7027e0f4-f97d-4b33-b164-3894e1fa7903 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:02.994643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027e0f4-f97d-4b33-b164-3894e1fa7903 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:02.994955 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027e0f4-f97d-4b33-b164-3894e1fa7903 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:02.996312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7027e0f4-f97d-4b33-b164-3894e1fa7903 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:03.005939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 517/1005] 10.222.0.64 () {56 vars in 1122 bytes} [Thu May 26 18:09:02 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:03.007054 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1a8d5-9dcc-4801-b602-55d2029ca822 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:03.101801 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:03.112462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6d1a8d5-9dcc-4801-b602-55d2029ca822 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:03.151578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f0aaa62-13eb-4232-90ca-e6e7e7f13e51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:03.152255 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aaa62-13eb-4232-90ca-e6e7e7f13e51 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.152541 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aaa62-13eb-4232-90ca-e6e7e7f13e51 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.152820 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f0aaa62-13eb-4232-90ca-e6e7e7f13e51 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.154189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aaa62-13eb-4232-90ca-e6e7e7f13e51 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:03.154499 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aaa62-13eb-4232-90ca-e6e7e7f13e51 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:03.155878 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f0aaa62-13eb-4232-90ca-e6e7e7f13e51 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:03.165837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 489/1006] 10.222.0.64 () {56 vars in 1122 bytes} [Thu May 26 18:09:03 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:03.167029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027e0f4-f97d-4b33-b164-3894e1fa7903 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:03.270193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7027e0f4-f97d-4b33-b164-3894e1fa7903 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:03.304390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8906b9f-ef33-4c3c-b72c-5247acab18f7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:03.305071 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8906b9f-ef33-4c3c-b72c-5247acab18f7 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.305352 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8906b9f-ef33-4c3c-b72c-5247acab18f7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.305624 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8906b9f-ef33-4c3c-b72c-5247acab18f7 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.306341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8906b9f-ef33-4c3c-b72c-5247acab18f7 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:03.307688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8906b9f-ef33-4c3c-b72c-5247acab18f7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:03.323375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 518/1007] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 26 18:09:03 2022] POST /identity/v3/endpoints => generated 325 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:09:03.547767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e5669-6912-46a9-a603-518c548b2e35 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.548251 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e5669-6912-46a9-a603-518c548b2e35 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.548251 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e9e5669-6912-46a9-a603-518c548b2e35 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.549792 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 490/1008] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:03.554759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10d06e-3808-4a5a-aaaa-747f82b7b004 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.555050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10d06e-3808-4a5a-aaaa-747f82b7b004 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.555326 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b10d06e-3808-4a5a-aaaa-747f82b7b004 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.572374 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7b10d06e-3808-4a5a-aaaa-747f82b7b004 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:03.573598 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7b10d06e-3808-4a5a-aaaa-747f82b7b004 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:03.618544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:03.652807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 519/1009] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:03 2022] POST /identity/v3/auth/tokens => generated 1707 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:03.675515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e5669-6912-46a9-a603-518c548b2e35 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:03.779464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e9e5669-6912-46a9-a603-518c548b2e35 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:03.813420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46d10222-98ad-47b5-8801-710b5a03af8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:03.814060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d10222-98ad-47b5-8801-710b5a03af8d None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:03.814357 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d10222-98ad-47b5-8801-710b5a03af8d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:03.814637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46d10222-98ad-47b5-8801-710b5a03af8d None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:03.815369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d10222-98ad-47b5-8801-710b5a03af8d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:03.816737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46d10222-98ad-47b5-8801-710b5a03af8d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:03.841028 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 491/1010] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 26 18:09:03 2022] POST /identity/v3/services => generated 242 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:04.667501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4ae5-2c87-4ef8-b17c-6f0adf97755e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:04.668037 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4ae5-2c87-4ef8-b17c-6f0adf97755e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:04.668037 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fff4ae5-2c87-4ef8-b17c-6f0adf97755e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:04.669636 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 520/1011] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:04.674574 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743379a-b97d-4881-adef-27b4c4f6e780 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:04.674968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743379a-b97d-4881-adef-27b4c4f6e780 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:04.675129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c743379a-b97d-4881-adef-27b4c4f6e780 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:04.691389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c743379a-b97d-4881-adef-27b4c4f6e780 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:04.692541 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c743379a-b97d-4881-adef-27b4c4f6e780 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:04.704216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:04.768117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 492/1012] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:04 2022] POST /identity/v3/auth/tokens => generated 1803 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:04.790533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff4ae5-2c87-4ef8-b17c-6f0adf97755e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:04.890675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fff4ae5-2c87-4ef8-b17c-6f0adf97755e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:04.924063 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ae63-5689-4669-8645-06cf35af4945 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:04.924784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ae63-5689-4669-8645-06cf35af4945 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:04.925094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ae63-5689-4669-8645-06cf35af4945 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:04.925373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92d7ae63-5689-4669-8645-06cf35af4945 None admin] PATH_INFO: `/v3/services/compute` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:04.926020 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7ae63-5689-4669-8645-06cf35af4945 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:04.927387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92d7ae63-5689-4669-8645-06cf35af4945 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-92d7ae63-5689-4669-8645-06cf35af4945 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:04.940482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:04.941696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:04.942568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:04.942568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:09:04.942568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:04.942568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:04.942568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:04.942568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:04.942568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:04.942568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:04.942568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:04.942568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:04.942568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:09:04.942568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:09:04.942568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. May 26 18:09:04.942568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:04.945446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 521/1013] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:09:04 2022] GET /identity/v3/services/compute => generated 88 bytes in 155 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:04.947974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743379a-b97d-4881-adef-27b4c4f6e780 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:05.048347 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c743379a-b97d-4881-adef-27b4c4f6e780 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:05.082530 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9c502-7e11-4e7d-964c-7e32bcdd65f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:05.083193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c502-7e11-4e7d-964c-7e32bcdd65f6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:05.083474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c502-7e11-4e7d-964c-7e32bcdd65f6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:05.083750 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f9c502-7e11-4e7d-964c-7e32bcdd65f6 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:05.084445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9c502-7e11-4e7d-964c-7e32bcdd65f6 None admin] RBAC: Adding query filter params (name=compute) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:05.084752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9c502-7e11-4e7d-964c-7e32bcdd65f6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:05.086164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91f9c502-7e11-4e7d-964c-7e32bcdd65f6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:05.096521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 493/1014] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 26 18:09:04 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:05.097482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ae63-5689-4669-8645-06cf35af4945 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:05.133794 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:05.207323 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92d7ae63-5689-4669-8645-06cf35af4945 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:05.240157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f9b6bff-bfb1-46ad-845f-ced9e335cbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:05.240792 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b6bff-bfb1-46ad-845f-ced9e335cbbb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:05.241108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b6bff-bfb1-46ad-845f-ced9e335cbbb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:05.241387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f9b6bff-bfb1-46ad-845f-ced9e335cbbb None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:05.242092 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b6bff-bfb1-46ad-845f-ced9e335cbbb None admin] RBAC: Adding query filter params (type=compute) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:05.242399 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b6bff-bfb1-46ad-845f-ced9e335cbbb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:05.243749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f9b6bff-bfb1-46ad-845f-ced9e335cbbb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:05.249275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 522/1015] 10.222.0.64 () {56 vars in 1112 bytes} [Thu May 26 18:09:05 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:05.254663 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9c502-7e11-4e7d-964c-7e32bcdd65f6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:05.264108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:05.356731 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91f9c502-7e11-4e7d-964c-7e32bcdd65f6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:05.393928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c938df1-66d6-4664-8bd0-2c4873897b97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:05.394589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c938df1-66d6-4664-8bd0-2c4873897b97 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:05.394874 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c938df1-66d6-4664-8bd0-2c4873897b97 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:05.395154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c938df1-66d6-4664-8bd0-2c4873897b97 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:05.395898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c938df1-66d6-4664-8bd0-2c4873897b97 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:05.397318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c938df1-66d6-4664-8bd0-2c4873897b97 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:05.417534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 494/1016] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 26 18:09:05 2022] POST /identity/v3/endpoints => generated 334 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:05.548800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827a717-3e22-4ed1-aebb-af7342f3161e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:05.549106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827a717-3e22-4ed1-aebb-af7342f3161e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:05.549381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c827a717-3e22-4ed1-aebb-af7342f3161e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:05.550972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 523/1017] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:05 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:05.556622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b5527-2c64-4d7b-a561-c02ce36dc96e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:05.556914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b5527-2c64-4d7b-a561-c02ce36dc96e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:05.557218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e56b5527-2c64-4d7b-a561-c02ce36dc96e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:05.575266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e56b5527-2c64-4d7b-a561-c02ce36dc96e None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:05.576520 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e56b5527-2c64-4d7b-a561-c02ce36dc96e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:05.642866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:05.661231 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 495/1018] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:05 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:05.685866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827a717-3e22-4ed1-aebb-af7342f3161e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:05.791006 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:05.795994 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c827a717-3e22-4ed1-aebb-af7342f3161e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:05.830490 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be927c91-267e-40d7-9126-365d617c8fbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:05.831205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be927c91-267e-40d7-9126-365d617c8fbe None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:05.831486 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be927c91-267e-40d7-9126-365d617c8fbe None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:05.831759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be927c91-267e-40d7-9126-365d617c8fbe None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:05.832917 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be927c91-267e-40d7-9126-365d617c8fbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:05.834363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be927c91-267e-40d7-9126-365d617c8fbe None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:05.840466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 524/1019] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:05 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:05.842225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b5527-2c64-4d7b-a561-c02ce36dc96e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:05.947658 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e56b5527-2c64-4d7b-a561-c02ce36dc96e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:05.981591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8934b05a-601d-45da-a557-7be388ba5cd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:05.982994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934b05a-601d-45da-a557-7be388ba5cd5 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:05.983285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934b05a-601d-45da-a557-7be388ba5cd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:05.983569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8934b05a-601d-45da-a557-7be388ba5cd5 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:05.984547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934b05a-601d-45da-a557-7be388ba5cd5 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:05.986026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8934b05a-601d-45da-a557-7be388ba5cd5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:06.012777 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 496/1020] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 26 18:09:05 2022] POST /identity/v3/projects => generated 311 bytes in 171 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:09:06.051114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83522b-ab6c-4ad2-9915-c60b4f99eb02 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:06.051431 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83522b-ab6c-4ad2-9915-c60b4f99eb02 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:06.051691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c83522b-ab6c-4ad2-9915-c60b4f99eb02 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:06.053298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 525/1021] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:06.059014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af1163-c37c-414c-baff-8103d3ee1034 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:06.059314 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af1163-c37c-414c-baff-8103d3ee1034 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:06.059595 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6af1163-c37c-414c-baff-8103d3ee1034 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:06.077725 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c6af1163-c37c-414c-baff-8103d3ee1034 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:06.078980 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c6af1163-c37c-414c-baff-8103d3ee1034 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:06.118744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:06.157021 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 497/1022] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:06 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:06.181643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83522b-ab6c-4ad2-9915-c60b4f99eb02 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:06.290167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c83522b-ab6c-4ad2-9915-c60b4f99eb02 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:06.326229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ebf8f-cc96-4b0c-a883-711041355415 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:06.327049 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ebf8f-cc96-4b0c-a883-711041355415 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:06.327336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ebf8f-cc96-4b0c-a883-711041355415 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:06.327613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831ebf8f-cc96-4b0c-a883-711041355415 None admin] PATH_INFO: `/v3/services/image` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:06.328261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ebf8f-cc96-4b0c-a883-711041355415 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:06.329656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831ebf8f-cc96-4b0c-a883-711041355415 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-831ebf8f-cc96-4b0c-a883-711041355415 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:06.341553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:06.342554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:06.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:06.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:09:06.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:06.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:06.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:06.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:06.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:06.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:06.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:06.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:06.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:09:06.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:09:06.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 18:09:06.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:06.344780 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 526/1023] 10.222.0.64 () {56 vars in 1105 bytes} [Thu May 26 18:09:06 2022] GET /identity/v3/services/image => generated 86 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:06.349250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af1163-c37c-414c-baff-8103d3ee1034 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:06.450020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6af1163-c37c-414c-baff-8103d3ee1034 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:06.483748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23fb65-2019-4f7f-ad9f-1242cddad150 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:06.484670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23fb65-2019-4f7f-ad9f-1242cddad150 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:06.484956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23fb65-2019-4f7f-ad9f-1242cddad150 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:06.485260 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa23fb65-2019-4f7f-ad9f-1242cddad150 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:06.485956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23fb65-2019-4f7f-ad9f-1242cddad150 None admin] RBAC: Adding query filter params (name=image) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:06.486264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23fb65-2019-4f7f-ad9f-1242cddad150 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:06.487630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa23fb65-2019-4f7f-ad9f-1242cddad150 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:06.492624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 498/1024] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:06 2022] GET /identity/v3/services?name=image => generated 122 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:06.498746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ebf8f-cc96-4b0c-a883-711041355415 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:06.532181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:06.604073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831ebf8f-cc96-4b0c-a883-711041355415 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:06.638297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa2da9-0d96-4b66-8e8c-a80beecafbb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:06.638962 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa2da9-0d96-4b66-8e8c-a80beecafbb1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:06.639246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa2da9-0d96-4b66-8e8c-a80beecafbb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:06.639525 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5aa2da9-0d96-4b66-8e8c-a80beecafbb1 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:06.640231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa2da9-0d96-4b66-8e8c-a80beecafbb1 None admin] RBAC: Adding query filter params (type=image) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:06.640551 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa2da9-0d96-4b66-8e8c-a80beecafbb1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:06.641974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5aa2da9-0d96-4b66-8e8c-a80beecafbb1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:06.652268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 527/1025] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:06 2022] GET /identity/v3/services?type=image => generated 350 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:06.654153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23fb65-2019-4f7f-ad9f-1242cddad150 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:06.689714 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:06.758012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa23fb65-2019-4f7f-ad9f-1242cddad150 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:06.791506 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9f50e40-c6bb-4405-af16-2dbaedb69c54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:06.792211 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f50e40-c6bb-4405-af16-2dbaedb69c54 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:06.792497 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f50e40-c6bb-4405-af16-2dbaedb69c54 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:06.792770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9f50e40-c6bb-4405-af16-2dbaedb69c54 None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:06.793572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f50e40-c6bb-4405-af16-2dbaedb69c54 None admin] RBAC: Adding query filter params (interface=public, service_id=f9d9b54ef6974b8fb8d79d193e1a9a84, region_id=RegionOne) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:06.793891 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f50e40-c6bb-4405-af16-2dbaedb69c54 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:06.795807 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9f50e40-c6bb-4405-af16-2dbaedb69c54 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:06.805332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 499/1026] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 26 18:09:06 2022] GET /identity/v3/endpoints?service_id=f9d9b54ef6974b8fb8d79d193e1a9a84&interface=public®ion_id=RegionOne => generated 194 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:06.806888 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa2da9-0d96-4b66-8e8c-a80beecafbb1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:06.904298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:06.911286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5aa2da9-0d96-4b66-8e8c-a80beecafbb1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:06.945453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d78ad7-b914-459e-8f62-53e09253f375 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:06.946133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d78ad7-b914-459e-8f62-53e09253f375 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:06.946420 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d78ad7-b914-459e-8f62-53e09253f375 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:06.946698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d78ad7-b914-459e-8f62-53e09253f375 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:06.947381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d78ad7-b914-459e-8f62-53e09253f375 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:06.948754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d78ad7-b914-459e-8f62-53e09253f375 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:06.956269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 528/1027] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 26 18:09:06 2022] GET /identity/v3/services => generated 1957 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:09:07.758272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8da00-01be-4222-9fd3-c9e0e88319b3 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:07.758838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8da00-01be-4222-9fd3-c9e0e88319b3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:07.758838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf8da00-01be-4222-9fd3-c9e0e88319b3 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:07.760380 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 500/1028] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:07.766033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c9e6a-396a-4162-b767-70088b73a423 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:07.766331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c9e6a-396a-4162-b767-70088b73a423 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:07.766611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3c9e6a-396a-4162-b767-70088b73a423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:07.783944 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cb3c9e6a-396a-4162-b767-70088b73a423 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:07.785179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cb3c9e6a-396a-4162-b767-70088b73a423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:07.851770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 529/1029] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:07 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:07.875091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8da00-01be-4222-9fd3-c9e0e88319b3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:07.974116 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:07.979985 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf8da00-01be-4222-9fd3-c9e0e88319b3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:08.014938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd536c2-9e60-44be-90f4-c42a7e26c557 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:08.015672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd536c2-9e60-44be-90f4-c42a7e26c557 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:08.015957 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd536c2-9e60-44be-90f4-c42a7e26c557 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:08.016234 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd536c2-9e60-44be-90f4-c42a7e26c557 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:08.026439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd536c2-9e60-44be-90f4-c42a7e26c557 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-3dd536c2-9e60-44be-90f4-c42a7e26c557 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:09:08.034656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:08.035547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:08.036377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:08.036377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:08.036377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:08.036377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:08.036377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:09:08.036377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:09:08.036377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:09:08.036377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:09:08.036377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:09:08.036377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:09:08.036377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 18:09:08.036377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:08.041009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 501/1030] 10.222.0.64 () {56 vars in 1120 bytes} [Thu May 26 18:09:07 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:08.042530 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c9e6a-396a-4162-b767-70088b73a423 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:08.140609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:08.155604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3c9e6a-396a-4162-b767-70088b73a423 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:08.194531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05940e3f-daf6-4243-b60f-c22cb3cd0579 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:08.195557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05940e3f-daf6-4243-b60f-c22cb3cd0579 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:08.196050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05940e3f-daf6-4243-b60f-c22cb3cd0579 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:08.196574 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05940e3f-daf6-4243-b60f-c22cb3cd0579 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:08.197555 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05940e3f-daf6-4243-b60f-c22cb3cd0579 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:08.198074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05940e3f-daf6-4243-b60f-c22cb3cd0579 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:08.199634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05940e3f-daf6-4243-b60f-c22cb3cd0579 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:08.208907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 530/1031] 10.222.0.64 () {56 vars in 1115 bytes} [Thu May 26 18:09:08 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:08.214747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd536c2-9e60-44be-90f4-c42a7e26c557 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:08.310622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512fd3-2883-41e3-aa5a-b77e1a3d6f71 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:08.310923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512fd3-2883-41e3-aa5a-b77e1a3d6f71 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:08.311171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af512fd3-2883-41e3-aa5a-b77e1a3d6f71 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:08.312622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 531/1032] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:08 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:08.317319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d130398-e49e-4604-b01f-bcb23016a01f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:08.317611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d130398-e49e-4604-b01f-bcb23016a01f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:08.317892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d130398-e49e-4604-b01f-bcb23016a01f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:08.318130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd536c2-9e60-44be-90f4-c42a7e26c557 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:08.334598 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3d130398-e49e-4604-b01f-bcb23016a01f None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:08.335778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3d130398-e49e-4604-b01f-bcb23016a01f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:08.353879 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8f5aa-9887-4886-b189-473231e21bed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:08.354666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8f5aa-9887-4886-b189-473231e21bed None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:08.354948 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8f5aa-9887-4886-b189-473231e21bed None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:08.355219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8b8f5aa-9887-4886-b189-473231e21bed None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:08.366297 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b8f5aa-9887-4886-b189-473231e21bed None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:08.367730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8b8f5aa-9887-4886-b189-473231e21bed None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-d8b8f5aa-9887-4886-b189-473231e21bed None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:09:08.384945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:08.386063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:08.387063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:09:08.387063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:09:08.387063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:09:08.387063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:08.387063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 502/1033] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:08.392299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8f5aa-9887-4886-b189-473231e21bed None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:08.404418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:08.408493 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 532/1034] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:08 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:09:08.433330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d130398-e49e-4604-b01f-bcb23016a01f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:08.494109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8b8f5aa-9887-4886-b189-473231e21bed None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:08.515739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:08.530202 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c061c9-1f67-40f0-87e0-99357cd98e0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:08.530866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c061c9-1f67-40f0-87e0-99357cd98e0d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:08.531154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c061c9-1f67-40f0-87e0-99357cd98e0d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:08.531434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c061c9-1f67-40f0-87e0-99357cd98e0d None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:08.532149 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c061c9-1f67-40f0-87e0-99357cd98e0d None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:08.532456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c061c9-1f67-40f0-87e0-99357cd98e0d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:08.533853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63c061c9-1f67-40f0-87e0-99357cd98e0d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:08.536559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d130398-e49e-4604-b01f-bcb23016a01f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:08.550378 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 503/1035] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:09:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 154 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:08.551464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c061c9-1f67-40f0-87e0-99357cd98e0d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:08.577358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a5931-b4c9-4775-9616-d5b57e71dfb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:08.578214 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a5931-b4c9-4775-9616-d5b57e71dfb7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:08.578564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a5931-b4c9-4775-9616-d5b57e71dfb7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:08.578917 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0a5931-b4c9-4775-9616-d5b57e71dfb7 None admin] PATH_INFO: `/v3/domains/default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:08.580194 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a5931-b4c9-4775-9616-d5b57e71dfb7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:08.581729 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd0a5931-b4c9-4775-9616-d5b57e71dfb7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:08.583483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 533/1036] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:08 2022] GET /identity/v3/domains/default => generated 199 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:08.589067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a5931-b4c9-4775-9616-d5b57e71dfb7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:08.628269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:08.661394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c061c9-1f67-40f0-87e0-99357cd98e0d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:08.693485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd0a5931-b4c9-4775-9616-d5b57e71dfb7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:08.696839 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8573e-d81f-4747-81d4-f3711f75c6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:08.697652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8573e-d81f-4747-81d4-f3711f75c6bd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:08.697931 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8573e-d81f-4747-81d4-f3711f75c6bd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:08.698204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b8573e-d81f-4747-81d4-f3711f75c6bd None admin] PATH_INFO: `/v3/users/nova` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:08.705899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8573e-d81f-4747-81d4-f3711f75c6bd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:08.707346 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b8573e-d81f-4747-81d4-f3711f75c6bd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-65b8573e-d81f-4747-81d4-f3711f75c6bd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:09:08.721853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:08.723025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:08.724085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:08.724085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:08.724085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:09:08.724085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:09:08.724085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:09:08.724085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:09:08.724085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:09:08.724085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:09:08.724085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 18:09:08.724085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:08.724085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 504/1037] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 26 18:09:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:08.728503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8573e-d81f-4747-81d4-f3711f75c6bd None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:08.732262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62c708-e720-48cb-a048-ebdd8c7daa37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:08.732939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c708-e720-48cb-a048-ebdd8c7daa37 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:08.733246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c708-e720-48cb-a048-ebdd8c7daa37 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:08.733526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed62c708-e720-48cb-a048-ebdd8c7daa37 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:08.734494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62c708-e720-48cb-a048-ebdd8c7daa37 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:08.735910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed62c708-e720-48cb-a048-ebdd8c7daa37 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:08.769023 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 534/1038] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:09:08 2022] POST /identity/v3/users => generated 285 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:08.850997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b8573e-d81f-4747-81d4-f3711f75c6bd None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:08.882087 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:08.888629 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63c6cca-34fb-4a09-b91a-7a64d153648a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:08.889346 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c6cca-34fb-4a09-b91a-7a64d153648a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:08.889626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c6cca-34fb-4a09-b91a-7a64d153648a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:08.889900 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63c6cca-34fb-4a09-b91a-7a64d153648a None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:08.890748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c6cca-34fb-4a09-b91a-7a64d153648a None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:08.891057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c6cca-34fb-4a09-b91a-7a64d153648a None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:08.892513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63c6cca-34fb-4a09-b91a-7a64d153648a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:08.912164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 505/1039] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 26 18:09:08 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:08.917879 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62c708-e720-48cb-a048-ebdd8c7daa37 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:08.928906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:09.033549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed62c708-e720-48cb-a048-ebdd8c7daa37 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:09.068328 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0134c85-93cd-4fb8-8591-a3d1f21238b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:09.069001 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0134c85-93cd-4fb8-8591-a3d1f21238b0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:09.069293 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0134c85-93cd-4fb8-8591-a3d1f21238b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:09.069575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0134c85-93cd-4fb8-8591-a3d1f21238b0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:09.137452 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0134c85-93cd-4fb8-8591-a3d1f21238b0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:09.139443 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0134c85-93cd-4fb8-8591-a3d1f21238b0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:09.150508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:09.169989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f3bd2-65e0-44e2-a180-2087ceb71022 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:09.170310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f3bd2-65e0-44e2-a180-2087ceb71022 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:09.170565 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-066f3bd2-65e0-44e2-a180-2087ceb71022 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:09.171934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 506/1040] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:09.176883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363e2a4-cb63-40e9-965a-bb550aa1bb82 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:09.177332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363e2a4-cb63-40e9-965a-bb550aa1bb82 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:09.177616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3363e2a4-cb63-40e9-965a-bb550aa1bb82 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:09.195428 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3363e2a4-cb63-40e9-965a-bb550aa1bb82 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:09.196619 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3363e2a4-cb63-40e9-965a-bb550aa1bb82 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:09.258547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 535/1041] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:09:08 2022] GET /identity/v3/auth/tokens => generated 1959 bytes in 341 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:09:09.259529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0134c85-93cd-4fb8-8591-a3d1f21238b0 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:09.277037 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 507/1042] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:09 2022] POST /identity/v3/auth/tokens => generated 1959 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:09:09.293883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363e2a4-cb63-40e9-965a-bb550aa1bb82 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:09.361930 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0134c85-93cd-4fb8-8591-a3d1f21238b0 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:09.370953 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:09.400332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3363e2a4-cb63-40e9-965a-bb550aa1bb82 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:09.404721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2f318-b826-415a-bea6-fab55dff30c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:09.405558 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2f318-b826-415a-bea6-fab55dff30c6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:09.405840 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2f318-b826-415a-bea6-fab55dff30c6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:09.406113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84a2f318-b826-415a-bea6-fab55dff30c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:09.418904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:09.420172 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2f318-b826-415a-bea6-fab55dff30c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:09.421793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84a2f318-b826-415a-bea6-fab55dff30c6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:09.438398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1224c-0a4b-4c73-85b3-f43fbc6044ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:09.439180 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1224c-0a4b-4c73-85b3-f43fbc6044ee None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:09.439463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1224c-0a4b-4c73-85b3-f43fbc6044ee None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:09.439744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20d1224c-0a4b-4c73-85b3-f43fbc6044ee None admin] PATH_INFO: `/v3/services/image` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:09.440390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1224c-0a4b-4c73-85b3-f43fbc6044ee None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:09.441782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20d1224c-0a4b-4c73-85b3-f43fbc6044ee None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-84a2f318-b826-415a-bea6-fab55dff30c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:09:09.442862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:09.443725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:09.444605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:09:09.444605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:09:09.444605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:09:09.444605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:09.451631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 536/1043] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:09.452344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2f318-b826-415a-bea6-fab55dff30c6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-20d1224c-0a4b-4c73-85b3-f43fbc6044ee None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:09.461419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:09.462395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:09.463215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:09.463215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:09.463215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:09.463215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:09.463215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:09.463215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:09.463215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:09.463215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:09.463215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:09.463215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:09.463215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:09:09.463215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:09:09.463215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. May 26 18:09:09.463215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:09.464649 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 508/1044] 10.222.0.64 () {56 vars in 1105 bytes} [Thu May 26 18:09:09 2022] GET /identity/v3/services/image => generated 86 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:09:09.469381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1224c-0a4b-4c73-85b3-f43fbc6044ee None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:09.562113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84a2f318-b826-415a-bea6-fab55dff30c6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:09.581034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20d1224c-0a4b-4c73-85b3-f43fbc6044ee None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:09.596893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce4855-ef75-44fd-801e-2c6a3149ce4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:09.597599 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce4855-ef75-44fd-801e-2c6a3149ce4f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:09.597945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce4855-ef75-44fd-801e-2c6a3149ce4f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:09.598230 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ce4855-ef75-44fd-801e-2c6a3149ce4f None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:09.598949 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce4855-ef75-44fd-801e-2c6a3149ce4f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:09.599260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce4855-ef75-44fd-801e-2c6a3149ce4f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:09.600626 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3ce4855-ef75-44fd-801e-2c6a3149ce4f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:09.612244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 537/1045] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:09:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:09.617858 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce4855-ef75-44fd-801e-2c6a3149ce4f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:09.619726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df09a4-e1ab-44f2-a497-fbffe97bef6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:09.620394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df09a4-e1ab-44f2-a497-fbffe97bef6e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:09.620670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df09a4-e1ab-44f2-a497-fbffe97bef6e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:09.620952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0df09a4-e1ab-44f2-a497-fbffe97bef6e None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:09.621683 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df09a4-e1ab-44f2-a497-fbffe97bef6e None admin] RBAC: Adding query filter params (name=image) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:09.621990 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df09a4-e1ab-44f2-a497-fbffe97bef6e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:09.623916 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0df09a4-e1ab-44f2-a497-fbffe97bef6e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:09.633505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 509/1046] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:09 2022] GET /identity/v3/services?name=image => generated 122 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:09.634955 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df09a4-e1ab-44f2-a497-fbffe97bef6e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:09.639935 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:09.683641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:09.732772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ce4855-ef75-44fd-801e-2c6a3149ce4f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:09.739408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0df09a4-e1ab-44f2-a497-fbffe97bef6e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:09.768371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ea378-2cdf-48a2-8867-1917861f5aa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:09.769189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ea378-2cdf-48a2-8867-1917861f5aa7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:09.769469 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ea378-2cdf-48a2-8867-1917861f5aa7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:09.769740 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044ea378-2cdf-48a2-8867-1917861f5aa7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:09.774671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d764872-8581-4e7d-940a-d43dc60ae80c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:09.775334 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d764872-8581-4e7d-940a-d43dc60ae80c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:09.775625 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d764872-8581-4e7d-940a-d43dc60ae80c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:09.775906 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d764872-8581-4e7d-940a-d43dc60ae80c None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:09.776513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ea378-2cdf-48a2-8867-1917861f5aa7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:09.776611 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d764872-8581-4e7d-940a-d43dc60ae80c None admin] RBAC: Adding query filter params (type=image) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:09.776898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d764872-8581-4e7d-940a-d43dc60ae80c None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:09.777985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044ea378-2cdf-48a2-8867-1917861f5aa7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:09.778354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d764872-8581-4e7d-940a-d43dc60ae80c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:09.788547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 510/1047] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:09 2022] GET /identity/v3/services?type=image => generated 350 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:09.789183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d764872-8581-4e7d-940a-d43dc60ae80c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-044ea378-2cdf-48a2-8867-1917861f5aa7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:09:09.797106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:09.797985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:09.798910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:09:09.798910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:09:09.798910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:09:09.798910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:09:09.798910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:09:09.798910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:09:09.798910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:09:09.798910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:09.798910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 538/1048] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:09:09 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:09:09.803783 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ea378-2cdf-48a2-8867-1917861f5aa7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:09.884392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:09.898230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d764872-8581-4e7d-940a-d43dc60ae80c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:09.908331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044ea378-2cdf-48a2-8867-1917861f5aa7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:09.909994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:09.937235 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac772dd-8fa8-47c2-ab67-b5909cbf9b8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:09.937833 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac772dd-8fa8-47c2-ab67-b5909cbf9b8f None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:09.938124 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac772dd-8fa8-47c2-ab67-b5909cbf9b8f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:09.938409 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bac772dd-8fa8-47c2-ab67-b5909cbf9b8f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:09.939170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac772dd-8fa8-47c2-ab67-b5909cbf9b8f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:09.940637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bac772dd-8fa8-47c2-ab67-b5909cbf9b8f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:09.949205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7c61a7e-979a-43df-b4ca-800fc194a7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:09.950527 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c61a7e-979a-43df-b4ca-800fc194a7f0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:09.950893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c61a7e-979a-43df-b4ca-800fc194a7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:09.951273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7c61a7e-979a-43df-b4ca-800fc194a7f0 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:09.952286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c61a7e-979a-43df-b4ca-800fc194a7f0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:09.952604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c61a7e-979a-43df-b4ca-800fc194a7f0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:09.954267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7c61a7e-979a-43df-b4ca-800fc194a7f0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:09.961043 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 511/1049] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 26 18:09:09 2022] POST /identity/v3/endpoints => generated 327 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:09:09.971707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 539/1050] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:09:09 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:09.977999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac772dd-8fa8-47c2-ab67-b5909cbf9b8f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:10.096743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bac772dd-8fa8-47c2-ab67-b5909cbf9b8f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:10.133660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22bab63a-2819-4f60-b697-ced5e97b0a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:10.134331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bab63a-2819-4f60-b697-ced5e97b0a3a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:10.134620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bab63a-2819-4f60-b697-ced5e97b0a3a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:10.134900 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22bab63a-2819-4f60-b697-ced5e97b0a3a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:10.135738 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bab63a-2819-4f60-b697-ced5e97b0a3a None admin] RBAC: Adding query filter params (role.id=eb196236bdeb4a6f8f5f05fdbee6f00c, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=97f259ac2eb4425f8b4dcffeccdcd439) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:10.136054 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bab63a-2819-4f60-b697-ced5e97b0a3a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:10.137558 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22bab63a-2819-4f60-b697-ced5e97b0a3a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:10.147640 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 512/1051] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:09:09 2022] GET /identity/v3/role_assignments?user.id=97f259ac2eb4425f8b4dcffeccdcd439&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=eb196236bdeb4a6f8f5f05fdbee6f00c => generated 259 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:11.025589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2edb-d7fe-4ce6-b1b4-400a29ad7b14 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:11.026109 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2edb-d7fe-4ce6-b1b4-400a29ad7b14 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:11.026188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05c2edb-d7fe-4ce6-b1b4-400a29ad7b14 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:11.027648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 540/1052] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:11.032761 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5426f7-d1ab-43d2-a12a-2d87aa33e44a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:11.033188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5426f7-d1ab-43d2-a12a-2d87aa33e44a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:11.033357 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae5426f7-d1ab-43d2-a12a-2d87aa33e44a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:11.050042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ae5426f7-d1ab-43d2-a12a-2d87aa33e44a None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:11.051204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ae5426f7-d1ab-43d2-a12a-2d87aa33e44a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:11.072348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:11.121366 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 513/1053] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:11 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:11.145105 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c2edb-d7fe-4ce6-b1b4-400a29ad7b14 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:11.266956 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05c2edb-d7fe-4ce6-b1b4-400a29ad7b14 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:11.300897 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926329-e9b4-4566-ad80-a6cb83bc76e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:11.301632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926329-e9b4-4566-ad80-a6cb83bc76e4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:11.301919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926329-e9b4-4566-ad80-a6cb83bc76e4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:11.302195 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32926329-e9b4-4566-ad80-a6cb83bc76e4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:11.309151 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:11.314300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32926329-e9b4-4566-ad80-a6cb83bc76e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-32926329-e9b4-4566-ad80-a6cb83bc76e4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:09:11.322587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:11.323524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:11.324360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:11.324360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:11.324360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:11.324360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:11.324360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:09:11.324360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:09:11.324360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:09:11.324360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:09:11.324360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:09:11.324360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:09:11.324360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:09:11.324360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:11.324360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 541/1054] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:09:11 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:11.330377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5426f7-d1ab-43d2-a12a-2d87aa33e44a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:11.430395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae5426f7-d1ab-43d2-a12a-2d87aa33e44a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:11.463234 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c8acc-8e28-43c9-9d7f-a427c1baac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:11.463889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c8acc-8e28-43c9-9d7f-a427c1baac71 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:11.464166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c8acc-8e28-43c9-9d7f-a427c1baac71 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:11.464437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89c8acc-8e28-43c9-9d7f-a427c1baac71 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:11.465204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c8acc-8e28-43c9-9d7f-a427c1baac71 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:11.465512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c8acc-8e28-43c9-9d7f-a427c1baac71 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:11.466893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89c8acc-8e28-43c9-9d7f-a427c1baac71 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:11.479368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 514/1055] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:09:11 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:11.480654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926329-e9b4-4566-ad80-a6cb83bc76e4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:11.579277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32926329-e9b4-4566-ad80-a6cb83bc76e4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:11.612523 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c85b3-39f0-4028-b5bb-69e67c24c257 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:11.613707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c85b3-39f0-4028-b5bb-69e67c24c257 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:11.614168 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c85b3-39f0-4028-b5bb-69e67c24c257 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:11.614619 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b8c85b3-39f0-4028-b5bb-69e67c24c257 None admin] PATH_INFO: `/v3/users/4de06be9840548d7bc689a6dcc74c201` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:11.627921 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c85b3-39f0-4028-b5bb-69e67c24c257 None admin] RBAC: Authorizing `identity:get_user(user_id=4de06be9840548d7bc689a6dcc74c201)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:11.629611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b8c85b3-39f0-4028-b5bb-69e67c24c257 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:11.635793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 542/1056] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:09:11 2022] GET /identity/v3/users/4de06be9840548d7bc689a6dcc74c201 => generated 285 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:11.637663 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c8acc-8e28-43c9-9d7f-a427c1baac71 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:11.658362 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:11.739338 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89c8acc-8e28-43c9-9d7f-a427c1baac71 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:11.773842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d7d1b-37d4-4225-9d5b-c4217353eeb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:11.774843 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d7d1b-37d4-4225-9d5b-c4217353eeb5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:11.775350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d7d1b-37d4-4225-9d5b-c4217353eeb5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:11.775833 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f3d7d1b-37d4-4225-9d5b-c4217353eeb5 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:11.843458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d7d1b-37d4-4225-9d5b-c4217353eeb5 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:11.845277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f3d7d1b-37d4-4225-9d5b-c4217353eeb5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:11.863612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:11.946509 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 515/1057] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:09:11 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 309 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:09:11.952846 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c85b3-39f0-4028-b5bb-69e67c24c257 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:12.011098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:12.056099 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b8c85b3-39f0-4028-b5bb-69e67c24c257 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:12.091567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417eed6a-59b8-4fca-a40d-f14b3b1360c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:12.092515 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eed6a-59b8-4fca-a40d-f14b3b1360c8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:12.092826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eed6a-59b8-4fca-a40d-f14b3b1360c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:12.093145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417eed6a-59b8-4fca-a40d-f14b3b1360c8 None admin] PATH_INFO: `/v3/projects/d6b6bb3b9ccb48938264921a08c0e234` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:12.094489 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417eed6a-59b8-4fca-a40d-f14b3b1360c8 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b6bb3b9ccb48938264921a08c0e234)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:12.095908 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-417eed6a-59b8-4fca-a40d-f14b3b1360c8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:12.097978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 543/1058] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:09:11 2022] GET /identity/v3/projects/d6b6bb3b9ccb48938264921a08c0e234 => generated 311 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:12.103995 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d7d1b-37d4-4225-9d5b-c4217353eeb5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:12.219076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f3d7d1b-37d4-4225-9d5b-c4217353eeb5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:12.236921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:12.255260 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758f1d08-8712-4562-a756-e360d2cb39f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:12.255921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f1d08-8712-4562-a756-e360d2cb39f0 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:12.256206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f1d08-8712-4562-a756-e360d2cb39f0 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:12.256482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758f1d08-8712-4562-a756-e360d2cb39f0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:12.257335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f1d08-8712-4562-a756-e360d2cb39f0 None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=d6b6bb3b9ccb48938264921a08c0e234, user.id=4de06be9840548d7bc689a6dcc74c201) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:12.257650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f1d08-8712-4562-a756-e360d2cb39f0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:12.259082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758f1d08-8712-4562-a756-e360d2cb39f0 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:12.269079 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 516/1059] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:09:12 2022] GET /identity/v3/role_assignments?user.id=4de06be9840548d7bc689a6dcc74c201&scope.project.id=d6b6bb3b9ccb48938264921a08c0e234&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 259 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:12.286658 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e670a-0016-4052-a8f4-c2183faa67bb None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:12.286935 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e670a-0016-4052-a8f4-c2183faa67bb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:12.287216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee5e670a-0016-4052-a8f4-c2183faa67bb None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:12.288646 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 544/1060] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:12.295128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edbf8c-c498-413f-9ef8-92078b76f095 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:12.295592 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edbf8c-c498-413f-9ef8-92078b76f095 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:12.296006 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2edbf8c-c498-413f-9ef8-92078b76f095 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:12.315369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a2edbf8c-c498-413f-9ef8-92078b76f095 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:12.316581 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a2edbf8c-c498-413f-9ef8-92078b76f095 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:12.347881 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570833d-7e01-4c17-81bd-59dae0229a37 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:12.348089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570833d-7e01-4c17-81bd-59dae0229a37 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:12.348338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2570833d-7e01-4c17-81bd-59dae0229a37 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:12.353777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 545/1061] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:12.355350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16d6f-68cd-4bf5-9a06-2d3c85a9b4d3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:12.355633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16d6f-68cd-4bf5-9a06-2d3c85a9b4d3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:12.355906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f16d6f-68cd-4bf5-9a06-2d3c85a9b4d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:12.374187 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-76f16d6f-68cd-4bf5-9a06-2d3c85a9b4d3 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:12.375416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-76f16d6f-68cd-4bf5-9a06-2d3c85a9b4d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:12.397045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 517/1062] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 100 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:12.413320 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edbf8c-c498-413f-9ef8-92078b76f095 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:12.449720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 546/1063] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:12 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:12.478085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f16d6f-68cd-4bf5-9a06-2d3c85a9b4d3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:12.535030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:12.541701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2edbf8c-c498-413f-9ef8-92078b76f095 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:12.556695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:12.580034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7734c-ff95-4568-898c-e181456cc218 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:12.580688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f16d6f-68cd-4bf5-9a06-2d3c85a9b4d3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:12.581196 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7734c-ff95-4568-898c-e181456cc218 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:12.581662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7734c-ff95-4568-898c-e181456cc218 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:12.582253 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebf7734c-ff95-4568-898c-e181456cc218 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:12.616009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da025813-f743-4197-bcc9-eff0a9f88a39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:12.616745 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da025813-f743-4197-bcc9-eff0a9f88a39 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:12.617046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da025813-f743-4197-bcc9-eff0a9f88a39 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:12.617325 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da025813-f743-4197-bcc9-eff0a9f88a39 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:12.627355 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da025813-f743-4197-bcc9-eff0a9f88a39 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-da025813-f743-4197-bcc9-eff0a9f88a39 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:09:12.635546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:12.636522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:12.637383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:12.637383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:12.637383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:12.637383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:12.637383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:09:12.637383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:09:12.637383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:09:12.637383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:09:12.637383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:09:12.637383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:09:12.637383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 18:09:12.637383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:12.637383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 547/1064] 10.222.0.64 () {56 vars in 1120 bytes} [Thu May 26 18:09:12 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:09:12.642685 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da025813-f743-4197-bcc9-eff0a9f88a39 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:12.659141 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7734c-ff95-4568-898c-e181456cc218 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:12.660607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebf7734c-ff95-4568-898c-e181456cc218 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:12.745415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da025813-f743-4197-bcc9-eff0a9f88a39 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:12.760400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:12.772633 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 518/1065] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:09:12 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 355 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 18:09:12.774886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7734c-ff95-4568-898c-e181456cc218 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:12.783991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf38bf-7eac-423b-92ba-33d9cb8218e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:12.784672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf38bf-7eac-423b-92ba-33d9cb8218e7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:12.784961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf38bf-7eac-423b-92ba-33d9cb8218e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:12.785268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59bf38bf-7eac-423b-92ba-33d9cb8218e7 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:12.786025 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf38bf-7eac-423b-92ba-33d9cb8218e7 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:12.786698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf38bf-7eac-423b-92ba-33d9cb8218e7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:12.788411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59bf38bf-7eac-423b-92ba-33d9cb8218e7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:12.792946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:12.798242 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 548/1066] 10.222.0.64 () {56 vars in 1115 bytes} [Thu May 26 18:09:12 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:12.803866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf38bf-7eac-423b-92ba-33d9cb8218e7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:12.891568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebf7734c-ff95-4568-898c-e181456cc218 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:12.916860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59bf38bf-7eac-423b-92ba-33d9cb8218e7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:12.927413 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0195cf-d660-4901-b98d-19d9ebba51d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:12.928209 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0195cf-d660-4901-b98d-19d9ebba51d1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:12.928494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0195cf-d660-4901-b98d-19d9ebba51d1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:12.928764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af0195cf-d660-4901-b98d-19d9ebba51d1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:12.939588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0195cf-d660-4901-b98d-19d9ebba51d1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:12.941064 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af0195cf-d660-4901-b98d-19d9ebba51d1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:12.953564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19668a2-995d-4ffd-95cd-ebf469a7b397 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:12.954355 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19668a2-995d-4ffd-95cd-ebf469a7b397 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:12.954639 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19668a2-995d-4ffd-95cd-ebf469a7b397 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:12.954907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c19668a2-995d-4ffd-95cd-ebf469a7b397 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-af0195cf-d660-4901-b98d-19d9ebba51d1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:09:12.959055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:12.959922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:12.960791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:09:12.960791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:09:12.960791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:09:12.960791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:12.960791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 519/1067] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:09:12.966677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0195cf-d660-4901-b98d-19d9ebba51d1 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:12.967385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19668a2-995d-4ffd-95cd-ebf469a7b397 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:12.968830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c19668a2-995d-4ffd-95cd-ebf469a7b397 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-c19668a2-995d-4ffd-95cd-ebf469a7b397 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:09:12.989301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:12.990239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:12.991125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:09:12.991125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:09:12.991125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:09:12.991125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:12.995614 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 549/1068] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 192 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:12.996350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19668a2-995d-4ffd-95cd-ebf469a7b397 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:13.025680 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:13.032945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:13.077943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af0195cf-d660-4901-b98d-19d9ebba51d1 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:13.105190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c19668a2-995d-4ffd-95cd-ebf469a7b397 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:13.118148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0df04-bcd7-4cc3-bbf8-49f5e4f23bbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:13.118810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0df04-bcd7-4cc3-bbf8-49f5e4f23bbd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:13.119097 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0df04-bcd7-4cc3-bbf8-49f5e4f23bbd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:13.119376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7b0df04-bcd7-4cc3-bbf8-49f5e4f23bbd None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:13.120096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0df04-bcd7-4cc3-bbf8-49f5e4f23bbd None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:13.120405 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0df04-bcd7-4cc3-bbf8-49f5e4f23bbd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:13.121810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7b0df04-bcd7-4cc3-bbf8-49f5e4f23bbd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:13.134078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 520/1069] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:13.153562 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3921f-01e9-4733-ad45-7fc1162a32d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:13.154440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3921f-01e9-4733-ad45-7fc1162a32d4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:13.154937 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3921f-01e9-4733-ad45-7fc1162a32d4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:13.155411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6a3921f-01e9-4733-ad45-7fc1162a32d4 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:13.156808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3921f-01e9-4733-ad45-7fc1162a32d4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:13.157394 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3921f-01e9-4733-ad45-7fc1162a32d4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:13.160024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6a3921f-01e9-4733-ad45-7fc1162a32d4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:13.182489 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 550/1070] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:09:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 186 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:13.183848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0df04-bcd7-4cc3-bbf8-49f5e4f23bbd None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:13.296306 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7b0df04-bcd7-4cc3-bbf8-49f5e4f23bbd None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:13.321455 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:13.333623 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6af4-ef16-42cf-8d00-d4147e0f3151 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:13.334715 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6af4-ef16-42cf-8d00-d4147e0f3151 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:13.335000 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6af4-ef16-42cf-8d00-d4147e0f3151 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:13.335277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee6a6af4-ef16-42cf-8d00-d4147e0f3151 None admin] PATH_INFO: `/v3/users/nova` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:13.344585 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a6af4-ef16-42cf-8d00-d4147e0f3151 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:13.346143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee6a6af4-ef16-42cf-8d00-d4147e0f3151 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-ee6a6af4-ef16-42cf-8d00-d4147e0f3151 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:09:13.361121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:13.362302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:13.363525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:13.363525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:13.363525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:09:13.363525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:09:13.363525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:09:13.363525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:09:13.363525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:09:13.363525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:09:13.363525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 18:09:13.363525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:13.363525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 521/1071] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 26 18:09:13 2022] GET /identity/v3/users/nova => generated 82 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:09:13.369446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3921f-01e9-4733-ad45-7fc1162a32d4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:13.465873 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:13.478582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6a3921f-01e9-4733-ad45-7fc1162a32d4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:13.512033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c71e3-034f-49d1-bac9-ac191ed218e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:13.512702 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c71e3-034f-49d1-bac9-ac191ed218e7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:13.513041 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c71e3-034f-49d1-bac9-ac191ed218e7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:13.513329 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-969c71e3-034f-49d1-bac9-ac191ed218e7 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:13.514153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c71e3-034f-49d1-bac9-ac191ed218e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:13.514466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c71e3-034f-49d1-bac9-ac191ed218e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:13.515900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-969c71e3-034f-49d1-bac9-ac191ed218e7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:13.532929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 551/1072] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 26 18:09:13 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:13.538710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6af4-ef16-42cf-8d00-d4147e0f3151 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:13.635726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee6a6af4-ef16-42cf-8d00-d4147e0f3151 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:13.668395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84ca5f-baa2-4fe5-b2c5-b105a1c17653 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:13.669223 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ca5f-baa2-4fe5-b2c5-b105a1c17653 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:13.669509 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ca5f-baa2-4fe5-b2c5-b105a1c17653 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:13.669788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf84ca5f-baa2-4fe5-b2c5-b105a1c17653 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:13.679905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84ca5f-baa2-4fe5-b2c5-b105a1c17653 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:13.681370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf84ca5f-baa2-4fe5-b2c5-b105a1c17653 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-bf84ca5f-baa2-4fe5-b2c5-b105a1c17653 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:09:13.697850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:13.698883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:13.699894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:09:13.699894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:09:13.699894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:09:13.699894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:13.699894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 522/1073] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:13.705215 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c71e3-034f-49d1-bac9-ac191ed218e7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:13.801257 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-969c71e3-034f-49d1-bac9-ac191ed218e7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:13.833607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a105043-dae3-4dd6-913d-4e22ee2b0027 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:13.834260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a105043-dae3-4dd6-913d-4e22ee2b0027 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:13.834539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a105043-dae3-4dd6-913d-4e22ee2b0027 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:13.834813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a105043-dae3-4dd6-913d-4e22ee2b0027 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:13.835516 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a105043-dae3-4dd6-913d-4e22ee2b0027 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:13.835819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a105043-dae3-4dd6-913d-4e22ee2b0027 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:13.837191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a105043-dae3-4dd6-913d-4e22ee2b0027 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:13.847934 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 552/1074] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:09:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:13.853523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84ca5f-baa2-4fe5-b2c5-b105a1c17653 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:13.890758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:13.956261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf84ca5f-baa2-4fe5-b2c5-b105a1c17653 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:13.989938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e14ec4-4097-4f03-86c0-d8ad7c2a9d8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:13.990730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e14ec4-4097-4f03-86c0-d8ad7c2a9d8b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:13.991016 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e14ec4-4097-4f03-86c0-d8ad7c2a9d8b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:13.991294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54e14ec4-4097-4f03-86c0-d8ad7c2a9d8b None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:13.998585 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e14ec4-4097-4f03-86c0-d8ad7c2a9d8b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:14.000031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54e14ec4-4097-4f03-86c0-d8ad7c2a9d8b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-54e14ec4-4097-4f03-86c0-d8ad7c2a9d8b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:09:14.013628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:14.014677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:14.015886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:09:14.015886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:09:14.015886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:09:14.015886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:09:14.015886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:09:14.015886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:09:14.015886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:09:14.015886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:14.015886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 523/1075] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:09:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 162 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:14.020578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a105043-dae3-4dd6-913d-4e22ee2b0027 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:14.030291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:14.119594 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a105043-dae3-4dd6-913d-4e22ee2b0027 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:14.151781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f842797-00bf-47cf-9106-d3f6b3d9dbb2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:14.152445 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f842797-00bf-47cf-9106-d3f6b3d9dbb2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:14.152725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f842797-00bf-47cf-9106-d3f6b3d9dbb2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:14.153028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f842797-00bf-47cf-9106-d3f6b3d9dbb2 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:14.154344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f842797-00bf-47cf-9106-d3f6b3d9dbb2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:14.154655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f842797-00bf-47cf-9106-d3f6b3d9dbb2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:14.156068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f842797-00bf-47cf-9106-d3f6b3d9dbb2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:14.167686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 553/1076] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:09:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:14.174242 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e14ec4-4097-4f03-86c0-d8ad7c2a9d8b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:14.268042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:14.274735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54e14ec4-4097-4f03-86c0-d8ad7c2a9d8b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:14.311815 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3719d181-3d42-4fa9-a297-fa846468593e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:14.312705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719d181-3d42-4fa9-a297-fa846468593e None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:14.313023 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719d181-3d42-4fa9-a297-fa846468593e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:14.313281 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3719d181-3d42-4fa9-a297-fa846468593e None admin] PATH_INFO: `/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/97f259ac2eb4425f8b4dcffeccdcd439/roles/eb196236bdeb4a6f8f5f05fdbee6f00c` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:14.315436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719d181-3d42-4fa9-a297-fa846468593e None admin] RBAC: Authorizing `identity:create_grant(project_id=ab7fe8d932964e7ab1f442f26ef0735b, user_id=97f259ac2eb4425f8b4dcffeccdcd439, role_id=eb196236bdeb4a6f8f5f05fdbee6f00c)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:14.316870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3719d181-3d42-4fa9-a297-fa846468593e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:14.330843 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 524/1077] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:09:14 2022] PUT /identity/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/97f259ac2eb4425f8b4dcffeccdcd439/roles/eb196236bdeb4a6f8f5f05fdbee6f00c => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:14.475572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6894f9-83b2-4761-a96f-d6c39fe27807 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:14.475867 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6894f9-83b2-4761-a96f-d6c39fe27807 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:14.476144 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d6894f9-83b2-4761-a96f-d6c39fe27807 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:14.477591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 554/1078] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:14.483362 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfcb53-d84b-4364-be7c-ba69376d3556 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:14.483648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfcb53-d84b-4364-be7c-ba69376d3556 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:14.483929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87cfcb53-d84b-4364-be7c-ba69376d3556 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:14.501300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-87cfcb53-d84b-4364-be7c-ba69376d3556 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:14.502478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-87cfcb53-d84b-4364-be7c-ba69376d3556 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:14.569264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 525/1079] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:14.592005 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6894f9-83b2-4761-a96f-d6c39fe27807 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:14.656341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:14.690871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d6894f9-83b2-4761-a96f-d6c39fe27807 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:14.724103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e7e9c-bb31-4b4e-867f-b746f2446899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:14.724882 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e7e9c-bb31-4b4e-867f-b746f2446899 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:14.725190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e7e9c-bb31-4b4e-867f-b746f2446899 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:14.725464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-882e7e9c-bb31-4b4e-867f-b746f2446899 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:14.735477 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-882e7e9c-bb31-4b4e-867f-b746f2446899 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-882e7e9c-bb31-4b4e-867f-b746f2446899 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:09:14.742915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:14.744031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:14.745383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:14.745383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:14.745383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:14.745383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:14.745383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:09:14.745383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:09:14.745383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:09:14.745383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:09:14.745383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:09:14.745383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:09:14.745383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:09:14.745383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:14.745383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 555/1080] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:09:14 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:14.750462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfcb53-d84b-4364-be7c-ba69376d3556 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:14.832323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:14.848121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87cfcb53-d84b-4364-be7c-ba69376d3556 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:14.882086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c60672-0841-438b-8fbe-4b6278f3a63e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:14.882747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c60672-0841-438b-8fbe-4b6278f3a63e None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:14.883031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c60672-0841-438b-8fbe-4b6278f3a63e None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:14.883308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46c60672-0841-438b-8fbe-4b6278f3a63e None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:14.884048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c60672-0841-438b-8fbe-4b6278f3a63e None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:14.884356 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c60672-0841-438b-8fbe-4b6278f3a63e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:14.885746 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46c60672-0841-438b-8fbe-4b6278f3a63e None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:14.894149 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 526/1081] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:09:14 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:14.900067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e7e9c-bb31-4b4e-867f-b746f2446899 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:15.000466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-882e7e9c-bb31-4b4e-867f-b746f2446899 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:15.025187 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:15.034105 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c2479-f57a-48b1-b9c2-13981707959d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:15.034989 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c2479-f57a-48b1-b9c2-13981707959d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:15.035270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c2479-f57a-48b1-b9c2-13981707959d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:15.035547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d19c2479-f57a-48b1-b9c2-13981707959d None admin] PATH_INFO: `/v3/users/4de06be9840548d7bc689a6dcc74c201` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:15.036709 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c2479-f57a-48b1-b9c2-13981707959d None admin] RBAC: Authorizing `identity:get_user(user_id=4de06be9840548d7bc689a6dcc74c201)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:15.038179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d19c2479-f57a-48b1-b9c2-13981707959d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:15.039804 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 556/1082] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:09:14 2022] GET /identity/v3/users/4de06be9840548d7bc689a6dcc74c201 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:15.045515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c60672-0841-438b-8fbe-4b6278f3a63e None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:15.143743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46c60672-0841-438b-8fbe-4b6278f3a63e None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:15.176655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4254e7aa-54a3-4ea7-a5a3-ed827ffb0f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:15.177552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254e7aa-54a3-4ea7-a5a3-ed827ffb0f7b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:15.177834 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254e7aa-54a3-4ea7-a5a3-ed827ffb0f7b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:15.178105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4254e7aa-54a3-4ea7-a5a3-ed827ffb0f7b None admin] PATH_INFO: `/v3/projects/d6b6bb3b9ccb48938264921a08c0e234` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:15.179274 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254e7aa-54a3-4ea7-a5a3-ed827ffb0f7b None admin] RBAC: Authorizing `identity:get_project(project_id=d6b6bb3b9ccb48938264921a08c0e234)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:15.180710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4254e7aa-54a3-4ea7-a5a3-ed827ffb0f7b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:15.182439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 527/1083] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:09:15 2022] GET /identity/v3/projects/d6b6bb3b9ccb48938264921a08c0e234 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:15.188853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c2479-f57a-48b1-b9c2-13981707959d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:15.284807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d19c2479-f57a-48b1-b9c2-13981707959d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:15.317897 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdfc86c2-a960-4a10-baeb-4f7db4b6138c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:15.318812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc86c2-a960-4a10-baeb-4f7db4b6138c None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:15.319094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc86c2-a960-4a10-baeb-4f7db4b6138c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:15.319370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdfc86c2-a960-4a10-baeb-4f7db4b6138c None admin] PATH_INFO: `/v3/projects/d6b6bb3b9ccb48938264921a08c0e234/users/4de06be9840548d7bc689a6dcc74c201/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:15.321327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc86c2-a960-4a10-baeb-4f7db4b6138c None admin] RBAC: Authorizing `identity:create_grant(project_id=d6b6bb3b9ccb48938264921a08c0e234, user_id=4de06be9840548d7bc689a6dcc74c201, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:15.322745 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdfc86c2-a960-4a10-baeb-4f7db4b6138c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:15.336570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 557/1084] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:09:15 2022] PUT /identity/v3/projects/d6b6bb3b9ccb48938264921a08c0e234/users/4de06be9840548d7bc689a6dcc74c201/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:16.491049 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9044b0-6cc3-4bca-851d-0716aa1f4765 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.491539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9044b0-6cc3-4bca-851d-0716aa1f4765 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.491539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab9044b0-6cc3-4bca-851d-0716aa1f4765 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.492939 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 528/1085] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:16.498661 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3424db-8597-4923-af2b-d38e765df1ac None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.499087 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3424db-8597-4923-af2b-d38e765df1ac None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.499252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3424db-8597-4923-af2b-d38e765df1ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.516402 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1a3424db-8597-4923-af2b-d38e765df1ac None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:16.517601 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1a3424db-8597-4923-af2b-d38e765df1ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:16.565178 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:16.584261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 558/1086] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:16 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:16.607241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9044b0-6cc3-4bca-851d-0716aa1f4765 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.626229 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:16.707060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab9044b0-6cc3-4bca-851d-0716aa1f4765 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.739616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef58c2c-5e0a-4381-ad55-bfdb5c99b73d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.740407 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef58c2c-5e0a-4381-ad55-bfdb5c99b73d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.740690 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef58c2c-5e0a-4381-ad55-bfdb5c99b73d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.740965 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ef58c2c-5e0a-4381-ad55-bfdb5c99b73d None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.751376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ef58c2c-5e0a-4381-ad55-bfdb5c99b73d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-3ef58c2c-5e0a-4381-ad55-bfdb5c99b73d None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:09:16.759492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:16.760612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:16.761550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:16.761550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:16.761550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:16.761550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:16.761550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:09:16.761550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:09:16.761550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:09:16.761550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:09:16.761550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:09:16.761550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:09:16.761550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. May 26 18:09:16.761550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:16.765144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 529/1087] 10.222.0.64 () {56 vars in 1120 bytes} [Thu May 26 18:09:16 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 158 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:16.766605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3424db-8597-4923-af2b-d38e765df1ac None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.862561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3424db-8597-4923-af2b-d38e765df1ac None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:16.895180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e54162-9005-42bf-9c70-d16f843c0eca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:16.895840 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e54162-9005-42bf-9c70-d16f843c0eca None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:16.896122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e54162-9005-42bf-9c70-d16f843c0eca None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:16.896398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55e54162-9005-42bf-9c70-d16f843c0eca None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:16.897157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e54162-9005-42bf-9c70-d16f843c0eca None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:16.897464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e54162-9005-42bf-9c70-d16f843c0eca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:16.898818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55e54162-9005-42bf-9c70-d16f843c0eca None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:16.906621 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 559/1088] 10.222.0.64 () {56 vars in 1115 bytes} [Thu May 26 18:09:16 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:16.912353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef58c2c-5e0a-4381-ad55-bfdb5c99b73d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:16.989042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:17.012347 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ef58c2c-5e0a-4381-ad55-bfdb5c99b73d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:17.045452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc555ad-ad62-406c-a03e-56c8baff58c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:17.046233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc555ad-ad62-406c-a03e-56c8baff58c8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:17.046515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc555ad-ad62-406c-a03e-56c8baff58c8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:17.046791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bc555ad-ad62-406c-a03e-56c8baff58c8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:17.057084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc555ad-ad62-406c-a03e-56c8baff58c8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:17.058528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bc555ad-ad62-406c-a03e-56c8baff58c8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-3bc555ad-ad62-406c-a03e-56c8baff58c8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:09:17.075083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:17.076068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:17.076959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:09:17.076959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:09:17.076959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:09:17.076959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:17.076959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 530/1089] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:16 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:17.082090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e54162-9005-42bf-9c70-d16f843c0eca None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:17.128569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:17.201593 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55e54162-9005-42bf-9c70-d16f843c0eca None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:17.240600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0556aab-d1e5-473f-ae86-9b1422da24a4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:17.241288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556aab-d1e5-473f-ae86-9b1422da24a4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:17.241571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556aab-d1e5-473f-ae86-9b1422da24a4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:17.241847 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0556aab-d1e5-473f-ae86-9b1422da24a4 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:17.242560 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0556aab-d1e5-473f-ae86-9b1422da24a4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:17.242866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0556aab-d1e5-473f-ae86-9b1422da24a4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:17.244219 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0556aab-d1e5-473f-ae86-9b1422da24a4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:17.255644 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 560/1090] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:09:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:17.261327 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc555ad-ad62-406c-a03e-56c8baff58c8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:17.363527 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bc555ad-ad62-406c-a03e-56c8baff58c8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:17.389071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:17.396889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23802e3b-ea2f-457e-a4ad-533ab57c4dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:17.397712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23802e3b-ea2f-457e-a4ad-533ab57c4dff None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:17.397997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23802e3b-ea2f-457e-a4ad-533ab57c4dff None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:17.398271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23802e3b-ea2f-457e-a4ad-533ab57c4dff None admin] PATH_INFO: `/v3/users/nova` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:17.406631 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23802e3b-ea2f-457e-a4ad-533ab57c4dff None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:17.408089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23802e3b-ea2f-457e-a4ad-533ab57c4dff None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-23802e3b-ea2f-457e-a4ad-533ab57c4dff None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:09:17.422158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:17.423078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:17.424003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:17.424003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:17.424003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:09:17.424003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:09:17.424003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:09:17.424003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:09:17.424003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:09:17.424003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:09:17.424003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. May 26 18:09:17.424003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:17.424003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 531/1091] 10.222.0.64 () {56 vars in 1093 bytes} [Thu May 26 18:09:17 2022] GET /identity/v3/users/nova => generated 82 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:17.429135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0556aab-d1e5-473f-ae86-9b1422da24a4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:17.515082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447fd04-75d9-4333-89a2-6a077cf599a7 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:17.515606 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447fd04-75d9-4333-89a2-6a077cf599a7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:17.515606 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f447fd04-75d9-4333-89a2-6a077cf599a7 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:17.517007 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 532/1092] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:17 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:17.521882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5835f6-8761-4d30-b0c4-c08bec464532 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:17.522171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5835f6-8761-4d30-b0c4-c08bec464532 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:17.522451 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5835f6-8761-4d30-b0c4-c08bec464532 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:17.534578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0556aab-d1e5-473f-ae86-9b1422da24a4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:17.540066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8e5835f6-8761-4d30-b0c4-c08bec464532 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:17.541263 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8e5835f6-8761-4d30-b0c4-c08bec464532 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:17.542262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:17.569515 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84759b87-ff59-416c-aca2-5aa62a482f04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:17.570183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84759b87-ff59-416c-aca2-5aa62a482f04 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:17.570468 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84759b87-ff59-416c-aca2-5aa62a482f04 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:17.570746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84759b87-ff59-416c-aca2-5aa62a482f04 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:17.571567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84759b87-ff59-416c-aca2-5aa62a482f04 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:17.571881 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84759b87-ff59-416c-aca2-5aa62a482f04 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:17.573322 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84759b87-ff59-416c-aca2-5aa62a482f04 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:17.592540 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 561/1093] 10.222.0.64 () {56 vars in 1133 bytes} [Thu May 26 18:09:17 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:17.598252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84759b87-ff59-416c-aca2-5aa62a482f04 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:17.607252 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 533/1094] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:17 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:09:17.630351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5835f6-8761-4d30-b0c4-c08bec464532 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:17.692457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84759b87-ff59-416c-aca2-5aa62a482f04 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:17.725162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5835f6-8761-4d30-b0c4-c08bec464532 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:17.726066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7de87-72f8-4906-b18b-3abce04ec8b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:17.726716 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7de87-72f8-4906-b18b-3abce04ec8b7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:17.726996 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7de87-72f8-4906-b18b-3abce04ec8b7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:17.727275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd7de87-72f8-4906-b18b-3abce04ec8b7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:17.741917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:17.757853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:17.760134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f01f9-ba91-4c27-9109-587502090549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:17.760941 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f01f9-ba91-4c27-9109-587502090549 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:17.761212 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f01f9-ba91-4c27-9109-587502090549 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:17.761491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f6f01f9-ba91-4c27-9109-587502090549 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:17.771914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f6f01f9-ba91-4c27-9109-587502090549 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-3f6f01f9-ba91-4c27-9109-587502090549 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:09:17.779572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:17.780478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:17.781358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:17.781358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:17.781358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:17.781358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:17.781358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:09:17.781358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:09:17.781358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:09:17.781358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:09:17.781358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:09:17.781358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:09:17.781358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:09:17.781358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:17.781358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 534/1095] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:09:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:09:17.786514 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f01f9-ba91-4c27-9109-587502090549 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:17.794358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7de87-72f8-4906-b18b-3abce04ec8b7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:17.795805 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd7de87-72f8-4906-b18b-3abce04ec8b7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:17.882351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f6f01f9-ba91-4c27-9109-587502090549 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:17.892088 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 562/1096] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:09:17 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 18:09:17.897841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7de87-72f8-4906-b18b-3abce04ec8b7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:17.920688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cc950-eef1-4340-afd3-180a0281115d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:17.921385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cc950-eef1-4340-afd3-180a0281115d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:17.921668 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cc950-eef1-4340-afd3-180a0281115d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:17.921942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c10cc950-eef1-4340-afd3-180a0281115d None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:17.922684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cc950-eef1-4340-afd3-180a0281115d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:17.922994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cc950-eef1-4340-afd3-180a0281115d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:17.924365 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c10cc950-eef1-4340-afd3-180a0281115d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:17.932500 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 535/1097] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:09:17 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:17.938624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cc950-eef1-4340-afd3-180a0281115d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:17.965288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:17.980302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:18.002887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd7de87-72f8-4906-b18b-3abce04ec8b7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:18.036377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a6df7-89a0-417d-9a34-c5073a3fb161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:18.037196 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a6df7-89a0-417d-9a34-c5073a3fb161 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:18.037476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c10cc950-eef1-4340-afd3-180a0281115d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:18.037585 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a6df7-89a0-417d-9a34-c5073a3fb161 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:18.037757 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-551a6df7-89a0-417d-9a34-c5073a3fb161 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:18.047856 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a6df7-89a0-417d-9a34-c5073a3fb161 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:18.049337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-551a6df7-89a0-417d-9a34-c5073a3fb161 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-551a6df7-89a0-417d-9a34-c5073a3fb161 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:09:18.067042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:18.068203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:18.069642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:09:18.069642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:09:18.069642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:09:18.069642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:18.069642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 563/1098] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:09:18.072079 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b73bf-890d-4a43-9c6e-0de42971110d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:18.072951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b73bf-890d-4a43-9c6e-0de42971110d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:18.073270 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b73bf-890d-4a43-9c6e-0de42971110d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:18.073546 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c89b73bf-890d-4a43-9c6e-0de42971110d None admin] PATH_INFO: `/v3/users/4de06be9840548d7bc689a6dcc74c201` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:18.073706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a6df7-89a0-417d-9a34-c5073a3fb161 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:18.074734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b73bf-890d-4a43-9c6e-0de42971110d None admin] RBAC: Authorizing `identity:get_user(user_id=4de06be9840548d7bc689a6dcc74c201)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:18.076770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c89b73bf-890d-4a43-9c6e-0de42971110d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:18.082979 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 536/1099] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:09:17 2022] GET /identity/v3/users/4de06be9840548d7bc689a6dcc74c201 => generated 285 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:18.083887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b73bf-890d-4a43-9c6e-0de42971110d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:18.171522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-551a6df7-89a0-417d-9a34-c5073a3fb161 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:18.182943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c89b73bf-890d-4a43-9c6e-0de42971110d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:18.188471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:18.193102 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:18.207550 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d0431-4854-47e9-a962-80ac6763da98 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:18.208213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d0431-4854-47e9-a962-80ac6763da98 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:18.208497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d0431-4854-47e9-a962-80ac6763da98 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:18.208775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-761d0431-4854-47e9-a962-80ac6763da98 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:18.209531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d0431-4854-47e9-a962-80ac6763da98 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:18.209840 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d0431-4854-47e9-a962-80ac6763da98 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:18.211202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-761d0431-4854-47e9-a962-80ac6763da98 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:18.217405 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece61f8-662c-42ae-afdb-1e37c7910b8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:18.218039 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece61f8-662c-42ae-afdb-1e37c7910b8c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:18.218318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece61f8-662c-42ae-afdb-1e37c7910b8c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:18.218592 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fece61f8-662c-42ae-afdb-1e37c7910b8c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:18.222249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 564/1100] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:09:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:18.227711 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d0431-4854-47e9-a962-80ac6763da98 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:18.285258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece61f8-662c-42ae-afdb-1e37c7910b8c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:18.286703 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fece61f8-662c-42ae-afdb-1e37c7910b8c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:18.328300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-761d0431-4854-47e9-a962-80ac6763da98 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:18.362294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8b420-04dd-4f1e-81ed-fb934fbcf511 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:18.363072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b420-04dd-4f1e-81ed-fb934fbcf511 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:18.363353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b420-04dd-4f1e-81ed-fb934fbcf511 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:18.363627 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f8b420-04dd-4f1e-81ed-fb934fbcf511 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:18.370225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8b420-04dd-4f1e-81ed-fb934fbcf511 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:18.371742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f8b420-04dd-4f1e-81ed-fb934fbcf511 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-07f8b420-04dd-4f1e-81ed-fb934fbcf511 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:09:18.386817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:18.388147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:18.389380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:09:18.389380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:09:18.389380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:09:18.389380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:09:18.389380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:09:18.389380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:09:18.389380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:09:18.389380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:18.389949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 537/1101] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:09:18 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 18:09:18.390043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 565/1102] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:09:18 2022] GET /identity/v3/projects/service => generated 88 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:09:18.392762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece61f8-662c-42ae-afdb-1e37c7910b8c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:18.393572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8b420-04dd-4f1e-81ed-fb934fbcf511 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:18.402264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:18.428182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:18.490511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f8b420-04dd-4f1e-81ed-fb934fbcf511 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:18.493334 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fece61f8-662c-42ae-afdb-1e37c7910b8c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:18.524070 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f408a3-3b95-4835-adec-d035c61b0d64 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:18.524718 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f408a3-3b95-4835-adec-d035c61b0d64 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:18.525023 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f408a3-3b95-4835-adec-d035c61b0d64 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:18.525310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71f408a3-3b95-4835-adec-d035c61b0d64 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:18.526086 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f408a3-3b95-4835-adec-d035c61b0d64 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:18.526404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f408a3-3b95-4835-adec-d035c61b0d64 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:18.526840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c22e5-76e4-473c-8a39-cc6608151d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:18.527695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c22e5-76e4-473c-8a39-cc6608151d4a None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:18.527816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71f408a3-3b95-4835-adec-d035c61b0d64 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:18.527976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c22e5-76e4-473c-8a39-cc6608151d4a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:18.528255 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-893c22e5-76e4-473c-8a39-cc6608151d4a None admin] PATH_INFO: `/v3/projects/d6b6bb3b9ccb48938264921a08c0e234` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:18.529971 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c22e5-76e4-473c-8a39-cc6608151d4a None admin] RBAC: Authorizing `identity:get_project(project_id=d6b6bb3b9ccb48938264921a08c0e234)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:18.531376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-893c22e5-76e4-473c-8a39-cc6608151d4a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:18.533084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 538/1103] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:09:18 2022] GET /identity/v3/projects/d6b6bb3b9ccb48938264921a08c0e234 => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:18.538825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c22e5-76e4-473c-8a39-cc6608151d4a None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:18.540553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 566/1104] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:09:18 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:18.547266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f408a3-3b95-4835-adec-d035c61b0d64 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:18.613543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:18.636121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-893c22e5-76e4-473c-8a39-cc6608151d4a None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:18.639308 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:18.645259 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71f408a3-3b95-4835-adec-d035c61b0d64 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:18.669776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c796b6-70cf-4258-8709-1b0b931b69a3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:18.670402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c796b6-70cf-4258-8709-1b0b931b69a3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:18.670688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c796b6-70cf-4258-8709-1b0b931b69a3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:18.670978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c796b6-70cf-4258-8709-1b0b931b69a3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:18.671800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c796b6-70cf-4258-8709-1b0b931b69a3 None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=d6b6bb3b9ccb48938264921a08c0e234, user.id=4de06be9840548d7bc689a6dcc74c201) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:18.672116 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c796b6-70cf-4258-8709-1b0b931b69a3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:18.673635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c796b6-70cf-4258-8709-1b0b931b69a3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:18.679184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b0838b-84a0-4f20-bc75-5f1824dd49c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:18.679482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 539/1105] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:09:18 2022] GET /identity/v3/role_assignments?user.id=4de06be9840548d7bc689a6dcc74c201&scope.project.id=d6b6bb3b9ccb48938264921a08c0e234&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:18.679957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0838b-84a0-4f20-bc75-5f1824dd49c5 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:18.680303 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0838b-84a0-4f20-bc75-5f1824dd49c5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:18.680638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b0838b-84a0-4f20-bc75-5f1824dd49c5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:18.681546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0838b-84a0-4f20-bc75-5f1824dd49c5 None admin] RBAC: Adding query filter params (role.id=eb196236bdeb4a6f8f5f05fdbee6f00c, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=97f259ac2eb4425f8b4dcffeccdcd439) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:18.681939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0838b-84a0-4f20-bc75-5f1824dd49c5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:18.683401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b0838b-84a0-4f20-bc75-5f1824dd49c5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:18.689971 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 567/1106] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:09:18 2022] GET /identity/v3/role_assignments?user.id=97f259ac2eb4425f8b4dcffeccdcd439&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=eb196236bdeb4a6f8f5f05fdbee6f00c => generated 608 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:09:20.897893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aebb8c-deac-49b0-80ba-90724100e751 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:20.898414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aebb8c-deac-49b0-80ba-90724100e751 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:20.898505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5aebb8c-deac-49b0-80ba-90724100e751 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:20.899814 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 540/1107] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:20.905520 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a62f5-af6a-4dfe-b199-8fdba1bf65cd None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:20.905929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a62f5-af6a-4dfe-b199-8fdba1bf65cd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:20.906104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc3a62f5-af6a-4dfe-b199-8fdba1bf65cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:20.922829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cc3a62f5-af6a-4dfe-b199-8fdba1bf65cd None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:20.923989 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cc3a62f5-af6a-4dfe-b199-8fdba1bf65cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:20.990342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 568/1108] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:20 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:21.014036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aebb8c-deac-49b0-80ba-90724100e751 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:21.111875 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5aebb8c-deac-49b0-80ba-90724100e751 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:21.144443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcf3e2c3-61cb-4eef-8236-9faab72860db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:21.145245 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3e2c3-61cb-4eef-8236-9faab72860db None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:21.145531 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3e2c3-61cb-4eef-8236-9faab72860db None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:21.145809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcf3e2c3-61cb-4eef-8236-9faab72860db None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:21.146968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3e2c3-61cb-4eef-8236-9faab72860db None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:21.148455 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcf3e2c3-61cb-4eef-8236-9faab72860db None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:21.150032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 541/1109] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:21 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:21.156308 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a62f5-af6a-4dfe-b199-8fdba1bf65cd None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:21.254912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:21.266732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc3a62f5-af6a-4dfe-b199-8fdba1bf65cd None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:21.299751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b5862c1-cc5b-40a0-b922-ab7ecf8366c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:21.300413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5862c1-cc5b-40a0-b922-ab7ecf8366c4 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:21.300695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5862c1-cc5b-40a0-b922-ab7ecf8366c4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:21.300971 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b5862c1-cc5b-40a0-b922-ab7ecf8366c4 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:21.301704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5862c1-cc5b-40a0-b922-ab7ecf8366c4 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:21.303118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b5862c1-cc5b-40a0-b922-ab7ecf8366c4 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:21.321977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 569/1110] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:09:21 2022] POST /identity/v3/users => generated 286 bytes in 166 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:23.546633 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed865a2-57af-47d5-878b-1e5268c84496 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:23.547139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed865a2-57af-47d5-878b-1e5268c84496 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:23.547139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ed865a2-57af-47d5-878b-1e5268c84496 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:23.548452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 542/1111] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:23.553743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220480a-41b3-4e82-b765-9caf7e7e77f6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:23.554132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220480a-41b3-4e82-b765-9caf7e7e77f6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:23.554286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0220480a-41b3-4e82-b765-9caf7e7e77f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:23.570483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0220480a-41b3-4e82-b765-9caf7e7e77f6 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:23.571637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0220480a-41b3-4e82-b765-9caf7e7e77f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:23.640570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 570/1112] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:23.664211 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed865a2-57af-47d5-878b-1e5268c84496 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:23.674756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:23.762655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ed865a2-57af-47d5-878b-1e5268c84496 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:23.795298 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159a157-5156-4b84-9fcf-987391651e3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:23.796132 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159a157-5156-4b84-9fcf-987391651e3f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:23.796414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159a157-5156-4b84-9fcf-987391651e3f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:23.796737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d159a157-5156-4b84-9fcf-987391651e3f None admin] PATH_INFO: `/v3/roles/1b7e8aa514f04cef9c1da777642b34a8` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:23.798157 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159a157-5156-4b84-9fcf-987391651e3f None admin] RBAC: Authorizing `identity:get_role(role_id=1b7e8aa514f04cef9c1da777642b34a8)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:23.799524 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d159a157-5156-4b84-9fcf-987391651e3f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:23.800848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 543/1113] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:09:23 2022] GET /identity/v3/roles/1b7e8aa514f04cef9c1da777642b34a8 => generated 223 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:23.806398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220480a-41b3-4e82-b765-9caf7e7e77f6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:23.879532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:23.902699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0220480a-41b3-4e82-b765-9caf7e7e77f6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:23.935445 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e5e88-d604-4429-923d-9b829546bb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:23.936305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e5e88-d604-4429-923d-9b829546bb13 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:23.936630 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e5e88-d604-4429-923d-9b829546bb13 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:23.936976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e2e5e88-d604-4429-923d-9b829546bb13 None admin] PATH_INFO: `/v3/users/b54f131c1216421d98b8b67a6c33f297` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:23.949695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e5e88-d604-4429-923d-9b829546bb13 None admin] RBAC: Authorizing `identity:get_user(user_id=b54f131c1216421d98b8b67a6c33f297)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:23.951655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e2e5e88-d604-4429-923d-9b829546bb13 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:23.953315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 571/1114] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:09:23 2022] GET /identity/v3/users/b54f131c1216421d98b8b67a6c33f297 => generated 286 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:23.959209 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159a157-5156-4b84-9fcf-987391651e3f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:24.033158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:24.055210 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d159a157-5156-4b84-9fcf-987391651e3f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:24.088264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f449ffd-c7d7-4258-8648-787b214f0647 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:24.088895 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f449ffd-c7d7-4258-8648-787b214f0647 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:24.089208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f449ffd-c7d7-4258-8648-787b214f0647 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:24.089486 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f449ffd-c7d7-4258-8648-787b214f0647 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:24.153931 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f449ffd-c7d7-4258-8648-787b214f0647 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:24.155379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f449ffd-c7d7-4258-8648-787b214f0647 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:24.227682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:24.251799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 544/1115] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:09:23 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 293 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:09:24.257582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e5e88-d604-4429-923d-9b829546bb13 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:24.351250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e2e5e88-d604-4429-923d-9b829546bb13 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:24.384130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25aa50ca-1e6a-454b-aad9-214abf931568 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:24.384961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa50ca-1e6a-454b-aad9-214abf931568 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:24.385269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa50ca-1e6a-454b-aad9-214abf931568 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:24.385542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25aa50ca-1e6a-454b-aad9-214abf931568 None admin] PATH_INFO: `/v3/projects/d6b6bb3b9ccb48938264921a08c0e234` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:24.386688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa50ca-1e6a-454b-aad9-214abf931568 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b6bb3b9ccb48938264921a08c0e234)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:24.388122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25aa50ca-1e6a-454b-aad9-214abf931568 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:24.389781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 572/1116] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:09:24 2022] GET /identity/v3/projects/d6b6bb3b9ccb48938264921a08c0e234 => generated 311 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:24.395587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f449ffd-c7d7-4258-8648-787b214f0647 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:24.491681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f449ffd-c7d7-4258-8648-787b214f0647 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:24.524405 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99e0523e-460d-4208-934d-323de7c9b0da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:24.525065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0523e-460d-4208-934d-323de7c9b0da None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:24.525353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0523e-460d-4208-934d-323de7c9b0da None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:24.525632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99e0523e-460d-4208-934d-323de7c9b0da None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:24.526447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0523e-460d-4208-934d-323de7c9b0da None admin] RBAC: Adding query filter params (role.id=1b7e8aa514f04cef9c1da777642b34a8, scope.project.id=d6b6bb3b9ccb48938264921a08c0e234, user.id=b54f131c1216421d98b8b67a6c33f297) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:24.526762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0523e-460d-4208-934d-323de7c9b0da None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:24.528179 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99e0523e-460d-4208-934d-323de7c9b0da None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:24.534019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 545/1117] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:09:24 2022] GET /identity/v3/role_assignments?user.id=b54f131c1216421d98b8b67a6c33f297&scope.project.id=d6b6bb3b9ccb48938264921a08c0e234&role.id=1b7e8aa514f04cef9c1da777642b34a8 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:26.692470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7504fd-7849-4e25-ae26-4f70cdec4738 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:26.693049 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7504fd-7849-4e25-ae26-4f70cdec4738 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:26.693049 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f7504fd-7849-4e25-ae26-4f70cdec4738 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:26.694413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 573/1118] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:26.699651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc565-1843-430b-bac2-57a834651c19 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:26.700033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc565-1843-430b-bac2-57a834651c19 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:26.700696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86fc565-1843-430b-bac2-57a834651c19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:26.717609 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a86fc565-1843-430b-bac2-57a834651c19 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:26.718777 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a86fc565-1843-430b-bac2-57a834651c19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:26.751798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:26.783786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 546/1119] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:26 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:26.805483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7504fd-7849-4e25-ae26-4f70cdec4738 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:26.808384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:26.904909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f7504fd-7849-4e25-ae26-4f70cdec4738 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:26.938509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fe196-50d6-4967-a647-ca8982637cb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:26.939360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fe196-50d6-4967-a647-ca8982637cb1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:26.939638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fe196-50d6-4967-a647-ca8982637cb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:26.939910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e03fe196-50d6-4967-a647-ca8982637cb1 None admin] PATH_INFO: `/v3/roles/1b7e8aa514f04cef9c1da777642b34a8` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:26.941391 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fe196-50d6-4967-a647-ca8982637cb1 None admin] RBAC: Authorizing `identity:get_role(role_id=1b7e8aa514f04cef9c1da777642b34a8)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:26.942801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e03fe196-50d6-4967-a647-ca8982637cb1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:26.944124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 574/1120] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:09:26 2022] GET /identity/v3/roles/1b7e8aa514f04cef9c1da777642b34a8 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:26.949905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fc565-1843-430b-bac2-57a834651c19 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:27.044871 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86fc565-1843-430b-bac2-57a834651c19 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:27.076545 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68ef0d-3578-406c-8c66-42c21e246944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:27.077416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68ef0d-3578-406c-8c66-42c21e246944 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:27.077695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68ef0d-3578-406c-8c66-42c21e246944 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:27.077964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e68ef0d-3578-406c-8c66-42c21e246944 None admin] PATH_INFO: `/v3/users/b54f131c1216421d98b8b67a6c33f297` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:27.079104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68ef0d-3578-406c-8c66-42c21e246944 None admin] RBAC: Authorizing `identity:get_user(user_id=b54f131c1216421d98b8b67a6c33f297)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:27.080516 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e68ef0d-3578-406c-8c66-42c21e246944 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:27.082115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 547/1121] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:09:26 2022] GET /identity/v3/users/b54f131c1216421d98b8b67a6c33f297 => generated 286 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:27.087419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fe196-50d6-4967-a647-ca8982637cb1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:27.157161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:27.187139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e03fe196-50d6-4967-a647-ca8982637cb1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:27.220163 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d79d457-1bce-4c6a-8f95-33ef9f5eeb38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:27.220939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79d457-1bce-4c6a-8f95-33ef9f5eeb38 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:27.221248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79d457-1bce-4c6a-8f95-33ef9f5eeb38 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:27.221520 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d79d457-1bce-4c6a-8f95-33ef9f5eeb38 None admin] PATH_INFO: `/v3/projects/d6b6bb3b9ccb48938264921a08c0e234` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:27.222668 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79d457-1bce-4c6a-8f95-33ef9f5eeb38 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b6bb3b9ccb48938264921a08c0e234)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:27.224072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d79d457-1bce-4c6a-8f95-33ef9f5eeb38 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:27.225763 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 575/1122] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:09:27 2022] GET /identity/v3/projects/d6b6bb3b9ccb48938264921a08c0e234 => generated 311 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:27.231650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68ef0d-3578-406c-8c66-42c21e246944 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:27.270477 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:27.328865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e68ef0d-3578-406c-8c66-42c21e246944 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:27.362398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb2ad430-e674-4410-a9bc-663cdec8f641 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:27.363269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ad430-e674-4410-a9bc-663cdec8f641 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:27.363553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ad430-e674-4410-a9bc-663cdec8f641 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:27.363834 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb2ad430-e674-4410-a9bc-663cdec8f641 None admin] PATH_INFO: `/v3/projects/d6b6bb3b9ccb48938264921a08c0e234/users/b54f131c1216421d98b8b67a6c33f297/roles/1b7e8aa514f04cef9c1da777642b34a8` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:27.366023 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ad430-e674-4410-a9bc-663cdec8f641 None admin] RBAC: Authorizing `identity:create_grant(project_id=d6b6bb3b9ccb48938264921a08c0e234, user_id=b54f131c1216421d98b8b67a6c33f297, role_id=1b7e8aa514f04cef9c1da777642b34a8)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:27.367452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb2ad430-e674-4410-a9bc-663cdec8f641 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:27.379581 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 548/1123] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:09:27 2022] PUT /identity/v3/projects/d6b6bb3b9ccb48938264921a08c0e234/users/b54f131c1216421d98b8b67a6c33f297/roles/1b7e8aa514f04cef9c1da777642b34a8 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:29.507400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3929e-7aa2-4ca4-94b8-2fd30b2df211 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:29.507893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3929e-7aa2-4ca4-94b8-2fd30b2df211 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:29.507893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eba3929e-7aa2-4ca4-94b8-2fd30b2df211 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:29.509281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 576/1124] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:29.515204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175f10-91e9-4d85-8905-f071af26bf84 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:29.515620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175f10-91e9-4d85-8905-f071af26bf84 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:29.515757 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65175f10-91e9-4d85-8905-f071af26bf84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:29.532507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-65175f10-91e9-4d85-8905-f071af26bf84 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:29.533708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-65175f10-91e9-4d85-8905-f071af26bf84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:29.597543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 549/1125] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:29 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:29.620557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3929e-7aa2-4ca4-94b8-2fd30b2df211 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:29.719717 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eba3929e-7aa2-4ca4-94b8-2fd30b2df211 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:29.753595 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b93666-db2f-4674-999e-ef206446237d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:29.754430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b93666-db2f-4674-999e-ef206446237d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:29.754713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b93666-db2f-4674-999e-ef206446237d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:29.754991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84b93666-db2f-4674-999e-ef206446237d None admin] PATH_INFO: `/v3/roles/1b7e8aa514f04cef9c1da777642b34a8` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:29.756433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b93666-db2f-4674-999e-ef206446237d None admin] RBAC: Authorizing `identity:get_role(role_id=1b7e8aa514f04cef9c1da777642b34a8)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:29.757868 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84b93666-db2f-4674-999e-ef206446237d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:29.759170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 577/1126] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:09:29 2022] GET /identity/v3/roles/1b7e8aa514f04cef9c1da777642b34a8 => generated 223 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:29.764755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65175f10-91e9-4d85-8905-f071af26bf84 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:29.791493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:29.861646 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65175f10-91e9-4d85-8905-f071af26bf84 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:29.893519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c416fb7-e0e2-483f-ae08-257b1b71a81d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:29.894366 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c416fb7-e0e2-483f-ae08-257b1b71a81d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:29.894648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c416fb7-e0e2-483f-ae08-257b1b71a81d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:29.894919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c416fb7-e0e2-483f-ae08-257b1b71a81d None admin] PATH_INFO: `/v3/users/b54f131c1216421d98b8b67a6c33f297` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:29.896070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c416fb7-e0e2-483f-ae08-257b1b71a81d None admin] RBAC: Authorizing `identity:get_user(user_id=b54f131c1216421d98b8b67a6c33f297)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:29.897538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c416fb7-e0e2-483f-ae08-257b1b71a81d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:29.899126 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 550/1127] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:09:29 2022] GET /identity/v3/users/b54f131c1216421d98b8b67a6c33f297 => generated 286 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:29.905370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b93666-db2f-4674-999e-ef206446237d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:29.913929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:30.003071 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84b93666-db2f-4674-999e-ef206446237d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:30.035164 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb32c5-22fd-411a-8e78-4b675440a684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:30.035740 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb32c5-22fd-411a-8e78-4b675440a684 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:30.036026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb32c5-22fd-411a-8e78-4b675440a684 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:30.036307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44cb32c5-22fd-411a-8e78-4b675440a684 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:30.100691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb32c5-22fd-411a-8e78-4b675440a684 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:30.102167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44cb32c5-22fd-411a-8e78-4b675440a684 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:30.110434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:30.198622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 578/1128] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:09:29 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:09:30.204936 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c416fb7-e0e2-483f-ae08-257b1b71a81d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:30.295212 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:30.300918 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c416fb7-e0e2-483f-ae08-257b1b71a81d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:30.333287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86de9e8e-18d0-4268-8f08-2be786dd6603 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:30.334124 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9e8e-18d0-4268-8f08-2be786dd6603 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:30.334406 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9e8e-18d0-4268-8f08-2be786dd6603 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:30.334682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86de9e8e-18d0-4268-8f08-2be786dd6603 None admin] PATH_INFO: `/v3/projects/d6b6bb3b9ccb48938264921a08c0e234` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:30.335830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de9e8e-18d0-4268-8f08-2be786dd6603 None admin] RBAC: Authorizing `identity:get_project(project_id=d6b6bb3b9ccb48938264921a08c0e234)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:30.337280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86de9e8e-18d0-4268-8f08-2be786dd6603 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:30.338929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 551/1129] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:09:30 2022] GET /identity/v3/projects/d6b6bb3b9ccb48938264921a08c0e234 => generated 311 bytes in 134 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:30.345395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb32c5-22fd-411a-8e78-4b675440a684 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:30.439538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44cb32c5-22fd-411a-8e78-4b675440a684 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:30.446595 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:30.473671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab6cd1f-302f-4a0b-bff0-543290a7e3b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:30.474315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6cd1f-302f-4a0b-bff0-543290a7e3b0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:30.474600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6cd1f-302f-4a0b-bff0-543290a7e3b0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:30.474879 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab6cd1f-302f-4a0b-bff0-543290a7e3b0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:30.475697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6cd1f-302f-4a0b-bff0-543290a7e3b0 None admin] RBAC: Adding query filter params (role.id=1b7e8aa514f04cef9c1da777642b34a8, scope.project.id=d6b6bb3b9ccb48938264921a08c0e234, user.id=b54f131c1216421d98b8b67a6c33f297) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:30.476013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6cd1f-302f-4a0b-bff0-543290a7e3b0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:30.477469 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab6cd1f-302f-4a0b-bff0-543290a7e3b0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:30.483135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 579/1130] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:09:30 2022] GET /identity/v3/role_assignments?user.id=b54f131c1216421d98b8b67a6c33f297&scope.project.id=d6b6bb3b9ccb48938264921a08c0e234&role.id=1b7e8aa514f04cef9c1da777642b34a8 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:32.710180 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414c4f9-6a5d-41dd-ab00-f873c2efb5d7 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:32.710716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414c4f9-6a5d-41dd-ab00-f873c2efb5d7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:32.710716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c414c4f9-6a5d-41dd-ab00-f873c2efb5d7 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:32.712096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 552/1131] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:32.718007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a32ef8-ae4a-4fe4-b541-98c11e0e58c2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:32.718397 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a32ef8-ae4a-4fe4-b541-98c11e0e58c2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:32.718561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0a32ef8-ae4a-4fe4-b541-98c11e0e58c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:32.735090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c0a32ef8-ae4a-4fe4-b541-98c11e0e58c2 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:32.736271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c0a32ef8-ae4a-4fe4-b541-98c11e0e58c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:32.798729 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 580/1132] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:32.821953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414c4f9-6a5d-41dd-ab00-f873c2efb5d7 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:32.918629 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c414c4f9-6a5d-41dd-ab00-f873c2efb5d7 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:32.951844 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4a5b168-1825-4a9b-9bb7-3b40572475bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:32.952616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5b168-1825-4a9b-9bb7-3b40572475bf None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:32.952899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5b168-1825-4a9b-9bb7-3b40572475bf None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:32.953202 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4a5b168-1825-4a9b-9bb7-3b40572475bf None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:32.954348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5b168-1825-4a9b-9bb7-3b40572475bf None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:32.955775 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4a5b168-1825-4a9b-9bb7-3b40572475bf None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:32.957372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 553/1133] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:32 2022] GET /identity/v3/domains/default => generated 199 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:32.962976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a32ef8-ae4a-4fe4-b541-98c11e0e58c2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:33.055838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:33.058748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0a32ef8-ae4a-4fe4-b541-98c11e0e58c2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:33.092736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d6d8db-4450-4bc6-9c27-645513846bc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:33.093413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d8db-4450-4bc6-9c27-645513846bc0 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:33.093698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d8db-4450-4bc6-9c27-645513846bc0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:33.093975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d6d8db-4450-4bc6-9c27-645513846bc0 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:33.094678 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6d8db-4450-4bc6-9c27-645513846bc0 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:33.096094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d6d8db-4450-4bc6-9c27-645513846bc0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:33.119612 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 581/1134] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 26 18:09:32 2022] POST /identity/v3/projects => generated 311 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:35.288255 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0e94a-840d-4f77-bf95-a61585902678 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:35.288786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0e94a-840d-4f77-bf95-a61585902678 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:35.288786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa0e94a-840d-4f77-bf95-a61585902678 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:35.290181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 554/1135] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:35.295484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e1390-aa23-41ac-aa65-dac8cbdbcb8c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:35.295871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e1390-aa23-41ac-aa65-dac8cbdbcb8c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:35.296031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-084e1390-aa23-41ac-aa65-dac8cbdbcb8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:35.312688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-084e1390-aa23-41ac-aa65-dac8cbdbcb8c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:35.313886 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-084e1390-aa23-41ac-aa65-dac8cbdbcb8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:35.377416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 582/1136] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:35 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:35.401338 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0e94a-840d-4f77-bf95-a61585902678 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:35.439784 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:35.508158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa0e94a-840d-4f77-bf95-a61585902678 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:35.539982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decbbe67-53a6-4ccd-8c49-fbbbce0b11ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:35.540757 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbbe67-53a6-4ccd-8c49-fbbbce0b11ba None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:35.541067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbbe67-53a6-4ccd-8c49-fbbbce0b11ba None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:35.541345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decbbe67-53a6-4ccd-8c49-fbbbce0b11ba None admin] PATH_INFO: `/v3/domains/default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:35.542493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbbe67-53a6-4ccd-8c49-fbbbce0b11ba None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:35.544440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decbbe67-53a6-4ccd-8c49-fbbbce0b11ba None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:35.546049 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 555/1137] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:09:35 2022] GET /identity/v3/domains/default => generated 199 bytes in 145 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:35.551762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e1390-aa23-41ac-aa65-dac8cbdbcb8c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:35.629425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:35.647135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-084e1390-aa23-41ac-aa65-dac8cbdbcb8c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:35.679087 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68b544a6-0f9c-4990-8284-7c5b1e2920a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:35.679688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b544a6-0f9c-4990-8284-7c5b1e2920a5 None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:35.679967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b544a6-0f9c-4990-8284-7c5b1e2920a5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:35.680241 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68b544a6-0f9c-4990-8284-7c5b1e2920a5 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:35.680937 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b544a6-0f9c-4990-8284-7c5b1e2920a5 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:35.682372 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68b544a6-0f9c-4990-8284-7c5b1e2920a5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:35.701617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 583/1138] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:09:35 2022] POST /identity/v3/users => generated 286 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:37.919560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6f3a6-5b01-40bd-8357-34f78a047fd1 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:37.920125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6f3a6-5b01-40bd-8357-34f78a047fd1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:37.920125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c6f3a6-5b01-40bd-8357-34f78a047fd1 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:37.921482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 556/1139] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:37.926723 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1bfb8-ff13-4c4d-a8a5-f5bfc171295c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:37.927105 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1bfb8-ff13-4c4d-a8a5-f5bfc171295c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:37.927276 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92f1bfb8-ff13-4c4d-a8a5-f5bfc171295c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:37.943381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-92f1bfb8-ff13-4c4d-a8a5-f5bfc171295c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:37.944534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-92f1bfb8-ff13-4c4d-a8a5-f5bfc171295c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:38.008646 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 584/1140] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:37 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:38.031686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6f3a6-5b01-40bd-8357-34f78a047fd1 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:38.125414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:38.129460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c6f3a6-5b01-40bd-8357-34f78a047fd1 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:38.162425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877aa3c-81dd-449d-8596-a5692ef6f63b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:38.163201 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877aa3c-81dd-449d-8596-a5692ef6f63b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:38.163481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877aa3c-81dd-449d-8596-a5692ef6f63b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:38.163751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8877aa3c-81dd-449d-8596-a5692ef6f63b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:38.173576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8877aa3c-81dd-449d-8596-a5692ef6f63b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-8877aa3c-81dd-449d-8596-a5692ef6f63b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:09:38.181011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:38.182117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:38.183154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:38.183154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:38.183154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:38.183154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:38.183154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:09:38.183154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:09:38.183154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:09:38.183154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:09:38.183154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:09:38.183154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:09:38.183154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:09:38.183154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:38.183154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 557/1141] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:09:38 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:09:38.188735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1bfb8-ff13-4c4d-a8a5-f5bfc171295c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:38.251944 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:38.284010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92f1bfb8-ff13-4c4d-a8a5-f5bfc171295c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:38.316362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5ee71-4a30-4995-9974-b7ba3768856f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:38.317035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ee71-4a30-4995-9974-b7ba3768856f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:38.317320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ee71-4a30-4995-9974-b7ba3768856f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:38.317595 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ae5ee71-4a30-4995-9974-b7ba3768856f None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:38.318324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5ee71-4a30-4995-9974-b7ba3768856f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:38.318631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5ee71-4a30-4995-9974-b7ba3768856f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:38.319987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ae5ee71-4a30-4995-9974-b7ba3768856f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:38.327771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 585/1142] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:09:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:38.333474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877aa3c-81dd-449d-8596-a5692ef6f63b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:38.431881 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8877aa3c-81dd-449d-8596-a5692ef6f63b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:38.464049 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f60ae-3e5e-453e-9333-4547c59b7eb6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:38.464909 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f60ae-3e5e-453e-9333-4547c59b7eb6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:38.465222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f60ae-3e5e-453e-9333-4547c59b7eb6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:38.465498 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a7f60ae-3e5e-453e-9333-4547c59b7eb6 None admin] PATH_INFO: `/v3/users/b8d9f98ebdc1456a9d20aadc928e9177` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:38.479445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f60ae-3e5e-453e-9333-4547c59b7eb6 None admin] RBAC: Authorizing `identity:get_user(user_id=b8d9f98ebdc1456a9d20aadc928e9177)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:38.480894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a7f60ae-3e5e-453e-9333-4547c59b7eb6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:38.482569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 558/1143] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:09:38 2022] GET /identity/v3/users/b8d9f98ebdc1456a9d20aadc928e9177 => generated 286 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:38.488525 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5ee71-4a30-4995-9974-b7ba3768856f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:38.583243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ae5ee71-4a30-4995-9974-b7ba3768856f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:38.610249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:38.616456 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3a482-9e45-41d1-8a4f-837baf91a5ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:38.617131 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3a482-9e45-41d1-8a4f-837baf91a5ce None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:38.617421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3a482-9e45-41d1-8a4f-837baf91a5ce None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:38.617702 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb3a482-9e45-41d1-8a4f-837baf91a5ce None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:38.682281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3a482-9e45-41d1-8a4f-837baf91a5ce None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:38.683652 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb3a482-9e45-41d1-8a4f-837baf91a5ce None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:38.778053 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 586/1144] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:09:38 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:09:38.783664 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f60ae-3e5e-453e-9333-4547c59b7eb6 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:38.801970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:38.881106 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a7f60ae-3e5e-453e-9333-4547c59b7eb6 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:38.914005 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4615b205-a179-4a9b-bb70-cfba1e75e724 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:38.914843 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615b205-a179-4a9b-bb70-cfba1e75e724 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:38.915128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615b205-a179-4a9b-bb70-cfba1e75e724 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:38.915405 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4615b205-a179-4a9b-bb70-cfba1e75e724 None admin] PATH_INFO: `/v3/projects/e28c1c54a42c4919934c27aa24708d4a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:38.916563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615b205-a179-4a9b-bb70-cfba1e75e724 None admin] RBAC: Authorizing `identity:get_project(project_id=e28c1c54a42c4919934c27aa24708d4a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:38.918017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4615b205-a179-4a9b-bb70-cfba1e75e724 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:38.919706 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 559/1145] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:09:38 2022] GET /identity/v3/projects/e28c1c54a42c4919934c27aa24708d4a => generated 311 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:38.925566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3a482-9e45-41d1-8a4f-837baf91a5ce None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:38.955233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:39.022920 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb3a482-9e45-41d1-8a4f-837baf91a5ce None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:39.055059 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee533522-8165-4c5d-87df-36c7a86db11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:39.055694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee533522-8165-4c5d-87df-36c7a86db11a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:39.055970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee533522-8165-4c5d-87df-36c7a86db11a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:39.056237 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee533522-8165-4c5d-87df-36c7a86db11a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:39.057070 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee533522-8165-4c5d-87df-36c7a86db11a None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=e28c1c54a42c4919934c27aa24708d4a, user.id=b8d9f98ebdc1456a9d20aadc928e9177) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:39.057380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee533522-8165-4c5d-87df-36c7a86db11a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:39.058782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee533522-8165-4c5d-87df-36c7a86db11a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:39.064446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 587/1146] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:09:38 2022] GET /identity/v3/role_assignments?user.id=b8d9f98ebdc1456a9d20aadc928e9177&scope.project.id=e28c1c54a42c4919934c27aa24708d4a&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:41.195999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38adc4-062d-4fee-99be-b4056fe06721 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:41.196506 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38adc4-062d-4fee-99be-b4056fe06721 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:41.196607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f38adc4-062d-4fee-99be-b4056fe06721 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:41.197942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 560/1147] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:41.203703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aef0d2-0c38-4f29-8d48-9ed2903dde37 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:41.204075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aef0d2-0c38-4f29-8d48-9ed2903dde37 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:41.204260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38aef0d2-0c38-4f29-8d48-9ed2903dde37 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:41.220440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-38aef0d2-0c38-4f29-8d48-9ed2903dde37 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:41.221637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-38aef0d2-0c38-4f29-8d48-9ed2903dde37 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:41.286278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 588/1148] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:41 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:41.308611 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38adc4-062d-4fee-99be-b4056fe06721 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:41.391199 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:41.406984 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f38adc4-062d-4fee-99be-b4056fe06721 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:41.438811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44150b-ad1d-43fd-9a9c-38c29d08d43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:41.439585 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44150b-ad1d-43fd-9a9c-38c29d08d43b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:41.439866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44150b-ad1d-43fd-9a9c-38c29d08d43b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:41.440139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f44150b-ad1d-43fd-9a9c-38c29d08d43b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:41.449877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f44150b-ad1d-43fd-9a9c-38c29d08d43b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-8f44150b-ad1d-43fd-9a9c-38c29d08d43b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:09:41.458009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:41.459096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:41.460084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:41.460084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:41.460084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:41.460084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:41.460084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:09:41.460084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:09:41.460084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:09:41.460084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:09:41.460084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:09:41.460084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:09:41.460084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:09:41.460084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:41.460084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 561/1149] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:09:41 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:41.465251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aef0d2-0c38-4f29-8d48-9ed2903dde37 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:41.492423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:41.563578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38aef0d2-0c38-4f29-8d48-9ed2903dde37 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:41.596531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee220a-967f-4b29-9962-00be2da9d358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:41.597214 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee220a-967f-4b29-9962-00be2da9d358 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:41.597497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee220a-967f-4b29-9962-00be2da9d358 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:41.597771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9ee220a-967f-4b29-9962-00be2da9d358 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:41.598504 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee220a-967f-4b29-9962-00be2da9d358 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:41.598809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee220a-967f-4b29-9962-00be2da9d358 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:41.600158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9ee220a-967f-4b29-9962-00be2da9d358 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:41.607959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 589/1150] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:09:41 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:41.614036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44150b-ad1d-43fd-9a9c-38c29d08d43b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:41.710960 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f44150b-ad1d-43fd-9a9c-38c29d08d43b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:41.743933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77429731-68e3-453b-9095-f1864c99858d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:41.744852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77429731-68e3-453b-9095-f1864c99858d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:41.745167 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77429731-68e3-453b-9095-f1864c99858d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:41.745448 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77429731-68e3-453b-9095-f1864c99858d None admin] PATH_INFO: `/v3/users/b8d9f98ebdc1456a9d20aadc928e9177` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:41.746617 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77429731-68e3-453b-9095-f1864c99858d None admin] RBAC: Authorizing `identity:get_user(user_id=b8d9f98ebdc1456a9d20aadc928e9177)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:41.748565 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77429731-68e3-453b-9095-f1864c99858d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:41.750199 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 562/1151] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:09:41 2022] GET /identity/v3/users/b8d9f98ebdc1456a9d20aadc928e9177 => generated 286 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:41.755767 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee220a-967f-4b29-9962-00be2da9d358 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:41.843179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:41.858174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9ee220a-967f-4b29-9962-00be2da9d358 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:41.890872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8472bb73-900c-4547-a82d-18202447abb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:41.891720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472bb73-900c-4547-a82d-18202447abb8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:41.891999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472bb73-900c-4547-a82d-18202447abb8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:41.892272 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8472bb73-900c-4547-a82d-18202447abb8 None admin] PATH_INFO: `/v3/projects/e28c1c54a42c4919934c27aa24708d4a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:41.893457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472bb73-900c-4547-a82d-18202447abb8 None admin] RBAC: Authorizing `identity:get_project(project_id=e28c1c54a42c4919934c27aa24708d4a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:41.894881 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8472bb73-900c-4547-a82d-18202447abb8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:41.896562 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 590/1152] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:09:41 2022] GET /identity/v3/projects/e28c1c54a42c4919934c27aa24708d4a => generated 311 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:41.902390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77429731-68e3-453b-9095-f1864c99858d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:41.917915 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:41.999183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77429731-68e3-453b-9095-f1864c99858d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:42.031278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f25cd35e-51a3-4e54-bc10-506eba3bc9e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:42.032145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cd35e-51a3-4e54-bc10-506eba3bc9e9 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:42.032430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cd35e-51a3-4e54-bc10-506eba3bc9e9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:42.032707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f25cd35e-51a3-4e54-bc10-506eba3bc9e9 None admin] PATH_INFO: `/v3/projects/e28c1c54a42c4919934c27aa24708d4a/users/b8d9f98ebdc1456a9d20aadc928e9177/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:42.034653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cd35e-51a3-4e54-bc10-506eba3bc9e9 None admin] RBAC: Authorizing `identity:create_grant(project_id=e28c1c54a42c4919934c27aa24708d4a, user_id=b8d9f98ebdc1456a9d20aadc928e9177, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:42.036078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f25cd35e-51a3-4e54-bc10-506eba3bc9e9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:42.048688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 563/1153] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:09:41 2022] PUT /identity/v3/projects/e28c1c54a42c4919934c27aa24708d4a/users/b8d9f98ebdc1456a9d20aadc928e9177/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:09:44.206938 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2274b-6dfd-4c21-8399-d1f5869020b9 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:44.207438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2274b-6dfd-4c21-8399-d1f5869020b9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:44.207556 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d2274b-6dfd-4c21-8399-d1f5869020b9 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:44.208865 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 591/1154] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:44.214079 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9b76b-2e7e-4098-833f-f8d79bb76cbd None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:44.214477 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9b76b-2e7e-4098-833f-f8d79bb76cbd None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:44.214648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e9b76b-2e7e-4098-833f-f8d79bb76cbd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:44.231495 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-51e9b76b-2e7e-4098-833f-f8d79bb76cbd None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:44.233288 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-51e9b76b-2e7e-4098-833f-f8d79bb76cbd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:44.297588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 564/1155] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:44 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:44.320084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2274b-6dfd-4c21-8399-d1f5869020b9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:44.419045 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d2274b-6dfd-4c21-8399-d1f5869020b9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:44.452169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbac207-f6bf-4738-b4a9-ff05aa15c6f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:44.452963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbac207-f6bf-4738-b4a9-ff05aa15c6f4 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:44.453274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbac207-f6bf-4738-b4a9-ff05aa15c6f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:44.453551 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efbac207-f6bf-4738-b4a9-ff05aa15c6f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:44.463475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efbac207-f6bf-4738-b4a9-ff05aa15c6f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-efbac207-f6bf-4738-b4a9-ff05aa15c6f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:09:44.471664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:44.472618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:44.473715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:44.473715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:44.473715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:44.473715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:44.473715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:09:44.473715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:09:44.473715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:09:44.473715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:09:44.473715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:09:44.473715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:09:44.473715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:09:44.473715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:44.473715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 592/1156] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:09:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:44.478920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9b76b-2e7e-4098-833f-f8d79bb76cbd None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:44.482012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:44.576314 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e9b76b-2e7e-4098-833f-f8d79bb76cbd None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:44.609840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1371e-6d55-409b-b5aa-e44ebd320b1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:44.610498 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1371e-6d55-409b-b5aa-e44ebd320b1f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:44.610776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1371e-6d55-409b-b5aa-e44ebd320b1f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:44.611050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24c1371e-6d55-409b-b5aa-e44ebd320b1f None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:44.611776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1371e-6d55-409b-b5aa-e44ebd320b1f None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:44.612081 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1371e-6d55-409b-b5aa-e44ebd320b1f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:44.613483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24c1371e-6d55-409b-b5aa-e44ebd320b1f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:44.621136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 565/1157] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:09:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:44.626792 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbac207-f6bf-4738-b4a9-ff05aa15c6f4 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:44.643012 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:44.724643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efbac207-f6bf-4738-b4a9-ff05aa15c6f4 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:44.756870 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05fa4-0772-41b4-918b-8bfae4f6e86b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:44.757743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05fa4-0772-41b4-918b-8bfae4f6e86b None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:44.758027 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05fa4-0772-41b4-918b-8bfae4f6e86b None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:44.758301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10f05fa4-0772-41b4-918b-8bfae4f6e86b None admin] PATH_INFO: `/v3/users/b8d9f98ebdc1456a9d20aadc928e9177` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:44.759452 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f05fa4-0772-41b4-918b-8bfae4f6e86b None admin] RBAC: Authorizing `identity:get_user(user_id=b8d9f98ebdc1456a9d20aadc928e9177)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:44.760877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10f05fa4-0772-41b4-918b-8bfae4f6e86b None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:44.762498 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 593/1158] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:09:44 2022] GET /identity/v3/users/b8d9f98ebdc1456a9d20aadc928e9177 => generated 286 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:44.768535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1371e-6d55-409b-b5aa-e44ebd320b1f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:44.831606 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:44.865302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24c1371e-6d55-409b-b5aa-e44ebd320b1f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:44.898103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8346a45-8ee4-4730-bf10-524794f27933 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:44.898739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8346a45-8ee4-4730-bf10-524794f27933 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:44.899023 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8346a45-8ee4-4730-bf10-524794f27933 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:44.899302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8346a45-8ee4-4730-bf10-524794f27933 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:44.964079 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8346a45-8ee4-4730-bf10-524794f27933 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:44.965547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8346a45-8ee4-4730-bf10-524794f27933 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:45.025348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:45.058346 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 566/1159] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:09:44 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:09:45.064564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05fa4-0772-41b4-918b-8bfae4f6e86b None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:45.144770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:45.162688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10f05fa4-0772-41b4-918b-8bfae4f6e86b None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:45.195164 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cb2aa2-951e-42f0-9e62-eb56954bcae0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:45.196000 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb2aa2-951e-42f0-9e62-eb56954bcae0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:45.196275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb2aa2-951e-42f0-9e62-eb56954bcae0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:45.196546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cb2aa2-951e-42f0-9e62-eb56954bcae0 None admin] PATH_INFO: `/v3/projects/e28c1c54a42c4919934c27aa24708d4a` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:45.197709 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb2aa2-951e-42f0-9e62-eb56954bcae0 None admin] RBAC: Authorizing `identity:get_project(project_id=e28c1c54a42c4919934c27aa24708d4a)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:45.199114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8cb2aa2-951e-42f0-9e62-eb56954bcae0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:45.200775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 594/1160] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:09:45 2022] GET /identity/v3/projects/e28c1c54a42c4919934c27aa24708d4a => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:45.206713 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8346a45-8ee4-4730-bf10-524794f27933 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:45.301498 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8346a45-8ee4-4730-bf10-524794f27933 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:45.334653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7291d11e-f3f1-4615-9b5a-22ddc3e2fcc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:45.335294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d11e-f3f1-4615-9b5a-22ddc3e2fcc6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:45.335578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d11e-f3f1-4615-9b5a-22ddc3e2fcc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:45.335856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7291d11e-f3f1-4615-9b5a-22ddc3e2fcc6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:45.336680 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291d11e-f3f1-4615-9b5a-22ddc3e2fcc6 None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=e28c1c54a42c4919934c27aa24708d4a, user.id=b8d9f98ebdc1456a9d20aadc928e9177) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:45.337017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291d11e-f3f1-4615-9b5a-22ddc3e2fcc6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:45.338446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7291d11e-f3f1-4615-9b5a-22ddc3e2fcc6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:45.344762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 567/1161] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:09:45 2022] GET /identity/v3/role_assignments?user.id=b8d9f98ebdc1456a9d20aadc928e9177&scope.project.id=e28c1c54a42c4919934c27aa24708d4a&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 608 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:47.540747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26e097-61ca-4aca-b4b3-961a94b79ed9 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:47.541279 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26e097-61ca-4aca-b4b3-961a94b79ed9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:47.541279 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b26e097-61ca-4aca-b4b3-961a94b79ed9 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:47.542624 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 595/1162] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:47.548435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc438f1c-a5aa-4f26-9e7e-86079a9dc65e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:47.548861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc438f1c-a5aa-4f26-9e7e-86079a9dc65e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:47.549005 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc438f1c-a5aa-4f26-9e7e-86079a9dc65e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:47.565788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fc438f1c-a5aa-4f26-9e7e-86079a9dc65e None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:47.566949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fc438f1c-a5aa-4f26-9e7e-86079a9dc65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:47.589650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:47.631830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 568/1163] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:47 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:47.653539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26e097-61ca-4aca-b4b3-961a94b79ed9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:47.752964 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b26e097-61ca-4aca-b4b3-961a94b79ed9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:47.785960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e40ad0-5669-41fb-a656-fbcc6979de66 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:47.786598 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e40ad0-5669-41fb-a656-fbcc6979de66 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:47.786883 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e40ad0-5669-41fb-a656-fbcc6979de66 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:47.787160 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11e40ad0-5669-41fb-a656-fbcc6979de66 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:47.805411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:47.852694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e40ad0-5669-41fb-a656-fbcc6979de66 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:47.854164 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11e40ad0-5669-41fb-a656-fbcc6979de66 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:47.948376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 596/1164] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:09:47 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 295 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:09:47.954218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc438f1c-a5aa-4f26-9e7e-86079a9dc65e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:48.048926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc438f1c-a5aa-4f26-9e7e-86079a9dc65e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:48.081433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6872c6-ac25-489e-94e0-ee85e650f5b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:48.082159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6872c6-ac25-489e-94e0-ee85e650f5b5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:48.082447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6872c6-ac25-489e-94e0-ee85e650f5b5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:48.082725 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6872c6-ac25-489e-94e0-ee85e650f5b5 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:48.089244 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6872c6-ac25-489e-94e0-ee85e650f5b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:48.090686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6872c6-ac25-489e-94e0-ee85e650f5b5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-6b6872c6-ac25-489e-94e0-ee85e650f5b5 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:48.104946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:48.106164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:09:48.107886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 569/1165] 10.222.0.64 () {56 vars in 1117 bytes} [Thu May 26 18:09:47 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:48.112719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e40ad0-5669-41fb-a656-fbcc6979de66 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:48.162994 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:48.211928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11e40ad0-5669-41fb-a656-fbcc6979de66 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:48.244876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0b278c1-e87b-4970-82a7-adfc28c3bd05 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:48.245560 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b278c1-e87b-4970-82a7-adfc28c3bd05 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:48.245846 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b278c1-e87b-4970-82a7-adfc28c3bd05 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:48.246124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0b278c1-e87b-4970-82a7-adfc28c3bd05 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:48.246832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b278c1-e87b-4970-82a7-adfc28c3bd05 None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:48.247168 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b278c1-e87b-4970-82a7-adfc28c3bd05 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:48.248525 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0b278c1-e87b-4970-82a7-adfc28c3bd05 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:48.255498 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 597/1166] 10.222.0.64 () {56 vars in 1115 bytes} [Thu May 26 18:09:48 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:50.419430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f9b9-a4ee-44cc-afff-8e8f8a76579b None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:50.419974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f9b9-a4ee-44cc-afff-8e8f8a76579b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:50.419974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-def5f9b9-a4ee-44cc-afff-8e8f8a76579b None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:50.421315 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 570/1167] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:50.426583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050898a0-dd0e-49ce-a92a-864281191663 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:50.427004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050898a0-dd0e-49ce-a92a-864281191663 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:50.427140 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050898a0-dd0e-49ce-a92a-864281191663 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:50.444190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-050898a0-dd0e-49ce-a92a-864281191663 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:50.445404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-050898a0-dd0e-49ce-a92a-864281191663 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:50.509733 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 598/1168] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:50 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:50.532052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f9b9-a4ee-44cc-afff-8e8f8a76579b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:50.555055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:50.634091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-def5f9b9-a4ee-44cc-afff-8e8f8a76579b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:50.666057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6758c82a-c7d5-4ef4-a797-a8fa3d0f88ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:50.666696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758c82a-c7d5-4ef4-a797-a8fa3d0f88ce None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:50.666979 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758c82a-c7d5-4ef4-a797-a8fa3d0f88ce None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:50.667254 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6758c82a-c7d5-4ef4-a797-a8fa3d0f88ce None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:50.667988 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758c82a-c7d5-4ef4-a797-a8fa3d0f88ce None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:50.669951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6758c82a-c7d5-4ef4-a797-a8fa3d0f88ce None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:50.684331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 571/1169] 10.222.0.64 () {60 vars in 1138 bytes} [Thu May 26 18:09:50 2022] POST /identity/v3/domains => generated 267 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:52.849245 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7bc93-8bae-493c-8ffb-9a98c92862c3 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:52.849799 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7bc93-8bae-493c-8ffb-9a98c92862c3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:52.849799 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdb7bc93-8bae-493c-8ffb-9a98c92862c3 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:52.851218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 599/1170] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:52.856279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6323-b231-496e-926c-496675845479 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:52.856729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6323-b231-496e-926c-496675845479 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:52.856828 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b6323-b231-496e-926c-496675845479 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:52.873356 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-768b6323-b231-496e-926c-496675845479 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:52.874515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-768b6323-b231-496e-926c-496675845479 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:52.937702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 572/1171] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:52 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:52.960940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7bc93-8bae-493c-8ffb-9a98c92862c3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:53.007719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:53.060814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdb7bc93-8bae-493c-8ffb-9a98c92862c3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:53.093478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8872aac5-e617-49b6-b49a-cbad074a77e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:53.094318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872aac5-e617-49b6-b49a-cbad074a77e6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:53.094597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872aac5-e617-49b6-b49a-cbad074a77e6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:53.094871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8872aac5-e617-49b6-b49a-cbad074a77e6 None admin] PATH_INFO: `/v3/domains/8c283287900d4425a18b31c2839b3d7b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:53.104914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872aac5-e617-49b6-b49a-cbad074a77e6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8c283287900d4425a18b31c2839b3d7b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:53.106420 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8872aac5-e617-49b6-b49a-cbad074a77e6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:53.108024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 600/1172] 10.222.0.64 () {56 vars in 1183 bytes} [Thu May 26 18:09:52 2022] GET /identity/v3/domains/8c283287900d4425a18b31c2839b3d7b => generated 267 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:53.113897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b6323-b231-496e-926c-496675845479 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:53.125575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:53.215770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b6323-b231-496e-926c-496675845479 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:53.248227 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89721bcc-9d63-42eb-b288-22d90eda8e8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:53.248873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89721bcc-9d63-42eb-b288-22d90eda8e8a None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:53.249179 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89721bcc-9d63-42eb-b288-22d90eda8e8a None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:53.249454 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89721bcc-9d63-42eb-b288-22d90eda8e8a None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:53.250155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89721bcc-9d63-42eb-b288-22d90eda8e8a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:53.251588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89721bcc-9d63-42eb-b288-22d90eda8e8a None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:53.275519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 573/1173] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 26 18:09:53 2022] POST /identity/v3/projects => generated 361 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:55.475912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442565b6-ca5e-4d77-824b-642a8f6ebd67 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:55.476507 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442565b6-ca5e-4d77-824b-642a8f6ebd67 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:55.476507 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-442565b6-ca5e-4d77-824b-642a8f6ebd67 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:55.477767 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 601/1174] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:55.483740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3ae30-79ad-4820-ad27-f98bf51ccdb5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:55.484135 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3ae30-79ad-4820-ad27-f98bf51ccdb5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:55.484299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ea3ae30-79ad-4820-ad27-f98bf51ccdb5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:55.500869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0ea3ae30-79ad-4820-ad27-f98bf51ccdb5 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:55.502079 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0ea3ae30-79ad-4820-ad27-f98bf51ccdb5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:55.556836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:55.567723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 574/1175] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:55 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:55.592887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442565b6-ca5e-4d77-824b-642a8f6ebd67 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:55.691593 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-442565b6-ca5e-4d77-824b-642a8f6ebd67 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:55.693812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:55.725190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1715e45c-099f-41da-b1d4-d1fcb8ebbce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:55.726084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715e45c-099f-41da-b1d4-d1fcb8ebbce8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:55.726321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715e45c-099f-41da-b1d4-d1fcb8ebbce8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:55.726596 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1715e45c-099f-41da-b1d4-d1fcb8ebbce8 None admin] PATH_INFO: `/v3/domains/8c283287900d4425a18b31c2839b3d7b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:55.727757 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715e45c-099f-41da-b1d4-d1fcb8ebbce8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=8c283287900d4425a18b31c2839b3d7b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:55.729207 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1715e45c-099f-41da-b1d4-d1fcb8ebbce8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:55.730814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 602/1176] 10.222.0.64 () {56 vars in 1183 bytes} [Thu May 26 18:09:55 2022] GET /identity/v3/domains/8c283287900d4425a18b31c2839b3d7b => generated 267 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:55.736826 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3ae30-79ad-4820-ad27-f98bf51ccdb5 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:55.830649 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ea3ae30-79ad-4820-ad27-f98bf51ccdb5 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:55.864077 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc629273-7f8d-4376-a14e-531f0c29543c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:55.864733 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc629273-7f8d-4376-a14e-531f0c29543c None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:55.865040 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc629273-7f8d-4376-a14e-531f0c29543c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:55.865318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc629273-7f8d-4376-a14e-531f0c29543c None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:55.866015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc629273-7f8d-4376-a14e-531f0c29543c None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:55.867441 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc629273-7f8d-4376-a14e-531f0c29543c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:55.886651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 575/1177] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:09:55 2022] POST /identity/v3/users => generated 311 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:09:58.158584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49928dba-02d4-4cc3-9302-dfcd19f18600 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.158992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49928dba-02d4-4cc3-9302-dfcd19f18600 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.159145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49928dba-02d4-4cc3-9302-dfcd19f18600 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.160570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 603/1178] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:09:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:09:58.165731 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b0ff5-959c-4eac-9e58-9bfda6f9fc05 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.166161 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b0ff5-959c-4eac-9e58-9bfda6f9fc05 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.166286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc9b0ff5-959c-4eac-9e58-9bfda6f9fc05 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.182624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-cc9b0ff5-959c-4eac-9e58-9bfda6f9fc05 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:09:58.183796 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cc9b0ff5-959c-4eac-9e58-9bfda6f9fc05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:09:58.226795 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:58.250121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 576/1179] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:09:58 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:09:58.273694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49928dba-02d4-4cc3-9302-dfcd19f18600 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:58.370872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49928dba-02d4-4cc3-9302-dfcd19f18600 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:58.404049 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf352b-68ee-4dcc-80f8-d9d498350d9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:58.404762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf352b-68ee-4dcc-80f8-d9d498350d9c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.405065 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf352b-68ee-4dcc-80f8-d9d498350d9c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.405338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bdf352b-68ee-4dcc-80f8-d9d498350d9c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.415115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bdf352b-68ee-4dcc-80f8-d9d498350d9c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-5bdf352b-68ee-4dcc-80f8-d9d498350d9c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:09:58.422747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:09:58.423943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:09:58.424830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:09:58.424830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:09:58.424830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:09:58.424830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:09:58.424830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:09:58.424830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:09:58.424830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:09:58.424830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:09:58.424830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:09:58.424830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:09:58.424830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:09:58.424830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:09:58.424830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 604/1180] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:09:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 151 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:09:58.429594 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b0ff5-959c-4eac-9e58-9bfda6f9fc05 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:58.524725 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc9b0ff5-959c-4eac-9e58-9bfda6f9fc05 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:58.557616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43757c30-99c0-4817-9cd2-a38611fe85f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:58.558264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43757c30-99c0-4817-9cd2-a38611fe85f4 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.558549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43757c30-99c0-4817-9cd2-a38611fe85f4 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.558827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43757c30-99c0-4817-9cd2-a38611fe85f4 None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.559590 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43757c30-99c0-4817-9cd2-a38611fe85f4 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:58.559899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43757c30-99c0-4817-9cd2-a38611fe85f4 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:58.561283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43757c30-99c0-4817-9cd2-a38611fe85f4 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:58.568977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 577/1181] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:09:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:58.574637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf352b-68ee-4dcc-80f8-d9d498350d9c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:58.605759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:58.672892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bdf352b-68ee-4dcc-80f8-d9d498350d9c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:58.706326 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016f8be-b3db-41df-b8fc-37c17fbbeb6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:58.707205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016f8be-b3db-41df-b8fc-37c17fbbeb6e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.707485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016f8be-b3db-41df-b8fc-37c17fbbeb6e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.707758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5016f8be-b3db-41df-b8fc-37c17fbbeb6e None admin] PATH_INFO: `/v3/users/a3c2508702f34ed3b3f39873515365b1` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.720925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016f8be-b3db-41df-b8fc-37c17fbbeb6e None admin] RBAC: Authorizing `identity:get_user(user_id=a3c2508702f34ed3b3f39873515365b1)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:58.722386 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5016f8be-b3db-41df-b8fc-37c17fbbeb6e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:58.723987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 605/1182] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:09:58 2022] GET /identity/v3/users/a3c2508702f34ed3b3f39873515365b1 => generated 311 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:58.729666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43757c30-99c0-4817-9cd2-a38611fe85f4 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:58.770453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:58.827742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43757c30-99c0-4817-9cd2-a38611fe85f4 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:58.860468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2a056-e7f6-4882-81f0-586280658bee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:58.861134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2a056-e7f6-4882-81f0-586280658bee None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:58.861417 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2a056-e7f6-4882-81f0-586280658bee None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:58.861694 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d2a056-e7f6-4882-81f0-586280658bee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:58.926017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2a056-e7f6-4882-81f0-586280658bee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:58.927404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8d2a056-e7f6-4882-81f0-586280658bee None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:58.965694 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:59.023378 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 578/1183] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:09:58 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 294 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:09:59.029820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016f8be-b3db-41df-b8fc-37c17fbbeb6e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:59.117637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:09:59.127146 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5016f8be-b3db-41df-b8fc-37c17fbbeb6e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:59.159941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c12eee87-92b5-40da-a7e4-b954839426a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:59.160787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eee87-92b5-40da-a7e4-b954839426a2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:59.161101 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eee87-92b5-40da-a7e4-b954839426a2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:59.161376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c12eee87-92b5-40da-a7e4-b954839426a2 None admin] PATH_INFO: `/v3/projects/764dfc08d16643dfbb1efba7eb306fe9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:59.162521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eee87-92b5-40da-a7e4-b954839426a2 None admin] RBAC: Authorizing `identity:get_project(project_id=764dfc08d16643dfbb1efba7eb306fe9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:59.163929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c12eee87-92b5-40da-a7e4-b954839426a2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:59.165631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 606/1184] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:09:59 2022] GET /identity/v3/projects/764dfc08d16643dfbb1efba7eb306fe9 => generated 361 bytes in 136 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:09:59.172193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2a056-e7f6-4882-81f0-586280658bee None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:09:59.267241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d2a056-e7f6-4882-81f0-586280658bee None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:09:59.307643 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-965128ce-8c80-476d-8e9a-d1ad1b03440f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:09:59.308595 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965128ce-8c80-476d-8e9a-d1ad1b03440f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:09:59.309120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965128ce-8c80-476d-8e9a-d1ad1b03440f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:09:59.309628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-965128ce-8c80-476d-8e9a-d1ad1b03440f None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:09:59.311093 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965128ce-8c80-476d-8e9a-d1ad1b03440f None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=764dfc08d16643dfbb1efba7eb306fe9, user.id=a3c2508702f34ed3b3f39873515365b1) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:09:59.311622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965128ce-8c80-476d-8e9a-d1ad1b03440f None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:09:59.314170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-965128ce-8c80-476d-8e9a-d1ad1b03440f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:09:59.320316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 579/1185] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:09:59 2022] GET /identity/v3/role_assignments?user.id=a3c2508702f34ed3b3f39873515365b1&scope.project.id=764dfc08d16643dfbb1efba7eb306fe9&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:01.490774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3c6a2-2ca4-49a8-8210-1d7a14a05368 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:01.491276 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3c6a2-2ca4-49a8-8210-1d7a14a05368 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:01.491276 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5c3c6a2-2ca4-49a8-8210-1d7a14a05368 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:01.492608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 607/1186] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:10:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:10:01.497949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00922f32-0a0c-4931-b996-745f560868dc None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:01.498317 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00922f32-0a0c-4931-b996-745f560868dc None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:01.498507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00922f32-0a0c-4931-b996-745f560868dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:01.504376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:01.515520 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-00922f32-0a0c-4931-b996-745f560868dc None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:01.516695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-00922f32-0a0c-4931-b996-745f560868dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:01.580533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 580/1187] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:10:01 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:10:01.603411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3c6a2-2ca4-49a8-8210-1d7a14a05368 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:01.702618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5c3c6a2-2ca4-49a8-8210-1d7a14a05368 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:01.735082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515aa8b-a39b-4338-8f4b-3c9ba094cf73 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:01.735853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515aa8b-a39b-4338-8f4b-3c9ba094cf73 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:01.736132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515aa8b-a39b-4338-8f4b-3c9ba094cf73 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:01.736401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4515aa8b-a39b-4338-8f4b-3c9ba094cf73 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:01.746076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4515aa8b-a39b-4338-8f4b-3c9ba094cf73 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4515aa8b-a39b-4338-8f4b-3c9ba094cf73 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:10:01.753513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:10:01.754603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:10:01.755816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:10:01.755816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:10:01.755816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:10:01.755816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:10:01.755816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:10:01.755816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:10:01.755816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:10:01.755816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:10:01.755816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:10:01.755816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:10:01.755816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:10:01.755816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:10:01.755816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 608/1188] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:10:01 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:10:01.760639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00922f32-0a0c-4931-b996-745f560868dc None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:01.855839 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00922f32-0a0c-4931-b996-745f560868dc None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:01.888506 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddc3e9-ef8c-4900-af84-b96da0ce1aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:01.889180 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddc3e9-ef8c-4900-af84-b96da0ce1aae None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:01.889465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddc3e9-ef8c-4900-af84-b96da0ce1aae None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:01.889737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cddc3e9-ef8c-4900-af84-b96da0ce1aae None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:01.890472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddc3e9-ef8c-4900-af84-b96da0ce1aae None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:10:01.890779 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddc3e9-ef8c-4900-af84-b96da0ce1aae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:01.892150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cddc3e9-ef8c-4900-af84-b96da0ce1aae None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:01.893502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:01.901003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 581/1189] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:10:01 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:01.907348 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515aa8b-a39b-4338-8f4b-3c9ba094cf73 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:01.926128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:02.004225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4515aa8b-a39b-4338-8f4b-3c9ba094cf73 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:02.035999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9bdf5-6745-449d-9478-84fb971037a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:02.036834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9bdf5-6745-449d-9478-84fb971037a6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:02.037142 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9bdf5-6745-449d-9478-84fb971037a6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:02.037415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5c9bdf5-6745-449d-9478-84fb971037a6 None admin] PATH_INFO: `/v3/users/a3c2508702f34ed3b3f39873515365b1` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:02.038555 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9bdf5-6745-449d-9478-84fb971037a6 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c2508702f34ed3b3f39873515365b1)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:02.039964 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5c9bdf5-6745-449d-9478-84fb971037a6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:02.041573 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 609/1190] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:10:01 2022] GET /identity/v3/users/a3c2508702f34ed3b3f39873515365b1 => generated 311 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:02.047079 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddc3e9-ef8c-4900-af84-b96da0ce1aae None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:02.147083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cddc3e9-ef8c-4900-af84-b96da0ce1aae None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:02.179479 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-698c1ec3-6308-4485-8449-4c5243488956 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:02.180336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c1ec3-6308-4485-8449-4c5243488956 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:02.180618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c1ec3-6308-4485-8449-4c5243488956 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:02.180890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-698c1ec3-6308-4485-8449-4c5243488956 None admin] PATH_INFO: `/v3/projects/764dfc08d16643dfbb1efba7eb306fe9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:02.182085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c1ec3-6308-4485-8449-4c5243488956 None admin] RBAC: Authorizing `identity:get_project(project_id=764dfc08d16643dfbb1efba7eb306fe9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:02.183505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-698c1ec3-6308-4485-8449-4c5243488956 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:02.185692 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 582/1191] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:10:02 2022] GET /identity/v3/projects/764dfc08d16643dfbb1efba7eb306fe9 => generated 361 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:02.191444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9bdf5-6745-449d-9478-84fb971037a6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:02.274037 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:02.288525 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5c9bdf5-6745-449d-9478-84fb971037a6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:02.332279 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfdb6d76-4ed8-4f80-9fcf-f3959068edd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:02.333196 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6d76-4ed8-4f80-9fcf-f3959068edd5 None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:02.333483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6d76-4ed8-4f80-9fcf-f3959068edd5 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:02.333910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfdb6d76-4ed8-4f80-9fcf-f3959068edd5 None admin] PATH_INFO: `/v3/projects/764dfc08d16643dfbb1efba7eb306fe9/users/a3c2508702f34ed3b3f39873515365b1/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:02.336697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb6d76-4ed8-4f80-9fcf-f3959068edd5 None admin] RBAC: Authorizing `identity:create_grant(project_id=764dfc08d16643dfbb1efba7eb306fe9, user_id=a3c2508702f34ed3b3f39873515365b1, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:02.338952 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfdb6d76-4ed8-4f80-9fcf-f3959068edd5 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:02.353690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 610/1192] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:10:02 2022] PUT /identity/v3/projects/764dfc08d16643dfbb1efba7eb306fe9/users/a3c2508702f34ed3b3f39873515365b1/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:10:04.587047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce4991-ef01-4d26-ad5d-70853c21f05b None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:04.587560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce4991-ef01-4d26-ad5d-70853c21f05b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:04.587560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3ce4991-ef01-4d26-ad5d-70853c21f05b None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:04.588877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 583/1193] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:10:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:10:04.594511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391e34a-b301-4a39-84ff-301d66953248 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:04.594902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391e34a-b301-4a39-84ff-301d66953248 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:04.595078 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7391e34a-b301-4a39-84ff-301d66953248 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:04.612600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7391e34a-b301-4a39-84ff-301d66953248 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:10:04.613816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7391e34a-b301-4a39-84ff-301d66953248 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:10:04.677672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 611/1194] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:10:04 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:10:04.700836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce4991-ef01-4d26-ad5d-70853c21f05b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:04.761537 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:04.799978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3ce4991-ef01-4d26-ad5d-70853c21f05b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:04.832037 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000313d6-bea2-42e5-8964-a96ff9a018de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:04.832805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000313d6-bea2-42e5-8964-a96ff9a018de None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:04.833111 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000313d6-bea2-42e5-8964-a96ff9a018de None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:04.833385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-000313d6-bea2-42e5-8964-a96ff9a018de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:04.843069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-000313d6-bea2-42e5-8964-a96ff9a018de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-000313d6-bea2-42e5-8964-a96ff9a018de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:10:04.850533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:10:04.851518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:10:04.852626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:10:04.852626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:10:04.852626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:10:04.852626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:10:04.852626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:10:04.852626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:10:04.852626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:10:04.852626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:10:04.852626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:10:04.852626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:10:04.852626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:10:04.852626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:10:04.852626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 584/1195] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:10:04 2022] GET /identity/v3/roles/admin => generated 83 bytes in 152 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:10:04.858119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391e34a-b301-4a39-84ff-301d66953248 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:04.931844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:04.955550 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7391e34a-b301-4a39-84ff-301d66953248 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:04.988373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1b6de-1314-4250-bdc4-0264b90c99b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:04.989060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1b6de-1314-4250-bdc4-0264b90c99b9 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:04.989347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1b6de-1314-4250-bdc4-0264b90c99b9 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:04.989622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c1b6de-1314-4250-bdc4-0264b90c99b9 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:04.990356 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1b6de-1314-4250-bdc4-0264b90c99b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:10:04.990662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1b6de-1314-4250-bdc4-0264b90c99b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:04.992018 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c1b6de-1314-4250-bdc4-0264b90c99b9 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:05.000253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 612/1196] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:10:04 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:05.005885 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000313d6-bea2-42e5-8964-a96ff9a018de None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:05.102540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-000313d6-bea2-42e5-8964-a96ff9a018de None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:05.125220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:05.136015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd259c-4b43-4d86-858a-2b251abf0c76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:05.136874 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd259c-4b43-4d86-858a-2b251abf0c76 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:05.137184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd259c-4b43-4d86-858a-2b251abf0c76 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:05.137506 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5fd259c-4b43-4d86-858a-2b251abf0c76 None admin] PATH_INFO: `/v3/users/a3c2508702f34ed3b3f39873515365b1` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:05.139162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd259c-4b43-4d86-858a-2b251abf0c76 None admin] RBAC: Authorizing `identity:get_user(user_id=a3c2508702f34ed3b3f39873515365b1)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:05.140578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5fd259c-4b43-4d86-858a-2b251abf0c76 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:05.142361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 585/1197] 10.222.0.64 () {56 vars in 1177 bytes} [Thu May 26 18:10:05 2022] GET /identity/v3/users/a3c2508702f34ed3b3f39873515365b1 => generated 311 bytes in 137 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:05.147948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1b6de-1314-4250-bdc4-0264b90c99b9 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:05.243637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c1b6de-1314-4250-bdc4-0264b90c99b9 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:05.276473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c18e35-fcbd-445f-a3b5-b9739a97c4fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:05.277137 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c18e35-fcbd-445f-a3b5-b9739a97c4fb None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:05.277418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c18e35-fcbd-445f-a3b5-b9739a97c4fb None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:05.277689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2c18e35-fcbd-445f-a3b5-b9739a97c4fb None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:05.286353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:05.342989 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c18e35-fcbd-445f-a3b5-b9739a97c4fb None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:05.344408 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2c18e35-fcbd-445f-a3b5-b9739a97c4fb None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:05.437475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 613/1198] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:10:05 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 290 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:10:05.443360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd259c-4b43-4d86-858a-2b251abf0c76 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:05.539850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5fd259c-4b43-4d86-858a-2b251abf0c76 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:05.571621 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06963584-d644-4ee2-bf9a-7ecdc9cb7160 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:05.572456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06963584-d644-4ee2-bf9a-7ecdc9cb7160 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:05.572742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06963584-d644-4ee2-bf9a-7ecdc9cb7160 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:05.573041 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06963584-d644-4ee2-bf9a-7ecdc9cb7160 None admin] PATH_INFO: `/v3/projects/764dfc08d16643dfbb1efba7eb306fe9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:05.574202 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06963584-d644-4ee2-bf9a-7ecdc9cb7160 None admin] RBAC: Authorizing `identity:get_project(project_id=764dfc08d16643dfbb1efba7eb306fe9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:05.576111 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06963584-d644-4ee2-bf9a-7ecdc9cb7160 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:05.577794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 586/1199] 10.222.0.64 () {56 vars in 1186 bytes} [Thu May 26 18:10:05 2022] GET /identity/v3/projects/764dfc08d16643dfbb1efba7eb306fe9 => generated 361 bytes in 135 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:05.583559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c18e35-fcbd-445f-a3b5-b9739a97c4fb None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:10:05.621597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:05.679756 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2c18e35-fcbd-445f-a3b5-b9739a97c4fb None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:10:05.712055 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282ede8-a959-4542-aef4-2bf761428f4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:10:05.712639 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282ede8-a959-4542-aef4-2bf761428f4d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:10:05.712917 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282ede8-a959-4542-aef4-2bf761428f4d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:10:05.713217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282ede8-a959-4542-aef4-2bf761428f4d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:10:05.714031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282ede8-a959-4542-aef4-2bf761428f4d None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=764dfc08d16643dfbb1efba7eb306fe9, user.id=a3c2508702f34ed3b3f39873515365b1) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:10:05.714353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282ede8-a959-4542-aef4-2bf761428f4d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:10:05.716333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282ede8-a959-4542-aef4-2bf761428f4d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:10:05.721953 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 614/1200] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:10:05 2022] GET /identity/v3/role_assignments?user.id=a3c2508702f34ed3b3f39873515365b1&scope.project.id=764dfc08d16643dfbb1efba7eb306fe9&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 608 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:10:15.567684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=70 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:10:15.719800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=49 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:05.594869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60ee46-ec8e-43a4-9bbe-935ff6e1ff19 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:05.595474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60ee46-ec8e-43a4-9bbe-935ff6e1ff19 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:05.595474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb60ee46-ec8e-43a4-9bbe-935ff6e1ff19 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:05.596742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 587/1201] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:11:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:11:05.602399 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d92b6-34dd-4a33-89d9-0a9eb79ee1dc None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:05.602894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d92b6-34dd-4a33-89d9-0a9eb79ee1dc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:05.602993 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a36d92b6-34dd-4a33-89d9-0a9eb79ee1dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:05.620895 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a36d92b6-34dd-4a33-89d9-0a9eb79ee1dc None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:11:05.622736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a36d92b6-34dd-4a33-89d9-0a9eb79ee1dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:05.707054 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 615/1202] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:11:05 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:11:05.735025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60ee46-ec8e-43a4-9bbe-935ff6e1ff19 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:05.903993 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb60ee46-ec8e-43a4-9bbe-935ff6e1ff19 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:05.945365 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16d0c4-6d0d-4ec0-84df-58cc58a6832b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:05.946235 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16d0c4-6d0d-4ec0-84df-58cc58a6832b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:05.946670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16d0c4-6d0d-4ec0-84df-58cc58a6832b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:05.946889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de16d0c4-6d0d-4ec0-84df-58cc58a6832b None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:05.963362 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16d0c4-6d0d-4ec0-84df-58cc58a6832b None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:05.964960 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de16d0c4-6d0d-4ec0-84df-58cc58a6832b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-de16d0c4-6d0d-4ec0-84df-58cc58a6832b None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:11:05.986129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:05.987271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:05.988250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:11:05.988250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:11:05.988250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:05.988250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:05.993734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d92b6-34dd-4a33-89d9-0a9eb79ee1dc None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:05.997355 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 588/1203] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:05 2022] GET /identity/v3/domains/Default => generated 87 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:06.140411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a36d92b6-34dd-4a33-89d9-0a9eb79ee1dc None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:06.180783 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:06.189008 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8409c09d-ac96-43b6-8e9a-d6d33c726f24 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:06.189906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409c09d-ac96-43b6-8e9a-d6d33c726f24 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:06.190261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409c09d-ac96-43b6-8e9a-d6d33c726f24 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:06.190607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8409c09d-ac96-43b6-8e9a-d6d33c726f24 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:06.191471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409c09d-ac96-43b6-8e9a-d6d33c726f24 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:06.191869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409c09d-ac96-43b6-8e9a-d6d33c726f24 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:06.193425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8409c09d-ac96-43b6-8e9a-d6d33c726f24 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:06.207468 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 616/1204] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:11:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:11:06.213707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16d0c4-6d0d-4ec0-84df-58cc58a6832b None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:06.278449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:06.341943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de16d0c4-6d0d-4ec0-84df-58cc58a6832b None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:06.379278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23c08140-b82a-4b5d-b4d4-034edebba479 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:06.379948 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c08140-b82a-4b5d-b4d4-034edebba479 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:06.380231 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c08140-b82a-4b5d-b4d4-034edebba479 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:06.380511 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23c08140-b82a-4b5d-b4d4-034edebba479 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:06.381343 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c08140-b82a-4b5d-b4d4-034edebba479 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:06.382674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23c08140-b82a-4b5d-b4d4-034edebba479 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:06.403747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 589/1205] 10.222.0.64 () {60 vars in 1132 bytes} [Thu May 26 18:11:06 2022] POST /identity/v3/users => generated 251 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:11:08.930754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db2874-c213-4aca-9dc3-dd78ac9ce321 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:08.931318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db2874-c213-4aca-9dc3-dd78ac9ce321 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:08.931318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23db2874-c213-4aca-9dc3-dd78ac9ce321 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:08.932816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 617/1206] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:11:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:11:08.939111 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc27e5-3176-4a08-8513-0e4b17b4dcb3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:08.939536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc27e5-3176-4a08-8513-0e4b17b4dcb3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:08.939679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fc27e5-3176-4a08-8513-0e4b17b4dcb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:08.958784 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c8fc27e5-3176-4a08-8513-0e4b17b4dcb3 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:11:08.960311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c8fc27e5-3176-4a08-8513-0e4b17b4dcb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:09.047391 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 590/1207] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:11:08 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:11:09.073633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db2874-c213-4aca-9dc3-dd78ac9ce321 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:09.191896 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23db2874-c213-4aca-9dc3-dd78ac9ce321 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:09.238454 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af53df-4d30-4835-a7b9-41e8dd02a66e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:09.239255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af53df-4d30-4835-a7b9-41e8dd02a66e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:09.239544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af53df-4d30-4835-a7b9-41e8dd02a66e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:09.239814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5af53df-4d30-4835-a7b9-41e8dd02a66e None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:09.254057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5af53df-4d30-4835-a7b9-41e8dd02a66e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e5af53df-4d30-4835-a7b9-41e8dd02a66e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:11:09.262675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:09.263708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:09.264549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:09.264549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:09.264549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:09.264549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:09.264549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:11:09.264549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:11:09.264549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:11:09.264549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:11:09.264549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:11:09.264549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:11:09.264549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:11:09.264549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:09.264549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 618/1208] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:11:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:09.272069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc27e5-3176-4a08-8513-0e4b17b4dcb3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:09.325045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:09.407077 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fc27e5-3176-4a08-8513-0e4b17b4dcb3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:09.456225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26107e-c7ef-4fa4-9af1-1a92aae5e2aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:09.457203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26107e-c7ef-4fa4-9af1-1a92aae5e2aa None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:09.457670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26107e-c7ef-4fa4-9af1-1a92aae5e2aa None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:09.458143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d26107e-c7ef-4fa4-9af1-1a92aae5e2aa None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:09.459090 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26107e-c7ef-4fa4-9af1-1a92aae5e2aa None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:09.459470 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26107e-c7ef-4fa4-9af1-1a92aae5e2aa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:09.460909 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d26107e-c7ef-4fa4-9af1-1a92aae5e2aa None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:09.476073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 591/1209] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:11:09 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:09.478216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af53df-4d30-4835-a7b9-41e8dd02a66e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:09.552804 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:09.617814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5af53df-4d30-4835-a7b9-41e8dd02a66e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:09.657649 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7950709-ddb1-4bd2-abba-c6b1e6e5b554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:09.658450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7950709-ddb1-4bd2-abba-c6b1e6e5b554 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:09.658730 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7950709-ddb1-4bd2-abba-c6b1e6e5b554 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:09.659007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7950709-ddb1-4bd2-abba-c6b1e6e5b554 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:09.673606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7950709-ddb1-4bd2-abba-c6b1e6e5b554 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:09.675592 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7950709-ddb1-4bd2-abba-c6b1e6e5b554 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e7950709-ddb1-4bd2-abba-c6b1e6e5b554 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:11:09.696253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:09.697436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:09.698412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:11:09.698412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:11:09.698412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:09.698412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:09.698412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 619/1210] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 221 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:09.705435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26107e-c7ef-4fa4-9af1-1a92aae5e2aa None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:09.832084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:09.837714 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d26107e-c7ef-4fa4-9af1-1a92aae5e2aa None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:09.889759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d1cf5-66ca-4c9d-ab06-93b170610a1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:09.890745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d1cf5-66ca-4c9d-ab06-93b170610a1f None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:09.891162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d1cf5-66ca-4c9d-ab06-93b170610a1f None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:09.891597 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8d1cf5-66ca-4c9d-ab06-93b170610a1f None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:09.892618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d1cf5-66ca-4c9d-ab06-93b170610a1f None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:09.893035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d1cf5-66ca-4c9d-ab06-93b170610a1f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:09.895058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8d1cf5-66ca-4c9d-ab06-93b170610a1f None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:09.913288 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 592/1211] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:11:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 208 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:09.919134 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7950709-ddb1-4bd2-abba-c6b1e6e5b554 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:10.036769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7950709-ddb1-4bd2-abba-c6b1e6e5b554 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:10.038508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:10.080522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771122f-efd9-453c-9a3d-ce1641ba65d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:10.081486 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771122f-efd9-453c-9a3d-ce1641ba65d6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:10.081842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771122f-efd9-453c-9a3d-ce1641ba65d6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:10.082296 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d771122f-efd9-453c-9a3d-ce1641ba65d6 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:10.091295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771122f-efd9-453c-9a3d-ce1641ba65d6 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:10.092743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d771122f-efd9-453c-9a3d-ce1641ba65d6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-d771122f-efd9-453c-9a3d-ce1641ba65d6 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:11:10.111423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:10.112476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:10.113502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:10.113502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:10.113502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:11:10.113502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:11:10.113502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:11:10.113502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:11:10.113502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:11:10.113502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:11:10.113502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 18:11:10.113502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:10.113502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 620/1212] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:09 2022] GET /identity/v3/users/placement => generated 87 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:10.118804 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d1cf5-66ca-4c9d-ab06-93b170610a1f None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:10.241523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8d1cf5-66ca-4c9d-ab06-93b170610a1f None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:10.286820 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c71fcc-226e-427a-8171-5631d098ac71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:10.287794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71fcc-226e-427a-8171-5631d098ac71 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:10.288083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71fcc-226e-427a-8171-5631d098ac71 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:10.288623 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c71fcc-226e-427a-8171-5631d098ac71 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:10.289825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c71fcc-226e-427a-8171-5631d098ac71 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:10.290311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c71fcc-226e-427a-8171-5631d098ac71 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:10.292370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c71fcc-226e-427a-8171-5631d098ac71 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:10.321422 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 593/1213] 10.222.0.64 () {56 vars in 1143 bytes} [Thu May 26 18:11:10 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:10.323274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771122f-efd9-453c-9a3d-ce1641ba65d6 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:10.449101 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d771122f-efd9-453c-9a3d-ce1641ba65d6 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:10.485829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75c20c-edc8-4b5b-900c-91529a81aa79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:10.486517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75c20c-edc8-4b5b-900c-91529a81aa79 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:10.486770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75c20c-edc8-4b5b-900c-91529a81aa79 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:10.487064 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e75c20c-edc8-4b5b-900c-91529a81aa79 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:10.521737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:10.563979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75c20c-edc8-4b5b-900c-91529a81aa79 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:10.565487 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e75c20c-edc8-4b5b-900c-91529a81aa79 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:10.685326 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 621/1214] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:11:10 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:11:10.691331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c71fcc-226e-427a-8171-5631d098ac71 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:10.716698 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:10.817389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c71fcc-226e-427a-8171-5631d098ac71 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:10.856926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad999649-95f5-4ee6-8b8e-f2678310ad9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:10.857808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad999649-95f5-4ee6-8b8e-f2678310ad9c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:10.858168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad999649-95f5-4ee6-8b8e-f2678310ad9c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:10.858850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad999649-95f5-4ee6-8b8e-f2678310ad9c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:10.870853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad999649-95f5-4ee6-8b8e-f2678310ad9c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:10.872513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad999649-95f5-4ee6-8b8e-f2678310ad9c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-ad999649-95f5-4ee6-8b8e-f2678310ad9c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:11:10.889928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:10.890846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:10.896908 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:11:10.896908 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:11:10.896908 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:10.896908 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:10.896908 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 594/1215] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 200 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:10.898647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75c20c-edc8-4b5b-900c-91529a81aa79 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:10.967748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:11.012355 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e75c20c-edc8-4b5b-900c-91529a81aa79 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:11.051965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d803078-fb14-43a9-8103-01324e06df20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:11.052715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d803078-fb14-43a9-8103-01324e06df20 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:11.053022 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d803078-fb14-43a9-8103-01324e06df20 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:11.053301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d803078-fb14-43a9-8103-01324e06df20 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:11.054099 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d803078-fb14-43a9-8103-01324e06df20 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:11.054392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d803078-fb14-43a9-8103-01324e06df20 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:11.055883 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d803078-fb14-43a9-8103-01324e06df20 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:11.069787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 622/1216] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:11:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 172 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:11.076548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad999649-95f5-4ee6-8b8e-f2678310ad9c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:11.156453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:11.204055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad999649-95f5-4ee6-8b8e-f2678310ad9c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:11.242082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6951b-e825-4381-9649-5fbf656a30df None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:11.242762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6951b-e825-4381-9649-5fbf656a30df None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:11.243043 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6951b-e825-4381-9649-5fbf656a30df None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:11.243391 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ac6951b-e825-4381-9649-5fbf656a30df None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:11.251397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6951b-e825-4381-9649-5fbf656a30df None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:11.252945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ac6951b-e825-4381-9649-5fbf656a30df None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-9ac6951b-e825-4381-9649-5fbf656a30df None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:11:11.267799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:11.268759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:11.270022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:11:11.270022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:11:11.270022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:11:11.270022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:11:11.270022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:11:11.270022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:11:11.270022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:11:11.270022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:11.270022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 595/1217] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:11:11 2022] GET /identity/v3/projects/service => generated 88 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:11.274964 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d803078-fb14-43a9-8103-01324e06df20 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:11.388686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d803078-fb14-43a9-8103-01324e06df20 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:11.412838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:11.425672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24b0a123-cc1f-4f10-b1bf-27f5ac4b2f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:11.426362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0a123-cc1f-4f10-b1bf-27f5ac4b2f87 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:11.426645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0a123-cc1f-4f10-b1bf-27f5ac4b2f87 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:11.426918 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24b0a123-cc1f-4f10-b1bf-27f5ac4b2f87 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:11.427698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0a123-cc1f-4f10-b1bf-27f5ac4b2f87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:11.428007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0a123-cc1f-4f10-b1bf-27f5ac4b2f87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:11.429464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24b0a123-cc1f-4f10-b1bf-27f5ac4b2f87 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:11.449422 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 623/1218] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:11:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:11.452535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6951b-e825-4381-9649-5fbf656a30df None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:11.570091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ac6951b-e825-4381-9649-5fbf656a30df None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:11.603031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:11.611468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a4cee-ed13-495b-9505-5ac2ba156c0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:11.612117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a4cee-ed13-495b-9505-5ac2ba156c0b None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:11.612397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a4cee-ed13-495b-9505-5ac2ba156c0b None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:11.612669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a4cee-ed13-495b-9505-5ac2ba156c0b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:11.613568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a4cee-ed13-495b-9505-5ac2ba156c0b None admin] RBAC: Adding query filter params (role.id=ec1445be03c942a98070dd9213fd0705, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=1ab4efe6f79d4b3ca5618c089c5f3d24) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:11.613829 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a4cee-ed13-495b-9505-5ac2ba156c0b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:11.615253 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a4cee-ed13-495b-9505-5ac2ba156c0b None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:11.621372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 596/1219] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:11:11 2022] GET /identity/v3/role_assignments?user.id=1ab4efe6f79d4b3ca5618c089c5f3d24&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=ec1445be03c942a98070dd9213fd0705 => generated 259 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:14.031271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae9c95-f321-4ea5-8c27-8160bf982116 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:14.031850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae9c95-f321-4ea5-8c27-8160bf982116 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:14.031850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaae9c95-f321-4ea5-8c27-8160bf982116 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:14.033252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 624/1220] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:11:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:11:14.039030 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48cedf-eb99-40ff-8407-b23bc6e4d7e7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:14.039488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48cedf-eb99-40ff-8407-b23bc6e4d7e7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:14.039631 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a48cedf-eb99-40ff-8407-b23bc6e4d7e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:14.057921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4a48cedf-eb99-40ff-8407-b23bc6e4d7e7 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:11:14.059722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4a48cedf-eb99-40ff-8407-b23bc6e4d7e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:14.130748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 597/1221] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:11:14 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:11:14.155976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae9c95-f321-4ea5-8c27-8160bf982116 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:14.262973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaae9c95-f321-4ea5-8c27-8160bf982116 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:14.297541 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da3b7f-340b-4a2d-a38f-76a97d9f9385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:14.298405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da3b7f-340b-4a2d-a38f-76a97d9f9385 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:14.298698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da3b7f-340b-4a2d-a38f-76a97d9f9385 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:14.298984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17da3b7f-340b-4a2d-a38f-76a97d9f9385 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:14.310513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17da3b7f-340b-4a2d-a38f-76a97d9f9385 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-17da3b7f-340b-4a2d-a38f-76a97d9f9385 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:11:14.318244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:14.319336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:14.320271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:14.320271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:14.320271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:14.320271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:14.320271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:11:14.320271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:11:14.320271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:11:14.320271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:11:14.320271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:11:14.320271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:11:14.320271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:11:14.320271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:14.320271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 625/1222] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:11:14 2022] GET /identity/v3/roles/service => generated 85 bytes in 165 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:14.325823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48cedf-eb99-40ff-8407-b23bc6e4d7e7 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:14.432527 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a48cedf-eb99-40ff-8407-b23bc6e4d7e7 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:14.458681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:14.471742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be9b52-2e5e-46fb-93bb-909a90b2368d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:14.472414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be9b52-2e5e-46fb-93bb-909a90b2368d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:14.472696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be9b52-2e5e-46fb-93bb-909a90b2368d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:14.473018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48be9b52-2e5e-46fb-93bb-909a90b2368d None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:14.473787 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be9b52-2e5e-46fb-93bb-909a90b2368d None admin] RBAC: Adding query filter params (name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:14.474062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be9b52-2e5e-46fb-93bb-909a90b2368d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:14.475496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48be9b52-2e5e-46fb-93bb-909a90b2368d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:14.485897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 598/1223] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:11:14 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:14.491986 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da3b7f-340b-4a2d-a38f-76a97d9f9385 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:14.535315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:14.591846 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17da3b7f-340b-4a2d-a38f-76a97d9f9385 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:14.629893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346eb1fb-9b58-4724-9af5-d9690987a340 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:14.630766 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eb1fb-9b58-4724-9af5-d9690987a340 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:14.631078 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eb1fb-9b58-4724-9af5-d9690987a340 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:14.631419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346eb1fb-9b58-4724-9af5-d9690987a340 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:14.642582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346eb1fb-9b58-4724-9af5-d9690987a340 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:14.644014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-346eb1fb-9b58-4724-9af5-d9690987a340 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-346eb1fb-9b58-4724-9af5-d9690987a340 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:11:14.663832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:14.664925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:14.666316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:11:14.666316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:11:14.666316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:14.666316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:14.666316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 626/1224] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:11:14.672114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be9b52-2e5e-46fb-93bb-909a90b2368d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:14.775951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48be9b52-2e5e-46fb-93bb-909a90b2368d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:14.812495 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ef036-c7d1-4555-87c5-80b839193b92 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:14.813447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ef036-c7d1-4555-87c5-80b839193b92 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:14.813742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ef036-c7d1-4555-87c5-80b839193b92 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:14.814088 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b2ef036-c7d1-4555-87c5-80b839193b92 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:14.814950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ef036-c7d1-4555-87c5-80b839193b92 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:14.815376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ef036-c7d1-4555-87c5-80b839193b92 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:14.817159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b2ef036-c7d1-4555-87c5-80b839193b92 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:14.834492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 599/1225] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:11:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:14.840324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346eb1fb-9b58-4724-9af5-d9690987a340 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:14.947873 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:14.956031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-346eb1fb-9b58-4724-9af5-d9690987a340 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:14.991855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1048d-adf3-49b9-a6db-b1346c9f5b51 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:14.992653 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1048d-adf3-49b9-a6db-b1346c9f5b51 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:14.992933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1048d-adf3-49b9-a6db-b1346c9f5b51 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:14.993243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ce1048d-adf3-49b9-a6db-b1346c9f5b51 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:15.002180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1048d-adf3-49b9-a6db-b1346c9f5b51 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:15.003612 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ce1048d-adf3-49b9-a6db-b1346c9f5b51 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-3ce1048d-adf3-49b9-a6db-b1346c9f5b51 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:11:15.018110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:15.019334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:15.020309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:15.020309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:15.020309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:11:15.020309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:11:15.020309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:11:15.020309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:11:15.020309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:11:15.020309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:11:15.020309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 18:11:15.020309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:15.020309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 627/1226] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:14 2022] GET /identity/v3/users/placement => generated 87 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:15.025181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ef036-c7d1-4555-87c5-80b839193b92 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:15.074329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:15.137342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b2ef036-c7d1-4555-87c5-80b839193b92 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:15.178438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61725101-2261-4eeb-91d8-75c5fad683fd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:15.178438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725101-2261-4eeb-91d8-75c5fad683fd None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:15.178438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725101-2261-4eeb-91d8-75c5fad683fd None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:15.178825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61725101-2261-4eeb-91d8-75c5fad683fd None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:15.179537 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61725101-2261-4eeb-91d8-75c5fad683fd None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:15.179849 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61725101-2261-4eeb-91d8-75c5fad683fd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:15.181312 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61725101-2261-4eeb-91d8-75c5fad683fd None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:15.202589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 600/1227] 10.222.0.64 () {56 vars in 1143 bytes} [Thu May 26 18:11:15 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:15.208151 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1048d-adf3-49b9-a6db-b1346c9f5b51 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:15.332338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ce1048d-adf3-49b9-a6db-b1346c9f5b51 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:15.369512 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189ebca-4d7b-4d05-87c8-896fb8e6946f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:15.370891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189ebca-4d7b-4d05-87c8-896fb8e6946f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:15.371183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189ebca-4d7b-4d05-87c8-896fb8e6946f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:15.371501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e189ebca-4d7b-4d05-87c8-896fb8e6946f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:15.382617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189ebca-4d7b-4d05-87c8-896fb8e6946f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:15.384394 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e189ebca-4d7b-4d05-87c8-896fb8e6946f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-e189ebca-4d7b-4d05-87c8-896fb8e6946f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:11:15.407499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:15.408491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:15.409406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:11:15.409406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:11:15.409406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:15.409406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:15.409406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 628/1228] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:15 2022] GET /identity/v3/domains/Default => generated 87 bytes in 201 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:15.415806 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61725101-2261-4eeb-91d8-75c5fad683fd None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:15.545899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61725101-2261-4eeb-91d8-75c5fad683fd None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:15.548631 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:15.587412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb11ee-513e-4343-858b-782556301d40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:15.588213 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb11ee-513e-4343-858b-782556301d40 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:15.588521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb11ee-513e-4343-858b-782556301d40 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:15.588963 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8deb11ee-513e-4343-858b-782556301d40 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:15.590378 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb11ee-513e-4343-858b-782556301d40 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:15.591070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb11ee-513e-4343-858b-782556301d40 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:15.592840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8deb11ee-513e-4343-858b-782556301d40 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:15.610194 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 601/1229] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:11:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:15.615905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189ebca-4d7b-4d05-87c8-896fb8e6946f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:15.626133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:15.730954 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e189ebca-4d7b-4d05-87c8-896fb8e6946f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:15.765434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1ad63-2689-41e7-b4bb-430298f5a62c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:15.766313 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1ad63-2689-41e7-b4bb-430298f5a62c None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:15.766674 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1ad63-2689-41e7-b4bb-430298f5a62c None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:15.767019 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce1ad63-2689-41e7-b4bb-430298f5a62c None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:15.773761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1ad63-2689-41e7-b4bb-430298f5a62c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:15.775193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce1ad63-2689-41e7-b4bb-430298f5a62c None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-dce1ad63-2689-41e7-b4bb-430298f5a62c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:11:15.789749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:15.790843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:15.792039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:11:15.792039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:11:15.792039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:11:15.792039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:11:15.792039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:11:15.792039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:11:15.792039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:11:15.792039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:15.796338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 629/1230] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:11:15 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:15.797282 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb11ee-513e-4343-858b-782556301d40 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:15.918131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8deb11ee-513e-4343-858b-782556301d40 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:15.956610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0e69a0-3a50-4e8b-8ac0-e65a91005d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:15.957551 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e69a0-3a50-4e8b-8ac0-e65a91005d10 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:15.957950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e69a0-3a50-4e8b-8ac0-e65a91005d10 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:15.958277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0e69a0-3a50-4e8b-8ac0-e65a91005d10 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:15.959274 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e69a0-3a50-4e8b-8ac0-e65a91005d10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:15.959722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e69a0-3a50-4e8b-8ac0-e65a91005d10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:15.961745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0e69a0-3a50-4e8b-8ac0-e65a91005d10 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:15.977395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 602/1231] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:11:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:15.983973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1ad63-2689-41e7-b4bb-430298f5a62c None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:16.053832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:16.089614 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce1ad63-2689-41e7-b4bb-430298f5a62c None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:16.126457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f8f0ea0-ec66-411a-a5b1-f18947deb89d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:16.127420 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f0ea0-ec66-411a-a5b1-f18947deb89d None admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:16.127775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f0ea0-ec66-411a-a5b1-f18947deb89d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:16.128082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f8f0ea0-ec66-411a-a5b1-f18947deb89d None admin] PATH_INFO: `/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/1ab4efe6f79d4b3ca5618c089c5f3d24/roles/ec1445be03c942a98070dd9213fd0705` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:16.144070 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f0ea0-ec66-411a-a5b1-f18947deb89d None admin] RBAC: Authorizing `identity:create_grant(project_id=ab7fe8d932964e7ab1f442f26ef0735b, user_id=1ab4efe6f79d4b3ca5618c089c5f3d24, role_id=ec1445be03c942a98070dd9213fd0705)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:16.145557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f8f0ea0-ec66-411a-a5b1-f18947deb89d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:16.157704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 630/1232] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:11:15 2022] PUT /identity/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/1ab4efe6f79d4b3ca5618c089c5f3d24/roles/ec1445be03c942a98070dd9213fd0705 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:11:18.655496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a506776-e849-44c4-be25-68c89b452985 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:18.656076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a506776-e849-44c4-be25-68c89b452985 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:18.656076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a506776-e849-44c4-be25-68c89b452985 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:18.657468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 603/1233] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:11:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:11:18.662884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1b44b-eca9-4f90-b19f-f47e1ed330d9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:18.663331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1b44b-eca9-4f90-b19f-f47e1ed330d9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:18.663422 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba1b44b-eca9-4f90-b19f-f47e1ed330d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:18.680254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1ba1b44b-eca9-4f90-b19f-f47e1ed330d9 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:11:18.681466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1ba1b44b-eca9-4f90-b19f-f47e1ed330d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:18.752417 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 631/1234] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:11:18 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:11:18.777330 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a506776-e849-44c4-be25-68c89b452985 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:18.805780 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:18.903071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a506776-e849-44c4-be25-68c89b452985 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:18.939099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cdf37-8c57-4fee-8658-608bdcd14ff7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:18.939911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cdf37-8c57-4fee-8658-608bdcd14ff7 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:18.940200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cdf37-8c57-4fee-8658-608bdcd14ff7 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:18.940507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6cdf37-8c57-4fee-8658-608bdcd14ff7 None admin] PATH_INFO: `/v3/roles/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:18.951117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6cdf37-8c57-4fee-8658-608bdcd14ff7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-7d6cdf37-8c57-4fee-8658-608bdcd14ff7 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:11:18.958953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:18.960166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:18.961033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:18.961033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:18.961033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:18.961033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:18.961033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:11:18.961033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:11:18.961033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:11:18.961033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:11:18.961033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:11:18.961033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:11:18.961033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. May 26 18:11:18.961033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:18.961033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 604/1235] 10.222.0.64 () {56 vars in 1102 bytes} [Thu May 26 18:11:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:18.967012 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1b44b-eca9-4f90-b19f-f47e1ed330d9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:19.017665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:19.084392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba1b44b-eca9-4f90-b19f-f47e1ed330d9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:19.128348 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a661af-0ce8-4cb9-a0cc-dad14b793fc8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:19.129074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a661af-0ce8-4cb9-a0cc-dad14b793fc8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:19.129363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a661af-0ce8-4cb9-a0cc-dad14b793fc8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:19.129631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a661af-0ce8-4cb9-a0cc-dad14b793fc8 None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:19.130368 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a661af-0ce8-4cb9-a0cc-dad14b793fc8 None admin] RBAC: Adding query filter params (name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:19.130692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a661af-0ce8-4cb9-a0cc-dad14b793fc8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:19.132193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a661af-0ce8-4cb9-a0cc-dad14b793fc8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:19.140483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 632/1236] 10.222.0.64 () {56 vars in 1103 bytes} [Thu May 26 18:11:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:19.146464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cdf37-8c57-4fee-8658-608bdcd14ff7 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:19.245770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:19.263523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6cdf37-8c57-4fee-8658-608bdcd14ff7 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:19.304848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0314c6-d4bd-4558-8edc-39271a26b1fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:19.305862 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0314c6-d4bd-4558-8edc-39271a26b1fb None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:19.306251 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0314c6-d4bd-4558-8edc-39271a26b1fb None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:19.306669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d0314c6-d4bd-4558-8edc-39271a26b1fb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:19.322012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0314c6-d4bd-4558-8edc-39271a26b1fb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:19.324007 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d0314c6-d4bd-4558-8edc-39271a26b1fb None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-4d0314c6-d4bd-4558-8edc-39271a26b1fb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:11:19.348301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:19.349508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:19.350522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:11:19.350522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:11:19.350522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:19.350522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:19.350522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 605/1237] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:19.356277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a661af-0ce8-4cb9-a0cc-dad14b793fc8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:19.463498 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a661af-0ce8-4cb9-a0cc-dad14b793fc8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:19.473268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:19.499248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e523e-e604-461c-8c71-68d76bff675a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:19.499840 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e523e-e604-461c-8c71-68d76bff675a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:19.500124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e523e-e604-461c-8c71-68d76bff675a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:19.500394 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21e523e-e604-461c-8c71-68d76bff675a None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:19.501140 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e523e-e604-461c-8c71-68d76bff675a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:19.501443 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e523e-e604-461c-8c71-68d76bff675a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:19.502805 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21e523e-e604-461c-8c71-68d76bff675a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:19.515056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 633/1238] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:11:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:11:19.520697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0314c6-d4bd-4558-8edc-39271a26b1fb None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:19.635039 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d0314c6-d4bd-4558-8edc-39271a26b1fb None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:19.673922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfb5cb-9448-4e47-9be9-0c523b755b17 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:19.674716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfb5cb-9448-4e47-9be9-0c523b755b17 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:19.674998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfb5cb-9448-4e47-9be9-0c523b755b17 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:19.675272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbfb5cb-9448-4e47-9be9-0c523b755b17 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:19.677952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:19.684844 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfb5cb-9448-4e47-9be9-0c523b755b17 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:19.686687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4cbfb5cb-9448-4e47-9be9-0c523b755b17 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-4cbfb5cb-9448-4e47-9be9-0c523b755b17 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:11:19.702195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:19.708130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:19.709390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:19.709390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:19.709390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:11:19.709390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:11:19.709390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:11:19.709390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:11:19.709390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:11:19.709390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:11:19.709390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 18:11:19.709390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:19.709390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 606/1239] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:19.710122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e523e-e604-461c-8c71-68d76bff675a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:19.821415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21e523e-e604-461c-8c71-68d76bff675a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:19.857754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7dc35-bd3b-4bb7-aa7c-36e069a1e9a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:19.858743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7dc35-bd3b-4bb7-aa7c-36e069a1e9a8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:19.859054 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7dc35-bd3b-4bb7-aa7c-36e069a1e9a8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:19.859363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1f7dc35-bd3b-4bb7-aa7c-36e069a1e9a8 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:19.860325 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7dc35-bd3b-4bb7-aa7c-36e069a1e9a8 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:19.860669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7dc35-bd3b-4bb7-aa7c-36e069a1e9a8 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:19.862361 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1f7dc35-bd3b-4bb7-aa7c-36e069a1e9a8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:19.888286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 634/1240] 10.222.0.64 () {56 vars in 1143 bytes} [Thu May 26 18:11:19 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:11:19.894293 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfb5cb-9448-4e47-9be9-0c523b755b17 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:20.016463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cbfb5cb-9448-4e47-9be9-0c523b755b17 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:20.054171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbc5f7-9fa0-4822-a722-c7206ceab038 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:20.054814 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbc5f7-9fa0-4822-a722-c7206ceab038 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:20.055097 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbc5f7-9fa0-4822-a722-c7206ceab038 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:20.055373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dbc5f7-9fa0-4822-a722-c7206ceab038 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:20.121535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:20.129225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbc5f7-9fa0-4822-a722-c7206ceab038 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:20.130682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dbc5f7-9fa0-4822-a722-c7206ceab038 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:20.246101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 607/1241] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:11:19 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:11:20.251997 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7dc35-bd3b-4bb7-aa7c-36e069a1e9a8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:20.280317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:20.357499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1f7dc35-bd3b-4bb7-aa7c-36e069a1e9a8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:20.394786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b115c-9578-405e-bb3e-e0ae0200a549 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:20.395588 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b115c-9578-405e-bb3e-e0ae0200a549 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:20.395918 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b115c-9578-405e-bb3e-e0ae0200a549 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:20.396229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e7b115c-9578-405e-bb3e-e0ae0200a549 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:20.408349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b115c-9578-405e-bb3e-e0ae0200a549 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:20.410117 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e7b115c-9578-405e-bb3e-e0ae0200a549 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6e7b115c-9578-405e-bb3e-e0ae0200a549 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:11:20.429539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:20.430633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:20.431987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:11:20.431987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:11:20.431987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:20.431987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:20.431987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 635/1242] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 179 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:20.436879 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbc5f7-9fa0-4822-a722-c7206ceab038 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:20.544103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:20.550930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dbc5f7-9fa0-4822-a722-c7206ceab038 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:20.588411 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841d652-8b1a-4e75-adc3-ec1f6d5d77bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:20.589127 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841d652-8b1a-4e75-adc3-ec1f6d5d77bc None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:20.589412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841d652-8b1a-4e75-adc3-ec1f6d5d77bc None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:20.589721 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1841d652-8b1a-4e75-adc3-ec1f6d5d77bc None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:20.590515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841d652-8b1a-4e75-adc3-ec1f6d5d77bc None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:20.590851 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841d652-8b1a-4e75-adc3-ec1f6d5d77bc None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:20.592353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1841d652-8b1a-4e75-adc3-ec1f6d5d77bc None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:20.605387 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 608/1243] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:11:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:11:20.611687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b115c-9578-405e-bb3e-e0ae0200a549 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:20.695775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:20.719828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e7b115c-9578-405e-bb3e-e0ae0200a549 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:20.757505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3ea85-a454-4292-857f-8a0e20a3544a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:20.758299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3ea85-a454-4292-857f-8a0e20a3544a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:20.758577 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3ea85-a454-4292-857f-8a0e20a3544a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:20.758848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13b3ea85-a454-4292-857f-8a0e20a3544a None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:20.765573 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3ea85-a454-4292-857f-8a0e20a3544a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:20.767019 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13b3ea85-a454-4292-857f-8a0e20a3544a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-13b3ea85-a454-4292-857f-8a0e20a3544a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:11:20.780401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:20.781746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:20.782905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:11:20.782905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:11:20.782905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:11:20.782905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:11:20.782905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:11:20.782905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:11:20.782905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:11:20.782905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:20.782905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 636/1244] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:11:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 171 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:20.791484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841d652-8b1a-4e75-adc3-ec1f6d5d77bc None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:20.900169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1841d652-8b1a-4e75-adc3-ec1f6d5d77bc None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:20.937013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a692d40-974e-4f2d-a2e0-2be5c8491b87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:20.937695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692d40-974e-4f2d-a2e0-2be5c8491b87 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:20.937978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692d40-974e-4f2d-a2e0-2be5c8491b87 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:20.938256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a692d40-974e-4f2d-a2e0-2be5c8491b87 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:20.939035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a692d40-974e-4f2d-a2e0-2be5c8491b87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:20.939350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a692d40-974e-4f2d-a2e0-2be5c8491b87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:20.940780 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a692d40-974e-4f2d-a2e0-2be5c8491b87 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:20.953674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 609/1245] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:11:20 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:20.960051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3ea85-a454-4292-857f-8a0e20a3544a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:21.067209 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13b3ea85-a454-4292-857f-8a0e20a3544a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:21.110709 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c425f370-4ba7-4dca-879c-bfecd91e9e86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:21.111432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425f370-4ba7-4dca-879c-bfecd91e9e86 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:21.111746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425f370-4ba7-4dca-879c-bfecd91e9e86 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:21.112083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c425f370-4ba7-4dca-879c-bfecd91e9e86 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:21.113035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425f370-4ba7-4dca-879c-bfecd91e9e86 None admin] RBAC: Adding query filter params (role.id=ec1445be03c942a98070dd9213fd0705, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=1ab4efe6f79d4b3ca5618c089c5f3d24) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:21.113397 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425f370-4ba7-4dca-879c-bfecd91e9e86 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:21.115023 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c425f370-4ba7-4dca-879c-bfecd91e9e86 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:21.121176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 637/1246] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:11:20 2022] GET /identity/v3/role_assignments?user.id=1ab4efe6f79d4b3ca5618c089c5f3d24&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=ec1445be03c942a98070dd9213fd0705 => generated 608 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:23.360305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e161361-a573-48ab-b400-c3d3929d7d06 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:23.360860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e161361-a573-48ab-b400-c3d3929d7d06 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:23.360860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e161361-a573-48ab-b400-c3d3929d7d06 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:23.362411 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 610/1247] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:11:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:11:23.367538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c21f1-35cd-45ff-990e-9c655651973d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:23.368238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c21f1-35cd-45ff-990e-9c655651973d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:23.368238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-061c21f1-35cd-45ff-990e-9c655651973d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:23.373281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:23.387475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-061c21f1-35cd-45ff-990e-9c655651973d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:11:23.389229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-061c21f1-35cd-45ff-990e-9c655651973d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:23.465505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 638/1248] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:11:23 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:11:23.489182 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e161361-a573-48ab-b400-c3d3929d7d06 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:23.511142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:23.603703 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e161361-a573-48ab-b400-c3d3929d7d06 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:23.639045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd74db9-e71e-45d2-a747-081a45538a13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:23.639823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd74db9-e71e-45d2-a747-081a45538a13 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:23.640102 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd74db9-e71e-45d2-a747-081a45538a13 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:23.640374 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fd74db9-e71e-45d2-a747-081a45538a13 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:23.650653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0fd74db9-e71e-45d2-a747-081a45538a13 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-0fd74db9-e71e-45d2-a747-081a45538a13 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:11:23.659015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:23.660246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:23.661613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:23.661613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:23.661613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:23.661613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:23.661613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:11:23.661613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:11:23.661613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:11:23.661613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:11:23.661613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:11:23.661613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:11:23.661613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:11:23.661613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:23.661613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 611/1249] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:11:23 2022] GET /identity/v3/roles/admin => generated 83 bytes in 172 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:11:23.666194 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c21f1-35cd-45ff-990e-9c655651973d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:23.773055 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-061c21f1-35cd-45ff-990e-9c655651973d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:23.804059 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:23.809949 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a3013-4b0a-422b-b11c-a3f507ef1bcd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:23.810624 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a3013-4b0a-422b-b11c-a3f507ef1bcd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:23.810905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a3013-4b0a-422b-b11c-a3f507ef1bcd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:23.811184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b94a3013-4b0a-422b-b11c-a3f507ef1bcd None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:23.811951 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a3013-4b0a-422b-b11c-a3f507ef1bcd None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:23.812232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a3013-4b0a-422b-b11c-a3f507ef1bcd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:23.813626 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b94a3013-4b0a-422b-b11c-a3f507ef1bcd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:23.825024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 639/1250] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:11:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:23.828217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd74db9-e71e-45d2-a747-081a45538a13 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:23.909307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:23.936003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fd74db9-e71e-45d2-a747-081a45538a13 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:23.974351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417c324-38f9-4f25-bbae-570a9c68c362 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:23.975143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417c324-38f9-4f25-bbae-570a9c68c362 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:23.975440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417c324-38f9-4f25-bbae-570a9c68c362 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:23.975722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7417c324-38f9-4f25-bbae-570a9c68c362 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:23.987659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417c324-38f9-4f25-bbae-570a9c68c362 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:23.989149 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7417c324-38f9-4f25-bbae-570a9c68c362 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-7417c324-38f9-4f25-bbae-570a9c68c362 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:11:24.008289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:24.009580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:24.010997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:11:24.010997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:11:24.010997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:24.010997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:24.010997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 612/1251] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 182 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:11:24.015981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a3013-4b0a-422b-b11c-a3f507ef1bcd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:24.130785 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b94a3013-4b0a-422b-b11c-a3f507ef1bcd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:24.174252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55f767-adf9-40b2-9c90-d07375957c6a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:24.175017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55f767-adf9-40b2-9c90-d07375957c6a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:24.175326 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55f767-adf9-40b2-9c90-d07375957c6a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:24.175643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e55f767-adf9-40b2-9c90-d07375957c6a None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:24.176391 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55f767-adf9-40b2-9c90-d07375957c6a None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:24.176704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55f767-adf9-40b2-9c90-d07375957c6a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:24.178104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e55f767-adf9-40b2-9c90-d07375957c6a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:24.191149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 640/1252] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:11:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 176 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:24.196764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417c324-38f9-4f25-bbae-570a9c68c362 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:24.313184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7417c324-38f9-4f25-bbae-570a9c68c362 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:24.346594 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:24.356276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c4d8b-4490-4d35-b5d1-9038e61b8fc3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:24.357360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c4d8b-4490-4d35-b5d1-9038e61b8fc3 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:24.357624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c4d8b-4490-4d35-b5d1-9038e61b8fc3 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:24.357890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c4d8b-4490-4d35-b5d1-9038e61b8fc3 None admin] PATH_INFO: `/v3/users/placement` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:24.365997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c4d8b-4490-4d35-b5d1-9038e61b8fc3 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:24.367443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c4d8b-4490-4d35-b5d1-9038e61b8fc3 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-5a1c4d8b-4490-4d35-b5d1-9038e61b8fc3 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:11:24.382002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:24.383170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:24.384189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:24.384189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:24.384189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:11:24.384189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:11:24.384189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:11:24.384189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:11:24.384189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:11:24.384189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:11:24.384189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 18:11:24.384189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:24.384189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 613/1253] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:24 2022] GET /identity/v3/users/placement => generated 87 bytes in 187 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:24.390125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55f767-adf9-40b2-9c90-d07375957c6a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:24.453289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:24.510919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e55f767-adf9-40b2-9c90-d07375957c6a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:24.545935 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9d0c0-ae50-4d71-99fa-a0d14c117fb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:24.546599 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9d0c0-ae50-4d71-99fa-a0d14c117fb1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:24.546893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9d0c0-ae50-4d71-99fa-a0d14c117fb1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:24.547152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b9d0c0-ae50-4d71-99fa-a0d14c117fb1 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:24.547972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9d0c0-ae50-4d71-99fa-a0d14c117fb1 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:24.548560 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9d0c0-ae50-4d71-99fa-a0d14c117fb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:24.550676 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b9d0c0-ae50-4d71-99fa-a0d14c117fb1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:24.576178 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 641/1254] 10.222.0.64 () {56 vars in 1143 bytes} [Thu May 26 18:11:24 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:24.581639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c4d8b-4490-4d35-b5d1-9038e61b8fc3 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:24.690125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c4d8b-4490-4d35-b5d1-9038e61b8fc3 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:24.730175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30dad40-f692-4878-910a-2c6941fbc68c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:24.730887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dad40-f692-4878-910a-2c6941fbc68c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:24.731189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dad40-f692-4878-910a-2c6941fbc68c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:24.731460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e30dad40-f692-4878-910a-2c6941fbc68c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:24.786121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:24.801593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30dad40-f692-4878-910a-2c6941fbc68c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:24.803043 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e30dad40-f692-4878-910a-2c6941fbc68c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:24.917921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 614/1255] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:11:24 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 359 bytes (2 switches on core 0) May 26 18:11:24.923877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9d0c0-ae50-4d71-99fa-a0d14c117fb1 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:25.039023 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b9d0c0-ae50-4d71-99fa-a0d14c117fb1 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:25.054123 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:25.075676 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75750d-4466-4b07-aedf-c332b4234049 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:25.076480 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75750d-4466-4b07-aedf-c332b4234049 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:25.076758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75750d-4466-4b07-aedf-c332b4234049 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:25.077062 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75750d-4466-4b07-aedf-c332b4234049 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:25.088110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75750d-4466-4b07-aedf-c332b4234049 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:25.090188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75750d-4466-4b07-aedf-c332b4234049 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ad75750d-4466-4b07-aedf-c332b4234049 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:11:25.109687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:25.110838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:25.111741 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:11:25.111741 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:11:25.111741 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:25.111741 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:25.111741 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 642/1256] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:25.116829 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30dad40-f692-4878-910a-2c6941fbc68c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:25.210145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:25.223223 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e30dad40-f692-4878-910a-2c6941fbc68c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:25.258086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2090e-a137-4af1-9388-d5aa04b10d67 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:25.259182 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2090e-a137-4af1-9388-d5aa04b10d67 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:25.259631 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2090e-a137-4af1-9388-d5aa04b10d67 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:25.260058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d2090e-a137-4af1-9388-d5aa04b10d67 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:25.261770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2090e-a137-4af1-9388-d5aa04b10d67 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:25.262258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2090e-a137-4af1-9388-d5aa04b10d67 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:25.264068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54d2090e-a137-4af1-9388-d5aa04b10d67 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:25.278345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 615/1257] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:11:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:25.283891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75750d-4466-4b07-aedf-c332b4234049 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:25.388136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75750d-4466-4b07-aedf-c332b4234049 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:25.421918 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19905605-eb7a-4578-aee7-f74eec08a1b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:25.422708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19905605-eb7a-4578-aee7-f74eec08a1b8 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:25.422991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19905605-eb7a-4578-aee7-f74eec08a1b8 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:25.423263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19905605-eb7a-4578-aee7-f74eec08a1b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:25.429902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19905605-eb7a-4578-aee7-f74eec08a1b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:25.431317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19905605-eb7a-4578-aee7-f74eec08a1b8 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-19905605-eb7a-4578-aee7-f74eec08a1b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:11:25.445670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:25.446773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:25.447919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:11:25.447919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:11:25.447919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:11:25.447919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:11:25.447919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:11:25.447919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:11:25.447919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:11:25.447919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:25.447919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 643/1258] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:11:25 2022] GET /identity/v3/projects/service => generated 88 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:11:25.452903 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2090e-a137-4af1-9388-d5aa04b10d67 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:25.560851 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54d2090e-a137-4af1-9388-d5aa04b10d67 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:25.600304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5d0136c-4c8e-4c4e-af44-d7e710d28cc6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:25.600967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0136c-4c8e-4c4e-af44-d7e710d28cc6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:25.601294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0136c-4c8e-4c4e-af44-d7e710d28cc6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:25.601572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5d0136c-4c8e-4c4e-af44-d7e710d28cc6 None admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:25.602353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0136c-4c8e-4c4e-af44-d7e710d28cc6 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:25.602661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0136c-4c8e-4c4e-af44-d7e710d28cc6 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:25.604088 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5d0136c-4c8e-4c4e-af44-d7e710d28cc6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:25.617115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 616/1259] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:11:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:25.623373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19905605-eb7a-4578-aee7-f74eec08a1b8 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:25.648146 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:25.719933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19905605-eb7a-4578-aee7-f74eec08a1b8 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:25.752755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c748b-280b-4a9c-9cf4-a4988c9abda0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:25.753414 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c748b-280b-4a9c-9cf4-a4988c9abda0 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:25.753699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c748b-280b-4a9c-9cf4-a4988c9abda0 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:25.753975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c748b-280b-4a9c-9cf4-a4988c9abda0 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:25.754797 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c748b-280b-4a9c-9cf4-a4988c9abda0 None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=1ab4efe6f79d4b3ca5618c089c5f3d24) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:25.755112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c748b-280b-4a9c-9cf4-a4988c9abda0 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:25.756522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c748b-280b-4a9c-9cf4-a4988c9abda0 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:25.761810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 644/1260] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:11:25 2022] GET /identity/v3/role_assignments?user.id=1ab4efe6f79d4b3ca5618c089c5f3d24&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 259 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:27.970974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf270a-0dfa-4fdf-8605-df688b3c1893 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:27.971534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf270a-0dfa-4fdf-8605-df688b3c1893 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:27.971674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbf270a-0dfa-4fdf-8605-df688b3c1893 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:27.973434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 617/1261] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:11:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:11:27.980165 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73317b11-9b06-4466-9b35-ef7fbdd21afb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:27.980583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73317b11-9b06-4466-9b35-ef7fbdd21afb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:27.980764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73317b11-9b06-4466-9b35-ef7fbdd21afb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:27.998094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-73317b11-9b06-4466-9b35-ef7fbdd21afb None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:11:27.999261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-73317b11-9b06-4466-9b35-ef7fbdd21afb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:28.065766 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 645/1262] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:11:27 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:11:28.087712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf270a-0dfa-4fdf-8605-df688b3c1893 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:28.098716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:28.187782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbf270a-0dfa-4fdf-8605-df688b3c1893 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:28.220680 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1caf1-5fb1-41fa-a049-2455fa218437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:28.221551 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1caf1-5fb1-41fa-a049-2455fa218437 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:28.221780 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1caf1-5fb1-41fa-a049-2455fa218437 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:28.222052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37c1caf1-5fb1-41fa-a049-2455fa218437 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:28.232538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37c1caf1-5fb1-41fa-a049-2455fa218437 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-37c1caf1-5fb1-41fa-a049-2455fa218437 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:11:28.240435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:28.241614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:28.242630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:28.242630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:28.242630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:28.242630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:28.242630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:11:28.242630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:11:28.242630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:11:28.242630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:11:28.242630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:11:28.242630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:11:28.242630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:11:28.242630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:28.242630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 618/1263] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:11:28 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:28.248121 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73317b11-9b06-4466-9b35-ef7fbdd21afb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:28.265875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:28.343047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73317b11-9b06-4466-9b35-ef7fbdd21afb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:28.376217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb7435-c4c2-41ca-a7bb-79ad42142a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:28.376869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb7435-c4c2-41ca-a7bb-79ad42142a7a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:28.377187 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb7435-c4c2-41ca-a7bb-79ad42142a7a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:28.377463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeeb7435-c4c2-41ca-a7bb-79ad42142a7a None admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:28.378191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb7435-c4c2-41ca-a7bb-79ad42142a7a None admin] RBAC: Adding query filter params (name=admin) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:28.378494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb7435-c4c2-41ca-a7bb-79ad42142a7a None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:28.379845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeeb7435-c4c2-41ca-a7bb-79ad42142a7a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:28.387640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 646/1264] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:11:28 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 140 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:28.393483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1caf1-5fb1-41fa-a049-2455fa218437 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:28.457244 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:28.489974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37c1caf1-5fb1-41fa-a049-2455fa218437 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:28.521560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47b3b-c8f0-47ee-b15d-df14a7940ba5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:28.522319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47b3b-c8f0-47ee-b15d-df14a7940ba5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:28.522596 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47b3b-c8f0-47ee-b15d-df14a7940ba5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:28.522866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87d47b3b-c8f0-47ee-b15d-df14a7940ba5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:28.532859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d47b3b-c8f0-47ee-b15d-df14a7940ba5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:28.534328 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87d47b3b-c8f0-47ee-b15d-df14a7940ba5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-87d47b3b-c8f0-47ee-b15d-df14a7940ba5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:11:28.551262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:28.552318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:28.553480 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:11:28.553480 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:11:28.553480 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:28.553480 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:28.553480 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 619/1265] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 159 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:28.558550 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb7435-c4c2-41ca-a7bb-79ad42142a7a None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:28.643582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:28.662076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeeb7435-c4c2-41ca-a7bb-79ad42142a7a None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:28.693775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600acde-90dc-4294-b501-f6ffdeff60b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:28.694421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600acde-90dc-4294-b501-f6ffdeff60b2 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:28.694701 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600acde-90dc-4294-b501-f6ffdeff60b2 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:28.694972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d600acde-90dc-4294-b501-f6ffdeff60b2 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:28.695673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600acde-90dc-4294-b501-f6ffdeff60b2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:28.695974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600acde-90dc-4294-b501-f6ffdeff60b2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:28.697331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d600acde-90dc-4294-b501-f6ffdeff60b2 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:28.708462 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 647/1266] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:11:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 151 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:28.714483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47b3b-c8f0-47ee-b15d-df14a7940ba5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:28.808965 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87d47b3b-c8f0-47ee-b15d-df14a7940ba5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:28.827299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:28.841401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e053-738d-4f15-b1a5-f103d454ed8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:28.842174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e053-738d-4f15-b1a5-f103d454ed8c None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:28.842452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e053-738d-4f15-b1a5-f103d454ed8c None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:28.842725 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b1e053-738d-4f15-b1a5-f103d454ed8c None admin] PATH_INFO: `/v3/users/placement` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:28.849846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1e053-738d-4f15-b1a5-f103d454ed8c None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:28.851271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b1e053-738d-4f15-b1a5-f103d454ed8c None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-87b1e053-738d-4f15-b1a5-f103d454ed8c None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:11:28.865819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:28.866934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:28.868430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:28.868430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:28.868430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:11:28.868430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:11:28.868430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:11:28.868430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:11:28.868430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:11:28.868430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:11:28.868430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 18:11:28.868430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:28.868430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 620/1267] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:28 2022] GET /identity/v3/users/placement => generated 87 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:28.872602 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600acde-90dc-4294-b501-f6ffdeff60b2 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:28.973512 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d600acde-90dc-4294-b501-f6ffdeff60b2 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:29.008404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc6bac-0875-4db3-9643-2f85e6a25682 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:29.009110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc6bac-0875-4db3-9643-2f85e6a25682 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:29.009395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc6bac-0875-4db3-9643-2f85e6a25682 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:29.009673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1dc6bac-0875-4db3-9643-2f85e6a25682 None admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:29.010500 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc6bac-0875-4db3-9643-2f85e6a25682 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:29.010811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc6bac-0875-4db3-9643-2f85e6a25682 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:29.012227 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1dc6bac-0875-4db3-9643-2f85e6a25682 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:29.020600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:29.029469 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 648/1268] 10.222.0.64 () {56 vars in 1143 bytes} [Thu May 26 18:11:28 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 157 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:29.035090 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e053-738d-4f15-b1a5-f103d454ed8c None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:29.131202 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b1e053-738d-4f15-b1a5-f103d454ed8c None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:29.162674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c579f33-ef71-4f54-9fc4-9e514a4938e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:29.163444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579f33-ef71-4f54-9fc4-9e514a4938e8 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:29.163723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579f33-ef71-4f54-9fc4-9e514a4938e8 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:29.163993 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c579f33-ef71-4f54-9fc4-9e514a4938e8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:29.174562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c579f33-ef71-4f54-9fc4-9e514a4938e8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:29.175984 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c579f33-ef71-4f54-9fc4-9e514a4938e8 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-3c579f33-ef71-4f54-9fc4-9e514a4938e8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:11:29.193496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:29.194583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:29.195696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:11:29.195696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:11:29.195696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:29.195696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:29.195696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 621/1269] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 160 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:29.200430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc6bac-0875-4db3-9643-2f85e6a25682 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:29.296012 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1dc6bac-0875-4db3-9643-2f85e6a25682 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:29.328102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866c0e0-6712-49f6-8e3c-e7ad1f3e2391 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:29.328747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c0e0-6712-49f6-8e3c-e7ad1f3e2391 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:29.329051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c0e0-6712-49f6-8e3c-e7ad1f3e2391 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:29.329328 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c866c0e0-6712-49f6-8e3c-e7ad1f3e2391 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:29.330034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866c0e0-6712-49f6-8e3c-e7ad1f3e2391 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:29.330339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866c0e0-6712-49f6-8e3c-e7ad1f3e2391 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:29.331675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c866c0e0-6712-49f6-8e3c-e7ad1f3e2391 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:29.342872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 649/1270] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:11:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:29.348373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c579f33-ef71-4f54-9fc4-9e514a4938e8 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:29.379477 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:29.445401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c579f33-ef71-4f54-9fc4-9e514a4938e8 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:29.477226 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bb7f4-83ae-4ffd-b1fe-8f2d1e06e237 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:29.477979 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bb7f4-83ae-4ffd-b1fe-8f2d1e06e237 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:29.478257 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bb7f4-83ae-4ffd-b1fe-8f2d1e06e237 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:29.478527 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a82bb7f4-83ae-4ffd-b1fe-8f2d1e06e237 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:29.485720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bb7f4-83ae-4ffd-b1fe-8f2d1e06e237 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:29.487182 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a82bb7f4-83ae-4ffd-b1fe-8f2d1e06e237 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-a82bb7f4-83ae-4ffd-b1fe-8f2d1e06e237 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:11:29.500899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:29.501977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:29.502892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:11:29.502892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:11:29.502892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:11:29.502892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:11:29.502892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:11:29.502892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:11:29.502892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:11:29.502892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:29.502892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 622/1271] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:11:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:29.507644 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866c0e0-6712-49f6-8e3c-e7ad1f3e2391 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:29.564194 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:29.605267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c866c0e0-6712-49f6-8e3c-e7ad1f3e2391 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:29.637356 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ee47867-de98-4115-9008-d74d78397c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:29.638006 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47867-de98-4115-9008-d74d78397c42 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:29.638290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47867-de98-4115-9008-d74d78397c42 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:29.638565 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ee47867-de98-4115-9008-d74d78397c42 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:29.639334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee47867-de98-4115-9008-d74d78397c42 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:29.639643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee47867-de98-4115-9008-d74d78397c42 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:29.641072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ee47867-de98-4115-9008-d74d78397c42 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:29.653113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 650/1272] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:11:29 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:29.658742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bb7f4-83ae-4ffd-b1fe-8f2d1e06e237 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:29.745892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:29.754937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a82bb7f4-83ae-4ffd-b1fe-8f2d1e06e237 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:29.787794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96aa7c7c-a4de-410a-b7af-c7dc012dd597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:29.788654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa7c7c-a4de-410a-b7af-c7dc012dd597 None admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:29.788930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa7c7c-a4de-410a-b7af-c7dc012dd597 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:29.789230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96aa7c7c-a4de-410a-b7af-c7dc012dd597 None admin] PATH_INFO: `/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/1ab4efe6f79d4b3ca5618c089c5f3d24/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:29.791113 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa7c7c-a4de-410a-b7af-c7dc012dd597 None admin] RBAC: Authorizing `identity:create_grant(project_id=ab7fe8d932964e7ab1f442f26ef0735b, user_id=1ab4efe6f79d4b3ca5618c089c5f3d24, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:29.792558 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96aa7c7c-a4de-410a-b7af-c7dc012dd597 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:29.804424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 623/1273] 10.222.0.64 () {58 vars in 1439 bytes} [Thu May 26 18:11:29 2022] PUT /identity/v3/projects/ab7fe8d932964e7ab1f442f26ef0735b/users/1ab4efe6f79d4b3ca5618c089c5f3d24/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:11:32.059739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c2337-95ce-4a8d-9d6d-6f970f38b54b None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:32.060274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c2337-95ce-4a8d-9d6d-6f970f38b54b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:32.060274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c2c2337-95ce-4a8d-9d6d-6f970f38b54b None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:32.061695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 651/1274] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:11:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:11:32.066755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622e5f-ddf2-45bf-89c4-9b9861ded19c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:32.067151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622e5f-ddf2-45bf-89c4-9b9861ded19c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:32.067316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83622e5f-ddf2-45bf-89c4-9b9861ded19c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:32.083519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-83622e5f-ddf2-45bf-89c4-9b9861ded19c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:11:32.084693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-83622e5f-ddf2-45bf-89c4-9b9861ded19c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:32.149261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 624/1275] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:11:32 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:11:32.172673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c2337-95ce-4a8d-9d6d-6f970f38b54b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:32.270900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c2c2337-95ce-4a8d-9d6d-6f970f38b54b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:32.288795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:32.305512 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1886c7-ef50-450e-b0f8-55f323e44c9f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:32.306291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1886c7-ef50-450e-b0f8-55f323e44c9f None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:32.306572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1886c7-ef50-450e-b0f8-55f323e44c9f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:32.307417 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b1886c7-ef50-450e-b0f8-55f323e44c9f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:32.317251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b1886c7-ef50-450e-b0f8-55f323e44c9f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-4b1886c7-ef50-450e-b0f8-55f323e44c9f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(role_id) May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role May 26 18:11:32.324704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:32.325853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:32.327072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:32.327072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:32.327072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:32.327072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:32.327072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role May 26 18:11:32.327072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) May 26 18:11:32.327072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role May 26 18:11:32.327072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() May 26 18:11:32.327072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role May 26 18:11:32.327072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) May 26 18:11:32.327072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. May 26 18:11:32.327072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:32.327072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 652/1276] 10.222.0.64 () {56 vars in 1096 bytes} [Thu May 26 18:11:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 154 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:32.331828 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83622e5f-ddf2-45bf-89c4-9b9861ded19c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:32.409275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:32.427776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83622e5f-ddf2-45bf-89c4-9b9861ded19c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:32.460052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5c802-1891-4b58-b04f-a67258b18d7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:32.460712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5c802-1891-4b58-b04f-a67258b18d7d None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:32.461019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5c802-1891-4b58-b04f-a67258b18d7d None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:32.461303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e5c802-1891-4b58-b04f-a67258b18d7d None admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:32.462050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5c802-1891-4b58-b04f-a67258b18d7d None admin] RBAC: Adding query filter params (name=admin) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:32.462361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5c802-1891-4b58-b04f-a67258b18d7d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:32.464237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e5c802-1891-4b58-b04f-a67258b18d7d None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:32.472224 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 625/1277] 10.222.0.64 () {56 vars in 1099 bytes} [Thu May 26 18:11:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:32.477806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1886c7-ef50-450e-b0f8-55f323e44c9f None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:32.574280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b1886c7-ef50-450e-b0f8-55f323e44c9f None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:32.607448 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5728ff-1d0e-4a29-98fe-bd168934af4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:32.608487 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5728ff-1d0e-4a29-98fe-bd168934af4d None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:32.608771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5728ff-1d0e-4a29-98fe-bd168934af4d None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:32.609077 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e5728ff-1d0e-4a29-98fe-bd168934af4d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:32.619236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5728ff-1d0e-4a29-98fe-bd168934af4d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:32.620722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e5728ff-1d0e-4a29-98fe-bd168934af4d None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-6e5728ff-1d0e-4a29-98fe-bd168934af4d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:11:32.637238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:32.638244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:32.639346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:11:32.639346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:11:32.639346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:32.639346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:32.639346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 653/1278] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) May 26 18:11:32.643917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5c802-1891-4b58-b04f-a67258b18d7d None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:32.744870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e5c802-1891-4b58-b04f-a67258b18d7d None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:32.778311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbe8cd-692b-4ca1-bbc9-ab3a79e53467 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:32.778968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbe8cd-692b-4ca1-bbc9-ab3a79e53467 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:32.779256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbe8cd-692b-4ca1-bbc9-ab3a79e53467 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:32.779536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46bbe8cd-692b-4ca1-bbc9-ab3a79e53467 None admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:32.780247 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbe8cd-692b-4ca1-bbc9-ab3a79e53467 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:32.780558 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbe8cd-692b-4ca1-bbc9-ab3a79e53467 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:32.781955 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46bbe8cd-692b-4ca1-bbc9-ab3a79e53467 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:32.793336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 626/1279] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:11:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:32.798919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5728ff-1d0e-4a29-98fe-bd168934af4d None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:32.828755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:32.895811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e5728ff-1d0e-4a29-98fe-bd168934af4d None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:32.928363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38730ace-9c0d-47a6-9298-5647742439cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:32.929161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38730ace-9c0d-47a6-9298-5647742439cc None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:32.929440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38730ace-9c0d-47a6-9298-5647742439cc None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:32.929710 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38730ace-9c0d-47a6-9298-5647742439cc None admin] PATH_INFO: `/v3/users/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:32.937376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38730ace-9c0d-47a6-9298-5647742439cc None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:32.938784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38730ace-9c0d-47a6-9298-5647742439cc None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-38730ace-9c0d-47a6-9298-5647742439cc None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_user(user_id) May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user May 26 18:11:32.953933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:32.955007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:32.956339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:32.956339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:32.956339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user May 26 18:11:32.956339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) May 26 18:11:32.956339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user May 26 18:11:32.956339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) May 26 18:11:32.956339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user May 26 18:11:32.956339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) May 26 18:11:32.956339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. May 26 18:11:32.956339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:32.956339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 654/1280] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:32 2022] GET /identity/v3/users/placement => generated 87 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:32.961528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbe8cd-692b-4ca1-bbc9-ab3a79e53467 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:32.966047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:33.074737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46bbe8cd-692b-4ca1-bbc9-ab3a79e53467 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:33.108961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69219826-4c15-4b06-9765-0ada8436adc9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:33.109588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69219826-4c15-4b06-9765-0ada8436adc9 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:33.109868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69219826-4c15-4b06-9765-0ada8436adc9 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:33.110140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69219826-4c15-4b06-9765-0ada8436adc9 None admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:33.110956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69219826-4c15-4b06-9765-0ada8436adc9 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:33.111261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69219826-4c15-4b06-9765-0ada8436adc9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:33.112696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69219826-4c15-4b06-9765-0ada8436adc9 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:33.129638 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 627/1281] 10.222.0.64 () {56 vars in 1143 bytes} [Thu May 26 18:11:32 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:33.135976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38730ace-9c0d-47a6-9298-5647742439cc None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:33.222132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:33.232349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38730ace-9c0d-47a6-9298-5647742439cc None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:33.264000 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3162f-ac98-49fa-b46a-586077370b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:33.264632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3162f-ac98-49fa-b46a-586077370b12 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:33.264911 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3162f-ac98-49fa-b46a-586077370b12 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:33.265288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34f3162f-ac98-49fa-b46a-586077370b12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:33.328751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3162f-ac98-49fa-b46a-586077370b12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:33.330206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34f3162f-ac98-49fa-b46a-586077370b12 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:33.415780 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:33.426728 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 655/1282] 10.222.0.64 () {58 vars in 1282 bytes} [Thu May 26 18:11:33 2022] GET /identity/v3/auth/tokens => generated 2108 bytes in 292 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) May 26 18:11:33.432897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69219826-4c15-4b06-9765-0ada8436adc9 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:33.492805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:33.531083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69219826-4c15-4b06-9765-0ada8436adc9 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:33.566475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e90f84-2600-4f28-8de4-176703129a10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:33.566475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e90f84-2600-4f28-8de4-176703129a10 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:33.566475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e90f84-2600-4f28-8de4-176703129a10 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:33.566475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94e90f84-2600-4f28-8de4-176703129a10 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:33.575714 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e90f84-2600-4f28-8de4-176703129a10 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:33.577193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94e90f84-2600-4f28-8de4-176703129a10 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-94e90f84-2600-4f28-8de4-176703129a10 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_domain(domain_id) May 26 18:11:33.594805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:33.595865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:33.596998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain May 26 18:11:33.596998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) May 26 18:11:33.596998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. May 26 18:11:33.596998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:33.596998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 628/1283] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:11:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 164 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:33.601632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3162f-ac98-49fa-b46a-586077370b12 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:33.696196 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34f3162f-ac98-49fa-b46a-586077370b12 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:33.729113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c98ae8-a8cf-4392-8746-702aa372a301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:33.729759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c98ae8-a8cf-4392-8746-702aa372a301 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:33.730041 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c98ae8-a8cf-4392-8746-702aa372a301 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:33.730315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2c98ae8-a8cf-4392-8746-702aa372a301 None admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:33.731029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c98ae8-a8cf-4392-8746-702aa372a301 None admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:33.731337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c98ae8-a8cf-4392-8746-702aa372a301 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:33.732686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2c98ae8-a8cf-4392-8746-702aa372a301 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:33.743673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 656/1284] 10.222.0.64 () {56 vars in 1109 bytes} [Thu May 26 18:11:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 143 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:33.748970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e90f84-2600-4f28-8de4-176703129a10 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:33.843964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94e90f84-2600-4f28-8de4-176703129a10 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:33.858000 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:33.877542 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cd3e9-7278-45dd-a600-eaf92148c1e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:33.878310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cd3e9-7278-45dd-a600-eaf92148c1e5 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:33.878586 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cd3e9-7278-45dd-a600-eaf92148c1e5 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:33.878856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0cd3e9-7278-45dd-a600-eaf92148c1e5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:33.885272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cd3e9-7278-45dd-a600-eaf92148c1e5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:33.886694 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0cd3e9-7278-45dd-a600-eaf92148c1e5 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application [None req-df0cd3e9-7278-45dd-a600-eaf92148c1e5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(project_id) May 26 18:11:33.899921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application with Lock( May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:33.901485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:33.902583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project May 26 18:11:33.902583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) May 26 18:11:33.902583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project May 26 18:11:33.902583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() May 26 18:11:33.902583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project May 26 18:11:33.902583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) May 26 18:11:33.902583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. May 26 18:11:33.902583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: ERROR keystone.server.flask.application May 26 18:11:33.902583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 629/1285] 10.222.0.64 () {56 vars in 1111 bytes} [Thu May 26 18:11:33 2022] GET /identity/v3/projects/service => generated 88 bytes in 153 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:33.907279 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c98ae8-a8cf-4392-8746-702aa372a301 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:33.958350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:34.008077 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2c98ae8-a8cf-4392-8746-702aa372a301 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:34.039822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17705113-cbe0-4575-a303-877692ac08f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:34.040473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17705113-cbe0-4575-a303-877692ac08f1 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:34.040752 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17705113-cbe0-4575-a303-877692ac08f1 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:34.041048 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17705113-cbe0-4575-a303-877692ac08f1 None admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:34.042395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17705113-cbe0-4575-a303-877692ac08f1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:34.042699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17705113-cbe0-4575-a303-877692ac08f1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:34.044139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17705113-cbe0-4575-a303-877692ac08f1 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:34.055525 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 657/1286] 10.222.0.64 () {56 vars in 1148 bytes} [Thu May 26 18:11:33 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:34.061860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cd3e9-7278-45dd-a600-eaf92148c1e5 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:34.159421 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0cd3e9-7278-45dd-a600-eaf92148c1e5 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:34.191950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b66073e-0a5e-448b-9a96-def4b3fec6ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:34.192593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66073e-0a5e-448b-9a96-def4b3fec6ad None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:34.192876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66073e-0a5e-448b-9a96-def4b3fec6ad None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:34.193182 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b66073e-0a5e-448b-9a96-def4b3fec6ad None admin] PATH_INFO: `/v3/role_assignments` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:34.193999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66073e-0a5e-448b-9a96-def4b3fec6ad None admin] RBAC: Adding query filter params (role.id=a66ff4069aae49baac5f96c0b4657894, scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b, user.id=1ab4efe6f79d4b3ca5618c089c5f3d24) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:34.194310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66073e-0a5e-448b-9a96-def4b3fec6ad None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:34.195723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b66073e-0a5e-448b-9a96-def4b3fec6ad None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:34.202034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 630/1287] 10.222.0.64 () {56 vars in 1374 bytes} [Thu May 26 18:11:34 2022] GET /identity/v3/role_assignments?user.id=1ab4efe6f79d4b3ca5618c089c5f3d24&scope.project.id=ab7fe8d932964e7ab1f442f26ef0735b&role.id=a66ff4069aae49baac5f96c0b4657894 => generated 608 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:36.394550 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968130bc-b628-473e-a7ea-cb6704567c4f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:36.395073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968130bc-b628-473e-a7ea-cb6704567c4f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:36.395162 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-968130bc-b628-473e-a7ea-cb6704567c4f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:36.396514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 658/1288] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:11:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:11:36.402402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aec5df-cf5c-43d6-bcf1-7f7f3155b498 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:36.402788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aec5df-cf5c-43d6-bcf1-7f7f3155b498 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:36.402960 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58aec5df-cf5c-43d6-bcf1-7f7f3155b498 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:36.420032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-58aec5df-cf5c-43d6-bcf1-7f7f3155b498 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:11:36.421362 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-58aec5df-cf5c-43d6-bcf1-7f7f3155b498 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:36.450408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:36.486773 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 631/1289] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:11:36 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:11:36.508571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968130bc-b628-473e-a7ea-cb6704567c4f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:36.605286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-968130bc-b628-473e-a7ea-cb6704567c4f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:36.615624 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:36.638489 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badd795-2ecb-45a2-94a4-00cb3d4d6ae7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:36.639261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badd795-2ecb-45a2-94a4-00cb3d4d6ae7 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:36.639545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badd795-2ecb-45a2-94a4-00cb3d4d6ae7 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:36.639817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2badd795-2ecb-45a2-94a4-00cb3d4d6ae7 None admin] PATH_INFO: `/v3/services/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:36.640454 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badd795-2ecb-45a2-94a4-00cb3d4d6ae7 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:36.641822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2badd795-2ecb-45a2-94a4-00cb3d4d6ae7 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-2badd795-2ecb-45a2-94a4-00cb3d4d6ae7 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:36.653912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:36.655133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:36.656169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 659/1290] 10.222.0.64 () {56 vars in 1117 bytes} [Thu May 26 18:11:36 2022] GET /identity/v3/services/placement => generated 90 bytes in 147 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:36.663025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aec5df-cf5c-43d6-bcf1-7f7f3155b498 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:36.758578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58aec5df-cf5c-43d6-bcf1-7f7f3155b498 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:36.792023 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18a194d6-f3b5-41e1-b2f9-6450dab5dcf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:36.792679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a194d6-f3b5-41e1-b2f9-6450dab5dcf6 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:36.792955 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a194d6-f3b5-41e1-b2f9-6450dab5dcf6 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:36.793259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18a194d6-f3b5-41e1-b2f9-6450dab5dcf6 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:36.793953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a194d6-f3b5-41e1-b2f9-6450dab5dcf6 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:36.794256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a194d6-f3b5-41e1-b2f9-6450dab5dcf6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:36.795623 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18a194d6-f3b5-41e1-b2f9-6450dab5dcf6 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:36.800781 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 632/1291] 10.222.0.64 () {56 vars in 1116 bytes} [Thu May 26 18:11:36 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:36.806653 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badd795-2ecb-45a2-94a4-00cb3d4d6ae7 None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:36.904317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2badd795-2ecb-45a2-94a4-00cb3d4d6ae7 None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:36.936961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e10a5ab7-8987-4d84-940e-a728224f4cd6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:36.937636 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a5ab7-8987-4d84-940e-a728224f4cd6 None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:36.937920 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a5ab7-8987-4d84-940e-a728224f4cd6 None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:36.938204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e10a5ab7-8987-4d84-940e-a728224f4cd6 None admin] PATH_INFO: `/v3/services` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:36.938898 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a5ab7-8987-4d84-940e-a728224f4cd6 None admin] RBAC: Adding query filter params (type=placement) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:36.939205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a5ab7-8987-4d84-940e-a728224f4cd6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:36.940574 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e10a5ab7-8987-4d84-940e-a728224f4cd6 None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:36.945169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 660/1292] 10.222.0.64 () {56 vars in 1116 bytes} [Thu May 26 18:11:36 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 139 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:39.137266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061e1fe-8bd1-464e-8c53-4574ba1714b0 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:39.137847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061e1fe-8bd1-464e-8c53-4574ba1714b0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:39.137847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7061e1fe-8bd1-464e-8c53-4574ba1714b0 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:39.139186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 633/1293] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:11:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:11:39.144472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8e44-27ac-4f88-82e5-5af334ea18ef None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:39.144896 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8e44-27ac-4f88-82e5-5af334ea18ef None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:39.145061 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2dc8e44-27ac-4f88-82e5-5af334ea18ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:39.161534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c2dc8e44-27ac-4f88-82e5-5af334ea18ef None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:11:39.162701 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c2dc8e44-27ac-4f88-82e5-5af334ea18ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:39.191061 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:39.227061 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 661/1294] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:11:39 2022] POST /identity/v3/auth/tokens => generated 2108 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:11:39.249956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061e1fe-8bd1-464e-8c53-4574ba1714b0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:39.280797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:39.348885 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7061e1fe-8bd1-464e-8c53-4574ba1714b0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:39.381214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0271eee9-7230-4448-90aa-3ed9f0323884 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:39.381858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271eee9-7230-4448-90aa-3ed9f0323884 None admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:39.382136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271eee9-7230-4448-90aa-3ed9f0323884 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:39.382410 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0271eee9-7230-4448-90aa-3ed9f0323884 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:39.383106 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271eee9-7230-4448-90aa-3ed9f0323884 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:39.384455 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0271eee9-7230-4448-90aa-3ed9f0323884 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:39.397564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 634/1295] 10.222.0.64 () {60 vars in 1141 bytes} [Thu May 26 18:11:39 2022] POST /identity/v3/services => generated 246 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:11:41.606823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80420a4-66db-4485-94a9-d9dfe85d66e2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:41.607335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80420a4-66db-4485-94a9-d9dfe85d66e2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:41.607335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b80420a4-66db-4485-94a9-d9dfe85d66e2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:41.608922 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 662/1296] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:11:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:11:41.614120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4573d2-0260-4811-a614-3b5711b5951e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:41.614557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4573d2-0260-4811-a614-3b5711b5951e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:41.614681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da4573d2-0260-4811-a614-3b5711b5951e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:41.631109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-da4573d2-0260-4811-a614-3b5711b5951e None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:11:41.632288 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-da4573d2-0260-4811-a614-3b5711b5951e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:41.702626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 635/1297] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:11:41 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) May 26 18:11:41.725318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80420a4-66db-4485-94a9-d9dfe85d66e2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:41.822987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b80420a4-66db-4485-94a9-d9dfe85d66e2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:41.855930 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc294ee-e781-4142-b4f5-f180e009b49e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:41.856710 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc294ee-e781-4142-b4f5-f180e009b49e None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:41.857063 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc294ee-e781-4142-b4f5-f180e009b49e None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:41.857290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dc294ee-e781-4142-b4f5-f180e009b49e None admin] PATH_INFO: `/v3/services/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:41.858225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc294ee-e781-4142-b4f5-f180e009b49e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:41.859582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dc294ee-e781-4142-b4f5-f180e009b49e None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-9dc294ee-e781-4142-b4f5-f180e009b49e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:41.871569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:41.872810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:41.873977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 663/1298] 10.222.0.64 () {56 vars in 1117 bytes} [Thu May 26 18:11:41 2022] GET /identity/v3/services/placement => generated 90 bytes in 148 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:41.878925 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4573d2-0260-4811-a614-3b5711b5951e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:41.896689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:41.982429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da4573d2-0260-4811-a614-3b5711b5951e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:42.018490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df72cb-2162-425d-b497-76c51e1e7c63 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:42.019150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df72cb-2162-425d-b497-76c51e1e7c63 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:42.019432 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df72cb-2162-425d-b497-76c51e1e7c63 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:42.019702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59df72cb-2162-425d-b497-76c51e1e7c63 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:42.020390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df72cb-2162-425d-b497-76c51e1e7c63 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:42.020692 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df72cb-2162-425d-b497-76c51e1e7c63 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:42.022080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59df72cb-2162-425d-b497-76c51e1e7c63 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:42.027048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 636/1299] 10.222.0.64 () {56 vars in 1116 bytes} [Thu May 26 18:11:41 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:42.032964 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc294ee-e781-4142-b4f5-f180e009b49e None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:42.063900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:42.129033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dc294ee-e781-4142-b4f5-f180e009b49e None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:42.161264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cbf8da8-aa80-45db-900a-dd54023e473a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:42.161912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8da8-aa80-45db-900a-dd54023e473a None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:42.162192 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8da8-aa80-45db-900a-dd54023e473a None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:42.162466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cbf8da8-aa80-45db-900a-dd54023e473a None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:42.163235 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf8da8-aa80-45db-900a-dd54023e473a None admin] RBAC: Adding query filter params (interface=public, service_id=9d20f56a95a747aa93d8dc737103b570, region_id=RegionOne) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:42.163543 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf8da8-aa80-45db-900a-dd54023e473a None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:42.164891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6cbf8da8-aa80-45db-900a-dd54023e473a None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:42.170363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 664/1300] 10.222.0.64 () {56 vars in 1251 bytes} [Thu May 26 18:11:42 2022] GET /identity/v3/endpoints?service_id=9d20f56a95a747aa93d8dc737103b570&interface=public®ion_id=RegionOne => generated 194 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:42.176013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df72cb-2162-425d-b497-76c51e1e7c63 None admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:42.255032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:42.273209 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59df72cb-2162-425d-b497-76c51e1e7c63 None admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:42.306621 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67b91674-5da5-4921-a2e9-bddeea124695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:42.307282 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b91674-5da5-4921-a2e9-bddeea124695 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:42.307567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b91674-5da5-4921-a2e9-bddeea124695 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:42.307846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67b91674-5da5-4921-a2e9-bddeea124695 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:42.308522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b91674-5da5-4921-a2e9-bddeea124695 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:42.309908 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67b91674-5da5-4921-a2e9-bddeea124695 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:42.316451 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 637/1301] 10.222.0.64 () {56 vars in 1087 bytes} [Thu May 26 18:11:42 2022] GET /identity/v3/services => generated 2191 bytes in 141 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:11:44.471153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaead4-6b68-4794-8ec2-9ab9f441f00e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:44.471672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaead4-6b68-4794-8ec2-9ab9f441f00e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:44.471672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6feaead4-6b68-4794-8ec2-9ab9f441f00e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:44.472977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 665/1302] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:11:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:11:44.478052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16d488-8717-4b14-966b-a8c6546f04c4 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:44.478482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16d488-8717-4b14-966b-a8c6546f04c4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:44.478592 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f16d488-8717-4b14-966b-a8c6546f04c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:44.495945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6f16d488-8717-4b14-966b-a8c6546f04c4 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:11:44.497158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6f16d488-8717-4b14-966b-a8c6546f04c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:11:44.559858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 638/1303] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:11:44 2022] POST /identity/v3/auth/tokens => generated 2211 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) May 26 18:11:44.582249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaead4-6b68-4794-8ec2-9ab9f441f00e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:44.672047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:44.678945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6feaead4-6b68-4794-8ec2-9ab9f441f00e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:44.711688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99cdee-d7c8-438e-b24b-0f3eed80b5cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:44.712461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99cdee-d7c8-438e-b24b-0f3eed80b5cd None admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:44.712764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99cdee-d7c8-438e-b24b-0f3eed80b5cd None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:44.713061 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab99cdee-d7c8-438e-b24b-0f3eed80b5cd None admin] PATH_INFO: `/v3/services/placement` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:44.713707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99cdee-d7c8-438e-b24b-0f3eed80b5cd None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:44.715042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab99cdee-d7c8-438e-b24b-0f3eed80b5cd None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application [None req-ab99cdee-d7c8-438e-b24b-0f3eed80b5cd None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application Traceback (most recent call last): May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1523, in full_dispatch_request May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application rv = self.dispatch_request() May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1509, in dispatch_request May 26 18:11:44.726425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**req.view_args) May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 84, in view May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(*args, **kwargs) May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._get_service(service_id) May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func May 26 18:11:44.727576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.get_or_create( May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application with Lock( May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self._enter() May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application return self.creator() May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application created_value = creator( May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: ERROR keystone.server.flask.application May 26 18:11:44.729115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 666/1304] 10.222.0.64 () {56 vars in 1117 bytes} [Thu May 26 18:11:44 2022] GET /identity/v3/services/placement => generated 90 bytes in 146 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) May 26 18:11:44.734126 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16d488-8717-4b14-966b-a8c6546f04c4 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:44.809057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:44.831094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f16d488-8717-4b14-966b-a8c6546f04c4 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:44.868893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c1ee77-29aa-441b-907b-da52c693a2e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:44.869576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1ee77-29aa-441b-907b-da52c693a2e1 None admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:44.869905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1ee77-29aa-441b-907b-da52c693a2e1 None admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:44.870684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c1ee77-29aa-441b-907b-da52c693a2e1 None admin] PATH_INFO: `/v3/services` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:44.871381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1ee77-29aa-441b-907b-da52c693a2e1 None admin] RBAC: Adding query filter params (name=placement) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:11:44.871687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1ee77-29aa-441b-907b-da52c693a2e1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:44.873124 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c1ee77-29aa-441b-907b-da52c693a2e1 None admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:44.878114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 639/1305] 10.222.0.64 () {56 vars in 1116 bytes} [Thu May 26 18:11:44 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 144 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:11:44.883730 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99cdee-d7c8-438e-b24b-0f3eed80b5cd None admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:11:44.979087 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab99cdee-d7c8-438e-b24b-0f3eed80b5cd None admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:11:45.011348 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6826ab01-4437-459b-a6d6-1374b4c7894f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:11:45.011983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826ab01-4437-459b-a6d6-1374b4c7894f None admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:11:45.012267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826ab01-4437-459b-a6d6-1374b4c7894f None admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:11:45.012546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6826ab01-4437-459b-a6d6-1374b4c7894f None admin] PATH_INFO: `/v3/endpoints` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:11:45.013310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826ab01-4437-459b-a6d6-1374b4c7894f None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:11:45.014657 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6826ab01-4437-459b-a6d6-1374b4c7894f None admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:11:45.031814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 667/1306] 10.222.0.64 () {60 vars in 1144 bytes} [Thu May 26 18:11:44 2022] POST /identity/v3/endpoints => generated 331 bytes in 148 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:11:54.875240 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=30 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:11:55.027665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:47.885382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51fa77-222f-4ae9-b8aa-80981dbc3628 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:47.885970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51fa77-222f-4ae9-b8aa-80981dbc3628 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:47.885970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be51fa77-222f-4ae9-b8aa-80981dbc3628 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:47.892627 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f9cc7-65af-4e42-890e-ba64b378bfb2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:47.893085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f9cc7-65af-4e42-890e-ba64b378bfb2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:47.893265 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683f9cc7-65af-4e42-890e-ba64b378bfb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:47.896794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 640/1307] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:12:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:12:47.986377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-683f9cc7-65af-4e42-890e-ba64b378bfb2 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:47.987881 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-683f9cc7-65af-4e42-890e-ba64b378bfb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:48.109464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 668/1308] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:12:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:48.158688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de161b-c559-475d-9233-508fca5fd65e None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:48.159962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de161b-c559-475d-9233-508fca5fd65e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:48.160471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07de161b-c559-475d-9233-508fca5fd65e None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:48.163058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 641/1309] 10.222.0.64 () {54 vars in 964 bytes} [Thu May 26 18:12:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:12:48.168770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887405e1-5de0-46e1-8baa-5dece08b86df None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:48.169069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887405e1-5de0-46e1-8baa-5dece08b86df None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:48.169353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887405e1-5de0-46e1-8baa-5dece08b86df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:48.247887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-887405e1-5de0-46e1-8baa-5dece08b86df None None] MFA Rules not processed for user `1b725c28490f4f90b5eec565cd0fb603`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:48.249122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-887405e1-5de0-46e1-8baa-5dece08b86df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:48.270184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:48.342812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 669/1310] 10.222.0.64 () {58 vars in 1061 bytes} [Thu May 26 18:12:48 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:48.343810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de161b-c559-475d-9233-508fca5fd65e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:48.345919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-07de161b-c559-475d-9233-508fca5fd65e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:48.483304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07de161b-c559-475d-9233-508fca5fd65e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:48.595970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc7c7b7-380c-498c-985b-3552aa3f7f92 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:48.597020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7c7b7-380c-498c-985b-3552aa3f7f92 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:48.597518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7c7b7-380c-498c-985b-3552aa3f7f92 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:48.598020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc7c7b7-380c-498c-985b-3552aa3f7f92 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:48.601247 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4bc7c7b7-380c-498c-985b-3552aa3f7f92 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:48.672835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:48.735086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7c7b7-380c-498c-985b-3552aa3f7f92 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:48.736838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc7c7b7-380c-498c-985b-3552aa3f7f92 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:48.758055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 642/1311] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:12:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 415 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:12:51.228572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666e92b-388e-4bda-a53d-115f0c2a5c26 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:51.229114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666e92b-388e-4bda-a53d-115f0c2a5c26 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:51.229114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0666e92b-388e-4bda-a53d-115f0c2a5c26 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:51.230721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 670/1312] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:12:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:12:51.235916 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04802e2-c1b9-4e70-aefe-7b9b8b13c2bf None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:51.236379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04802e2-c1b9-4e70-aefe-7b9b8b13c2bf None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:51.236474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e04802e2-c1b9-4e70-aefe-7b9b8b13c2bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:51.309035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e04802e2-c1b9-4e70-aefe-7b9b8b13c2bf None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:51.310248 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e04802e2-c1b9-4e70-aefe-7b9b8b13c2bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:51.407746 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 643/1313] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:12:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:51.445638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666e92b-388e-4bda-a53d-115f0c2a5c26 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:51.447183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0666e92b-388e-4bda-a53d-115f0c2a5c26 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:51.550378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0666e92b-388e-4bda-a53d-115f0c2a5c26 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:51.623947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:51.626571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888dcc5b-1e2e-4ed6-ac3e-b385bcf025c9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:51.627276 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dcc5b-1e2e-4ed6-ac3e-b385bcf025c9 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:51.627751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dcc5b-1e2e-4ed6-ac3e-b385bcf025c9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:51.628200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888dcc5b-1e2e-4ed6-ac3e-b385bcf025c9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:51.630623 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-888dcc5b-1e2e-4ed6-ac3e-b385bcf025c9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:51.739609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dcc5b-1e2e-4ed6-ac3e-b385bcf025c9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:51.741063 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-888dcc5b-1e2e-4ed6-ac3e-b385bcf025c9 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:51.763977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 671/1314] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:12:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:12:54.286825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ae832-d00c-4352-8281-4bb92335f69d None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:54.287251 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ae832-d00c-4352-8281-4bb92335f69d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:54.287350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44ae832-d00c-4352-8281-4bb92335f69d None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:54.288714 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 644/1315] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:12:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:12:54.293942 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0668-00a8-407d-872f-15a1fc2c6dc0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:54.294393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0668-00a8-407d-872f-15a1fc2c6dc0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:54.294500 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24dd0668-00a8-407d-872f-15a1fc2c6dc0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:54.358489 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-24dd0668-00a8-407d-872f-15a1fc2c6dc0 None None] MFA Rules not processed for user `b5af8a8fa8504036930130dd8858a838`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:54.359676 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-24dd0668-00a8-407d-872f-15a1fc2c6dc0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:54.410611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:54.454859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 672/1316] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:12:54 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 162 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:54.493544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ae832-d00c-4352-8281-4bb92335f69d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:54.495077 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b44ae832-d00c-4352-8281-4bb92335f69d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:54.505055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:54.598253 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44ae832-d00c-4352-8281-4bb92335f69d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:54.671151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a135194-9b69-4c3d-bcf8-a509acc3acb1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:54.671733 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a135194-9b69-4c3d-bcf8-a509acc3acb1 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:54.672013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a135194-9b69-4c3d-bcf8-a509acc3acb1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:54.672285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a135194-9b69-4c3d-bcf8-a509acc3acb1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:54.674063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8a135194-9b69-4c3d-bcf8-a509acc3acb1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:54.740131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:54.787510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a135194-9b69-4c3d-bcf8-a509acc3acb1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:54.788953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a135194-9b69-4c3d-bcf8-a509acc3acb1 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:54.807421 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 645/1317] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:12:54 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 314 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:12:57.619787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b8ad9-2db5-4890-93ff-221d68971409 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:57.620206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b8ad9-2db5-4890-93ff-221d68971409 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:57.620347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e3b8ad9-2db5-4890-93ff-221d68971409 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:57.621783 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 673/1318] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:12:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:12:57.626980 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab74f2-cd55-4679-bb83-1c6a3e70c158 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:57.627384 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab74f2-cd55-4679-bb83-1c6a3e70c158 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:57.627566 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78ab74f2-cd55-4679-bb83-1c6a3e70c158 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:57.690533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-78ab74f2-cd55-4679-bb83-1c6a3e70c158 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:12:57.692216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-78ab74f2-cd55-4679-bb83-1c6a3e70c158 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:57.785195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 646/1319] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:12:57 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:12:57.823961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b8ad9-2db5-4890-93ff-221d68971409 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:12:57.825523 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9e3b8ad9-2db5-4890-93ff-221d68971409 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:57.927129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e3b8ad9-2db5-4890-93ff-221d68971409 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:12:57.998734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8e8a809-5250-46f6-a1f2-c9be147d459a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:12:57.999367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8a809-5250-46f6-a1f2-c9be147d459a service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:12:57.999648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8a809-5250-46f6-a1f2-c9be147d459a service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:12:57.999940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8e8a809-5250-46f6-a1f2-c9be147d459a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:12:58.001554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d8e8a809-5250-46f6-a1f2-c9be147d459a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:12:58.009258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:12:58.107460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8a809-5250-46f6-a1f2-c9be147d459a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:12:58.108911 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8e8a809-5250-46f6-a1f2-c9be147d459a service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:12:58.126715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 674/1320] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:12:57 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 303 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:00.927663 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a5cc6-18e5-490c-b8f0-0920fa2c4f7b None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:00.928206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a5cc6-18e5-490c-b8f0-0920fa2c4f7b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:00.928206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd8a5cc6-18e5-490c-b8f0-0920fa2c4f7b None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:00.929740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 647/1321] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:00.934747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56051d9d-cc4b-4cd2-a3ce-575f7ab9bd79 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:00.935191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56051d9d-cc4b-4cd2-a3ce-575f7ab9bd79 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:00.935314 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56051d9d-cc4b-4cd2-a3ce-575f7ab9bd79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:01.002940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-56051d9d-cc4b-4cd2-a3ce-575f7ab9bd79 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:01.004150 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-56051d9d-cc4b-4cd2-a3ce-575f7ab9bd79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:01.061546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:01.102026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 675/1322] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:01.137386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a5cc6-18e5-490c-b8f0-0920fa2c4f7b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:01.138937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cd8a5cc6-18e5-490c-b8f0-0920fa2c4f7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:01.158690 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:01.245171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd8a5cc6-18e5-490c-b8f0-0920fa2c4f7b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:01.317368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd5589d-23af-4938-852b-70cae83c99e1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:01.318014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5589d-23af-4938-852b-70cae83c99e1 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:01.318297 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5589d-23af-4938-852b-70cae83c99e1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:01.318609 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd5589d-23af-4938-852b-70cae83c99e1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:01.320261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3fd5589d-23af-4938-852b-70cae83c99e1 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:01.389926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:01.428297 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5589d-23af-4938-852b-70cae83c99e1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:01.429767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd5589d-23af-4938-852b-70cae83c99e1 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:01.448772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 648/1323] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:03.685700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ebcbe-4898-41f2-8eff-45db7816bb32 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:03.686231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ebcbe-4898-41f2-8eff-45db7816bb32 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:03.686231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e8ebcbe-4898-41f2-8eff-45db7816bb32 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:03.687622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 676/1324] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:03.693272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceb914-e744-481a-a085-46a08acb9446 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:03.693656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceb914-e744-481a-a085-46a08acb9446 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:03.693828 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ceb914-e744-481a-a085-46a08acb9446 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:03.757735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e5ceb914-e744-481a-a085-46a08acb9446 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:03.758922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e5ceb914-e744-481a-a085-46a08acb9446 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:03.855927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 649/1325] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:03.890603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ebcbe-4898-41f2-8eff-45db7816bb32 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:03.892141 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4e8ebcbe-4898-41f2-8eff-45db7816bb32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:04.000687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e8ebcbe-4898-41f2-8eff-45db7816bb32 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:04.073146 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1573c4a3-42d0-4651-9825-cf3751316e09 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:04.073787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573c4a3-42d0-4651-9825-cf3751316e09 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:04.074072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573c4a3-42d0-4651-9825-cf3751316e09 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:04.074353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1573c4a3-42d0-4651-9825-cf3751316e09 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:04.075976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1573c4a3-42d0-4651-9825-cf3751316e09 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:04.092706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:04.189280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573c4a3-42d0-4651-9825-cf3751316e09 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:04.190711 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1573c4a3-42d0-4651-9825-cf3751316e09 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:04.209111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 677/1326] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 319 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:06.464383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6f195-168f-4d0a-aa36-a6ca4e600cf3 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:06.464900 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6f195-168f-4d0a-aa36-a6ca4e600cf3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:06.464900 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f6f195-168f-4d0a-aa36-a6ca4e600cf3 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:06.466262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 650/1327] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:06.471610 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62597e-c14b-49fc-a7a4-5426a0061b29 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:06.472029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62597e-c14b-49fc-a7a4-5426a0061b29 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:06.472179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f62597e-c14b-49fc-a7a4-5426a0061b29 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:06.539303 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4f62597e-c14b-49fc-a7a4-5426a0061b29 None None] MFA Rules not processed for user `b5af8a8fa8504036930130dd8858a838`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:06.540524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4f62597e-c14b-49fc-a7a4-5426a0061b29 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:06.604613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:06.638180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 678/1328] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:06 2022] POST /identity/v3/auth/tokens => generated 3233 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:06.690907 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67546cf1-e2c9-4b24-85f5-2ed707e43990 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:06.691666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67546cf1-e2c9-4b24-85f5-2ed707e43990 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:06.691945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67546cf1-e2c9-4b24-85f5-2ed707e43990 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:06.693348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 651/1329] 10.222.0.64 () {54 vars in 964 bytes} [Thu May 26 18:13:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:06.699665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a1016-c7ca-47ec-9b09-282c73c0417e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:06.700057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a1016-c7ca-47ec-9b09-282c73c0417e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:06.700400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53a1016-c7ca-47ec-9b09-282c73c0417e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:06.776634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e53a1016-c7ca-47ec-9b09-282c73c0417e None None] MFA Rules not processed for user `1b725c28490f4f90b5eec565cd0fb603`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:06.778410 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e53a1016-c7ca-47ec-9b09-282c73c0417e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:06.864957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 679/1330] 10.222.0.64 () {58 vars in 1061 bytes} [Thu May 26 18:13:06 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:06.874109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67546cf1-e2c9-4b24-85f5-2ed707e43990 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:06.875657 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-67546cf1-e2c9-4b24-85f5-2ed707e43990 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:06.906307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:06.981874 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67546cf1-e2c9-4b24-85f5-2ed707e43990 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:07.053645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b625e67-13ee-4575-92d4-4a67206f799a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:07.054206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b625e67-13ee-4575-92d4-4a67206f799a service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:07.054484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b625e67-13ee-4575-92d4-4a67206f799a service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:07.054757 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b625e67-13ee-4575-92d4-4a67206f799a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:07.056383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6b625e67-13ee-4575-92d4-4a67206f799a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:07.131854 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:07.164502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b625e67-13ee-4575-92d4-4a67206f799a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:07.165964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b625e67-13ee-4575-92d4-4a67206f799a service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:07.184162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 652/1331] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:06 2022] GET /identity/v3/auth/tokens => generated 3233 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:10.046433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898943a-780a-48ba-835e-e0784a894db2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:10.046975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898943a-780a-48ba-835e-e0784a894db2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:10.046975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9898943a-780a-48ba-835e-e0784a894db2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:10.049024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 680/1332] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:10 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:10.054398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8194b-b54a-4600-b029-8129b89cd925 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:10.054889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8194b-b54a-4600-b029-8129b89cd925 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:10.054983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61a8194b-b54a-4600-b029-8129b89cd925 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:10.122441 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-61a8194b-b54a-4600-b029-8129b89cd925 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:10.123660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-61a8194b-b54a-4600-b029-8129b89cd925 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:10.223601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 653/1333] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:10.259497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898943a-780a-48ba-835e-e0784a894db2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:10.261072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9898943a-780a-48ba-835e-e0784a894db2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:10.329371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:10.365751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9898943a-780a-48ba-835e-e0784a894db2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:10.439121 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98357c98-db16-43f3-861e-9b390435aa0c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:10.439653 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357c98-db16-43f3-861e-9b390435aa0c service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:10.439932 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357c98-db16-43f3-861e-9b390435aa0c service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:10.440204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98357c98-db16-43f3-861e-9b390435aa0c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:10.441886 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-98357c98-db16-43f3-861e-9b390435aa0c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:10.548829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98357c98-db16-43f3-861e-9b390435aa0c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:10.550862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98357c98-db16-43f3-861e-9b390435aa0c service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:10.560586 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:10.569833 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 681/1334] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 311 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:12.802154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810618b-e5ac-4d2a-8fd1-654f56583e05 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:12.802717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810618b-e5ac-4d2a-8fd1-654f56583e05 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:12.802717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0810618b-e5ac-4d2a-8fd1-654f56583e05 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:12.804066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 654/1335] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:12 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:12.809270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cffae3-6e6a-403c-9c39-1f6b5590bced None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:12.809651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cffae3-6e6a-403c-9c39-1f6b5590bced None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:12.809821 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55cffae3-6e6a-403c-9c39-1f6b5590bced None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:12.874353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-55cffae3-6e6a-403c-9c39-1f6b5590bced None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:12.875561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-55cffae3-6e6a-403c-9c39-1f6b5590bced None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:12.968511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 682/1336] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:13.007518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810618b-e5ac-4d2a-8fd1-654f56583e05 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:13.009054 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0810618b-e5ac-4d2a-8fd1-654f56583e05 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:13.048220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:13.109490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0810618b-e5ac-4d2a-8fd1-654f56583e05 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:13.180091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d0cda95-79fa-4c24-b9eb-d0f6755dc98d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:13.180784 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cda95-79fa-4c24-b9eb-d0f6755dc98d service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:13.181104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cda95-79fa-4c24-b9eb-d0f6755dc98d service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:13.181388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d0cda95-79fa-4c24-b9eb-d0f6755dc98d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:13.183053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1d0cda95-79fa-4c24-b9eb-d0f6755dc98d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:13.266032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:13.291991 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cda95-79fa-4c24-b9eb-d0f6755dc98d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:13.293479 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d0cda95-79fa-4c24-b9eb-d0f6755dc98d service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:13.310976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 655/1337] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:15.954128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a637aae-38c2-4432-88a3-77a6dd8d5236 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:15.954734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a637aae-38c2-4432-88a3-77a6dd8d5236 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:15.954734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a637aae-38c2-4432-88a3-77a6dd8d5236 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:15.956299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 683/1338] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:15 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:15.961676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e226e7-dbbb-43de-8407-389188ce2683 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:15.962105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e226e7-dbbb-43de-8407-389188ce2683 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:15.962218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e226e7-dbbb-43de-8407-389188ce2683 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:16.024789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-69e226e7-dbbb-43de-8407-389188ce2683 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:16.026016 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-69e226e7-dbbb-43de-8407-389188ce2683 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:16.120173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 656/1339] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:15 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:16.155379 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a637aae-38c2-4432-88a3-77a6dd8d5236 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:16.156913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1a637aae-38c2-4432-88a3-77a6dd8d5236 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:16.232174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:16.260074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a637aae-38c2-4432-88a3-77a6dd8d5236 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:16.330691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc03b97a-55df-442c-8539-6d550f551e05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:16.331872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03b97a-55df-442c-8539-6d550f551e05 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:16.332155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03b97a-55df-442c-8539-6d550f551e05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:16.332444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc03b97a-55df-442c-8539-6d550f551e05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:16.334091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dc03b97a-55df-442c-8539-6d550f551e05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:16.438916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03b97a-55df-442c-8539-6d550f551e05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:16.440821 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc03b97a-55df-442c-8539-6d550f551e05 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:16.459002 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 684/1340] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:16 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 304 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:20.662436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01ec50-4e18-4db1-8ed4-441aa194045a None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:20.662991 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01ec50-4e18-4db1-8ed4-441aa194045a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:20.662991 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f01ec50-4e18-4db1-8ed4-441aa194045a None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:20.664394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 657/1341] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:20.669820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec224e-3a99-40ca-8bf4-b635101cb85d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:20.670246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec224e-3a99-40ca-8bf4-b635101cb85d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:20.670387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ec224e-3a99-40ca-8bf4-b635101cb85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:20.676526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:20.741512 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a3ec224e-3a99-40ca-8bf4-b635101cb85d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:20.742722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a3ec224e-3a99-40ca-8bf4-b635101cb85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:20.846899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 685/1342] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:20.885469 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01ec50-4e18-4db1-8ed4-441aa194045a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:20.887642 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2f01ec50-4e18-4db1-8ed4-441aa194045a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:20.942604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:20.991159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f01ec50-4e18-4db1-8ed4-441aa194045a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:20.994734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fa2fe5-57fc-43e1-aa6f-51b769d4a310 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:20.995378 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2fe5-57fc-43e1-aa6f-51b769d4a310 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:20.995670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2fe5-57fc-43e1-aa6f-51b769d4a310 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:20.995949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fa2fe5-57fc-43e1-aa6f-51b769d4a310 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:21.005618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa2fe5-57fc-43e1-aa6f-51b769d4a310 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:21.007066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07fa2fe5-57fc-43e1-aa6f-51b769d4a310 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:21.016636 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 658/1343] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:23.773772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d25438-f2b5-4c6c-9343-9d17de218044 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.774572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d25438-f2b5-4c6c-9343-9d17de218044 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.774572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67d25438-f2b5-4c6c-9343-9d17de218044 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.776868 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 686/1344] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:23 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:23.782169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e58ca-6771-4951-a723-bb63d8954f92 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.782615 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e58ca-6771-4951-a723-bb63d8954f92 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.782752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb5e58ca-6771-4951-a723-bb63d8954f92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.811248 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-cb5e58ca-6771-4951-a723-bb63d8954f92 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:23.812425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cb5e58ca-6771-4951-a723-bb63d8954f92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:23.887874 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 659/1345] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:23 2022] POST /identity/v3/auth/tokens => generated 3228 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:23.925071 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d25438-f2b5-4c6c-9343-9d17de218044 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:23.935566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67d25438-f2b5-4c6c-9343-9d17de218044 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:23.939063 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a60eda9-d2ce-4758-a207-80c6ea0fa266 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:23.939739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60eda9-d2ce-4758-a207-80c6ea0fa266 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:23.940024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60eda9-d2ce-4758-a207-80c6ea0fa266 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:23.940304 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a60eda9-d2ce-4758-a207-80c6ea0fa266 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:23.949151 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60eda9-d2ce-4758-a207-80c6ea0fa266 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:23.950572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a60eda9-d2ce-4758-a207-80c6ea0fa266 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:23.961940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 687/1346] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:23 2022] GET /identity/v3/auth/tokens => generated 3228 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:28.042503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54832-fc3d-48d3-a235-d75ee36186e4 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:28.043048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54832-fc3d-48d3-a235-d75ee36186e4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:28.043048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef54832-fc3d-48d3-a235-d75ee36186e4 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:28.044652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 660/1347] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:28.050460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3690dd3-7654-464f-a036-a76d4d0e9cd9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:28.050842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3690dd3-7654-464f-a036-a76d4d0e9cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:28.051019 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3690dd3-7654-464f-a036-a76d4d0e9cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:28.069902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a3690dd3-7654-464f-a036-a76d4d0e9cd9 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:28.071159 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a3690dd3-7654-464f-a036-a76d4d0e9cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:28.079346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 688/1348] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:28.116209 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef54832-fc3d-48d3-a235-d75ee36186e4 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:28.126724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef54832-fc3d-48d3-a235-d75ee36186e4 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:28.130745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a39faca-81aa-41bc-80c7-ca9b753f1c86 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:28.131371 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39faca-81aa-41bc-80c7-ca9b753f1c86 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:28.131650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39faca-81aa-41bc-80c7-ca9b753f1c86 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:28.131920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a39faca-81aa-41bc-80c7-ca9b753f1c86 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:28.145673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39faca-81aa-41bc-80c7-ca9b753f1c86 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:28.147316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a39faca-81aa-41bc-80c7-ca9b753f1c86 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:28.157385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 661/1349] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:33.361347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fbf20-70ab-41e0-950d-f4d9ae6c6c74 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:33.361849 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fbf20-70ab-41e0-950d-f4d9ae6c6c74 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:33.361947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d3fbf20-70ab-41e0-950d-f4d9ae6c6c74 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:33.363411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 689/1350] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 26 18:13:33 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:33.368535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ed04-a46d-4e18-96a7-f0e49dcb8ff2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:33.369401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ed04-a46d-4e18-96a7-f0e49dcb8ff2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:33.369893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ede0ed04-a46d-4e18-96a7-f0e49dcb8ff2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:33.488214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ede0ed04-a46d-4e18-96a7-f0e49dcb8ff2 None None] MFA Rules not processed for user `1ab4efe6f79d4b3ca5618c089c5f3d24`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:33.488925 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ede0ed04-a46d-4e18-96a7-f0e49dcb8ff2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:33.519307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:33.589160 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 662/1351] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 26 18:13:33 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 222 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:38.018526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560e10d-6409-4cc4-b8e5-410c57cac8d9 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:38.019444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560e10d-6409-4cc4-b8e5-410c57cac8d9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:38.019723 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d560e10d-6409-4cc4-b8e5-410c57cac8d9 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:38.021442 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 690/1352] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 26 18:13:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:38.026465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa353e3d-6703-4505-99e6-8519ac63171b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:38.026873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa353e3d-6703-4505-99e6-8519ac63171b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:38.027104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa353e3d-6703-4505-99e6-8519ac63171b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:38.046618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fa353e3d-6703-4505-99e6-8519ac63171b None None] MFA Rules not processed for user `1ab4efe6f79d4b3ca5618c089c5f3d24`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:38.048139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fa353e3d-6703-4505-99e6-8519ac63171b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:38.056977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 663/1353] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 26 18:13:38 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:38.065358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=72 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:39.585267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c6635-649b-4a08-92b5-ae1925725dbd None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:39.585909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c6635-649b-4a08-92b5-ae1925725dbd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:39.585909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e1c6635-649b-4a08-92b5-ae1925725dbd None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:39.587156 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 691/1354] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 26 18:13:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:39.592137 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107dff7-ab5e-49ee-8f83-81622556031c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:39.592563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107dff7-ab5e-49ee-8f83-81622556031c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:39.592688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6107dff7-ab5e-49ee-8f83-81622556031c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:39.611922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6107dff7-ab5e-49ee-8f83-81622556031c None None] MFA Rules not processed for user `1ab4efe6f79d4b3ca5618c089c5f3d24`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:39.613386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6107dff7-ab5e-49ee-8f83-81622556031c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:39.621799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 664/1355] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 26 18:13:39 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:43.447464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef886e5-0346-4a76-befa-8ac9f048b596 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:43.447991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef886e5-0346-4a76-befa-8ac9f048b596 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:43.447991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef886e5-0346-4a76-befa-8ac9f048b596 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:43.449457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 692/1356] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:43.455161 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a1a0c-8ca3-4a0b-a370-a94a2f413b6b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:43.455558 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a1a0c-8ca3-4a0b-a370-a94a2f413b6b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:43.455779 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5a1a0c-8ca3-4a0b-a370-a94a2f413b6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:43.473362 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ba5a1a0c-8ca3-4a0b-a370-a94a2f413b6b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:43.474527 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ba5a1a0c-8ca3-4a0b-a370-a94a2f413b6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:43.482621 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 665/1357] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:43.536848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db37da-ce48-4e17-b6f5-d70db2c85fd7 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:43.537718 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db37da-ce48-4e17-b6f5-d70db2c85fd7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:43.538211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5db37da-ce48-4e17-b6f5-d70db2c85fd7 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:43.540238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 693/1358] 10.222.0.64 () {54 vars in 961 bytes} [Thu May 26 18:13:43 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:43.547137 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff230-b9d3-4f5a-8e20-7365250143e7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:43.548533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff230-b9d3-4f5a-8e20-7365250143e7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:43.549519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91cff230-b9d3-4f5a-8e20-7365250143e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:43.613647 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-91cff230-b9d3-4f5a-8e20-7365250143e7 None None] MFA Rules not processed for user `97f259ac2eb4425f8b4dcffeccdcd439`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:43.615315 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-91cff230-b9d3-4f5a-8e20-7365250143e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:43.714099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 666/1359] 10.222.0.64 () {58 vars in 1058 bytes} [Thu May 26 18:13:43 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:43.721774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db37da-ce48-4e17-b6f5-d70db2c85fd7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:43.738865 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5db37da-ce48-4e17-b6f5-d70db2c85fd7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:43.744807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d56a146-f2e9-4abd-a4d2-94984effec0a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:43.745807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a146-f2e9-4abd-a4d2-94984effec0a service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:43.746301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a146-f2e9-4abd-a4d2-94984effec0a service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:43.746829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d56a146-f2e9-4abd-a4d2-94984effec0a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:43.756945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56a146-f2e9-4abd-a4d2-94984effec0a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:43.759131 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d56a146-f2e9-4abd-a4d2-94984effec0a service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:43.769767 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 694/1360] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:46.195743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40362de3-8a14-43d8-93a2-ef82c74ce7c0 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:46.196237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40362de3-8a14-43d8-93a2-ef82c74ce7c0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:46.196237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40362de3-8a14-43d8-93a2-ef82c74ce7c0 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:46.197782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 667/1361] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:46 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:46.202666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397560a0-b0a2-4fde-940b-97f66d3068d2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:46.203477 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397560a0-b0a2-4fde-940b-97f66d3068d2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:46.203759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397560a0-b0a2-4fde-940b-97f66d3068d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:46.221694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-397560a0-b0a2-4fde-940b-97f66d3068d2 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:46.222869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-397560a0-b0a2-4fde-940b-97f66d3068d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:46.230864 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 695/1362] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:46.275631 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40362de3-8a14-43d8-93a2-ef82c74ce7c0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:46.292203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40362de3-8a14-43d8-93a2-ef82c74ce7c0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:46.298429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-629bc30a-982c-4d25-9444-b9618dbad767 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:46.299157 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bc30a-982c-4d25-9444-b9618dbad767 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:46.299503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bc30a-982c-4d25-9444-b9618dbad767 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:46.299844 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-629bc30a-982c-4d25-9444-b9618dbad767 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:46.308341 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bc30a-982c-4d25-9444-b9618dbad767 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:46.310037 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-629bc30a-982c-4d25-9444-b9618dbad767 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:46.319517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 668/1363] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:48.829046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547fca2-853c-4873-b41e-bcf97efc7c1f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:48.829557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547fca2-853c-4873-b41e-bcf97efc7c1f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:48.829654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8547fca2-853c-4873-b41e-bcf97efc7c1f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:48.830980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 696/1364] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:48.836484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161e45-df6f-4a81-aba5-e1032f7de13b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:48.836946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161e45-df6f-4a81-aba5-e1032f7de13b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:48.837158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82161e45-df6f-4a81-aba5-e1032f7de13b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:48.855976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-82161e45-df6f-4a81-aba5-e1032f7de13b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:48.857194 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-82161e45-df6f-4a81-aba5-e1032f7de13b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:48.865039 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 669/1365] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:48.920289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54567c46-d1ef-4f6e-8c8d-f7193fcdb3e6 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:48.920584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54567c46-d1ef-4f6e-8c8d-f7193fcdb3e6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:48.921209 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54567c46-d1ef-4f6e-8c8d-f7193fcdb3e6 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:48.923458 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 697/1366] 10.222.0.64 () {54 vars in 961 bytes} [Thu May 26 18:13:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:48.929521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbf9ec-c78c-4f31-b05f-841964c9c998 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:48.929815 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbf9ec-c78c-4f31-b05f-841964c9c998 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:48.930093 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3fbf9ec-c78c-4f31-b05f-841964c9c998 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:48.948158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b3fbf9ec-c78c-4f31-b05f-841964c9c998 None None] MFA Rules not processed for user `97f259ac2eb4425f8b4dcffeccdcd439`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:48.949474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b3fbf9ec-c78c-4f31-b05f-841964c9c998 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:48.959967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 670/1367] 10.222.0.64 () {58 vars in 1058 bytes} [Thu May 26 18:13:48 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:48.967827 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54567c46-d1ef-4f6e-8c8d-f7193fcdb3e6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:48.982890 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54567c46-d1ef-4f6e-8c8d-f7193fcdb3e6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:48.988386 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b89764c-e0e1-4881-b6ac-37e2f703d448 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:48.989033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89764c-e0e1-4881-b6ac-37e2f703d448 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:48.989316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89764c-e0e1-4881-b6ac-37e2f703d448 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:48.989587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b89764c-e0e1-4881-b6ac-37e2f703d448 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:48.997566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89764c-e0e1-4881-b6ac-37e2f703d448 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:48.999121 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b89764c-e0e1-4881-b6ac-37e2f703d448 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:49.008629 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 698/1368] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:51.297518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76504-6d89-493f-81be-3803cf63ccac None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:51.298042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76504-6d89-493f-81be-3803cf63ccac None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:51.298157 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df76504-6d89-493f-81be-3803cf63ccac None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:51.299632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 671/1369] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:51.304800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f22879-fa92-459d-ad41-5fd63783d8e0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:51.305250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f22879-fa92-459d-ad41-5fd63783d8e0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:51.305391 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f22879-fa92-459d-ad41-5fd63783d8e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:51.323274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-90f22879-fa92-459d-ad41-5fd63783d8e0 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:51.324382 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-90f22879-fa92-459d-ad41-5fd63783d8e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:51.332937 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 699/1370] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:51.377502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df76504-6d89-493f-81be-3803cf63ccac None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:51.395137 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0df76504-6d89-493f-81be-3803cf63ccac None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:51.402351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5345893-5fc9-4476-a18e-c4c9d86d135d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:51.403131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5345893-5fc9-4476-a18e-c4c9d86d135d service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:51.403479 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5345893-5fc9-4476-a18e-c4c9d86d135d service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:51.403822 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5345893-5fc9-4476-a18e-c4c9d86d135d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:51.415630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5345893-5fc9-4476-a18e-c4c9d86d135d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:51.418155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5345893-5fc9-4476-a18e-c4c9d86d135d service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:51.428524 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 672/1371] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:51.571644 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444d173-4678-4b12-bb52-1918b8178638 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:51.572190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444d173-4678-4b12-bb52-1918b8178638 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:51.572623 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b444d173-4678-4b12-bb52-1918b8178638 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:51.574653 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 700/1372] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:51 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:51.581217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3040a-89ca-4bdf-a6cc-eebca0b84883 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:51.581554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3040a-89ca-4bdf-a6cc-eebca0b84883 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:51.581783 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb3040a-89ca-4bdf-a6cc-eebca0b84883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:51.602275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-1fb3040a-89ca-4bdf-a6cc-eebca0b84883 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:51.603783 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1fb3040a-89ca-4bdf-a6cc-eebca0b84883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:51.612122 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 673/1373] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:51.925965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c551-7914-4092-a9f0-b07bec55fb39 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:51.925965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c551-7914-4092-a9f0-b07bec55fb39 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:51.925965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42a9c551-7914-4092-a9f0-b07bec55fb39 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:51.929233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 701/1374] 10.222.0.64 () {54 vars in 963 bytes} [Thu May 26 18:13:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:51.932961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300aa13-dd72-4aea-9cef-05e3dbcf3a2c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:51.933284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300aa13-dd72-4aea-9cef-05e3dbcf3a2c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:51.933561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d300aa13-dd72-4aea-9cef-05e3dbcf3a2c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:51.940117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:13:51.986756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d300aa13-dd72-4aea-9cef-05e3dbcf3a2c None None] MFA Rules not processed for user `0c09ffb276b84b2aa8735d6907a0de73`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:51.987942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d300aa13-dd72-4aea-9cef-05e3dbcf3a2c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:52.052201 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 674/1375] 10.222.0.64 () {58 vars in 1060 bytes} [Thu May 26 18:13:51 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:52.060100 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9c551-7914-4092-a9f0-b07bec55fb39 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:52.071301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42a9c551-7914-4092-a9f0-b07bec55fb39 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:52.075383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2b5be83-343f-445b-9d58-a027818519e8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:52.076122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5be83-343f-445b-9d58-a027818519e8 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:52.076476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5be83-343f-445b-9d58-a027818519e8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:52.076821 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2b5be83-343f-445b-9d58-a027818519e8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:52.087118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5be83-343f-445b-9d58-a027818519e8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:52.088614 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2b5be83-343f-445b-9d58-a027818519e8 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:52.099225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 702/1376] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:53.703662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ace183-b9a4-4334-94cb-3d1c81c28880 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:53.704220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ace183-b9a4-4334-94cb-3d1c81c28880 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:53.704220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51ace183-b9a4-4334-94cb-3d1c81c28880 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:53.705634 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 675/1377] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:53.711374 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd2d65-71b9-42c1-a62c-5eb914bcd614 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:53.711873 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd2d65-71b9-42c1-a62c-5eb914bcd614 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:53.712043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedd2d65-71b9-42c1-a62c-5eb914bcd614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:53.731136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-dedd2d65-71b9-42c1-a62c-5eb914bcd614 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:53.732287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dedd2d65-71b9-42c1-a62c-5eb914bcd614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:53.740385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 703/1378] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:53.786686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ace183-b9a4-4334-94cb-3d1c81c28880 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:53.801690 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51ace183-b9a4-4334-94cb-3d1c81c28880 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:53.807332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcac40d3-dfcd-458b-9de0-990400b3095d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:53.808002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac40d3-dfcd-458b-9de0-990400b3095d service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:53.808286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac40d3-dfcd-458b-9de0-990400b3095d service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:53.808566 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcac40d3-dfcd-458b-9de0-990400b3095d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:53.818498 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac40d3-dfcd-458b-9de0-990400b3095d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:53.820165 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcac40d3-dfcd-458b-9de0-990400b3095d service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:53.831501 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 676/1379] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:53 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:13:56.060252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a4638-a356-4f70-9453-1b917dce26c6 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:56.060869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a4638-a356-4f70-9453-1b917dce26c6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:56.060869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-560a4638-a356-4f70-9453-1b917dce26c6 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:56.064482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 704/1380] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:56 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:56.067498 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc75e5-e7a6-4a4f-b27b-c5ac50cb77e7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:56.067942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc75e5-e7a6-4a4f-b27b-c5ac50cb77e7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:56.068046 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21fc75e5-e7a6-4a4f-b27b-c5ac50cb77e7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:56.087007 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-21fc75e5-e7a6-4a4f-b27b-c5ac50cb77e7 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:56.088199 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-21fc75e5-e7a6-4a4f-b27b-c5ac50cb77e7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:56.096775 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 677/1381] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:13:56.140767 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a4638-a356-4f70-9453-1b917dce26c6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:56.157677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-560a4638-a356-4f70-9453-1b917dce26c6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:56.163445 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf6d9e1-846b-4c0d-b38e-9702a99ba9c4 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:56.164309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6d9e1-846b-4c0d-b38e-9702a99ba9c4 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:56.164759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6d9e1-846b-4c0d-b38e-9702a99ba9c4 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:56.165251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf6d9e1-846b-4c0d-b38e-9702a99ba9c4 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:56.175301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6d9e1-846b-4c0d-b38e-9702a99ba9c4 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:56.176955 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf6d9e1-846b-4c0d-b38e-9702a99ba9c4 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:56.187849 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 705/1382] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:13:58.398891 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261ac6b-1a8b-455c-a44d-8e4bdf8646b3 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:58.399446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261ac6b-1a8b-455c-a44d-8e4bdf8646b3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:58.399446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5261ac6b-1a8b-455c-a44d-8e4bdf8646b3 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:58.400785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 678/1383] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:13:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:13:58.406215 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd491e8-70c0-4412-81d3-ea4643f69342 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:58.406665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd491e8-70c0-4412-81d3-ea4643f69342 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:58.406767 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd491e8-70c0-4412-81d3-ea4643f69342 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:58.424077 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9fd491e8-70c0-4412-81d3-ea4643f69342 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:13:58.425276 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9fd491e8-70c0-4412-81d3-ea4643f69342 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:13:58.433098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 706/1384] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:13:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:13:58.474728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261ac6b-1a8b-455c-a44d-8e4bdf8646b3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:13:58.489349 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5261ac6b-1a8b-455c-a44d-8e4bdf8646b3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:13:58.494771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b71dece-df47-41b9-b19e-0b0427f24379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:13:58.495399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71dece-df47-41b9-b19e-0b0427f24379 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:13:58.495678 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71dece-df47-41b9-b19e-0b0427f24379 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:13:58.495951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b71dece-df47-41b9-b19e-0b0427f24379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:13:58.504722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71dece-df47-41b9-b19e-0b0427f24379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:13:58.506322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b71dece-df47-41b9-b19e-0b0427f24379 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:13:58.516546 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 679/1385] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:13:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:00.968973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de531-5f73-4bcf-b758-9627d197a3f2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:00.969557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de531-5f73-4bcf-b758-9627d197a3f2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:00.969653 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a3de531-5f73-4bcf-b758-9627d197a3f2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:00.970980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 707/1386] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:14:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:00.977251 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cc285-ad91-4aec-a6d0-447bafd6c239 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:00.977689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cc285-ad91-4aec-a6d0-447bafd6c239 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:00.977809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d38cc285-ad91-4aec-a6d0-447bafd6c239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:00.996208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d38cc285-ad91-4aec-a6d0-447bafd6c239 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:00.997446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d38cc285-ad91-4aec-a6d0-447bafd6c239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:01.006143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 680/1387] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:14:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:01.049521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3de531-5f73-4bcf-b758-9627d197a3f2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:01.065003 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a3de531-5f73-4bcf-b758-9627d197a3f2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:01.071495 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38642517-a3b0-4139-a6f2-4e5e963079e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:01.072145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38642517-a3b0-4139-a6f2-4e5e963079e8 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:01.072432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38642517-a3b0-4139-a6f2-4e5e963079e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:01.072713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38642517-a3b0-4139-a6f2-4e5e963079e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:01.081402 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38642517-a3b0-4139-a6f2-4e5e963079e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:01.082992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38642517-a3b0-4139-a6f2-4e5e963079e8 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:01.092511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 708/1388] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:03.346554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c96b68-0768-4ce1-a4e8-77241944511f None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:03.347060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c96b68-0768-4ce1-a4e8-77241944511f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:03.347219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c96b68-0768-4ce1-a4e8-77241944511f None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:03.349187 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 681/1389] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:14:03 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:03.354421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30f18-3055-4e3e-81a1-eef077cc718a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:03.354823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30f18-3055-4e3e-81a1-eef077cc718a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:03.354981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2b30f18-3055-4e3e-81a1-eef077cc718a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:03.375262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d2b30f18-3055-4e3e-81a1-eef077cc718a None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:03.377386 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d2b30f18-3055-4e3e-81a1-eef077cc718a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:03.387379 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 709/1390] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:14:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:03.432130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c96b68-0768-4ce1-a4e8-77241944511f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:03.446884 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c96b68-0768-4ce1-a4e8-77241944511f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:03.452462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e923aa77-3e1e-46af-bcc6-35c4d0ea00e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:03.453171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923aa77-3e1e-46af-bcc6-35c4d0ea00e8 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:03.453467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923aa77-3e1e-46af-bcc6-35c4d0ea00e8 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:03.453825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e923aa77-3e1e-46af-bcc6-35c4d0ea00e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:03.462958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923aa77-3e1e-46af-bcc6-35c4d0ea00e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:03.465177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e923aa77-3e1e-46af-bcc6-35c4d0ea00e8 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:03.478076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 682/1391] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:06.339221 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101adf0-e5ff-4ce1-9731-4fb4b0e86576 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:06.339802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101adf0-e5ff-4ce1-9731-4fb4b0e86576 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:06.339802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4101adf0-e5ff-4ce1-9731-4fb4b0e86576 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:06.341201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 710/1392] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:14:06 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:06.346974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a21a0a-dd16-4d80-871b-d73ef36bc0e4 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:06.347392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a21a0a-dd16-4d80-871b-d73ef36bc0e4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:06.347543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a21a0a-dd16-4d80-871b-d73ef36bc0e4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:06.365197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a6a21a0a-dd16-4d80-871b-d73ef36bc0e4 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:06.366386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a6a21a0a-dd16-4d80-871b-d73ef36bc0e4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:06.374119 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 683/1393] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:14:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:06.419042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101adf0-e5ff-4ce1-9731-4fb4b0e86576 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:06.433245 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4101adf0-e5ff-4ce1-9731-4fb4b0e86576 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:06.439199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24f1e433-977f-4c53-8ea0-24223594199c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:06.439835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1e433-977f-4c53-8ea0-24223594199c service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:06.440122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1e433-977f-4c53-8ea0-24223594199c service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:06.440404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24f1e433-977f-4c53-8ea0-24223594199c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:06.448488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1e433-977f-4c53-8ea0-24223594199c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:06.450151 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24f1e433-977f-4c53-8ea0-24223594199c service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:06.460279 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 711/1394] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:06 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:08.305637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413148f3-01d4-4ed3-81d7-c1b291b3ff27 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:08.306205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413148f3-01d4-4ed3-81d7-c1b291b3ff27 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:08.306205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-413148f3-01d4-4ed3-81d7-c1b291b3ff27 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:08.307567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 684/1395] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:08.313532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12f54b-6acc-43cc-9242-3077edd4675a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:08.313989 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12f54b-6acc-43cc-9242-3077edd4675a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:08.314091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a12f54b-6acc-43cc-9242-3077edd4675a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:08.320028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=52 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:08.332491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2a12f54b-6acc-43cc-9242-3077edd4675a None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:08.333743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2a12f54b-6acc-43cc-9242-3077edd4675a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:08.341574 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 712/1396] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:08.397198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e444172-a093-4a04-8f68-f86d0e3b9b7f None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:08.397503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e444172-a093-4a04-8f68-f86d0e3b9b7f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:08.397855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e444172-a093-4a04-8f68-f86d0e3b9b7f None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:08.399298 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 685/1397] 10.222.0.64 () {54 vars in 962 bytes} [Thu May 26 18:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:08.404391 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38450c75-a11c-493d-802a-3e893fa1f789 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:08.405375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38450c75-a11c-493d-802a-3e893fa1f789 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:08.405663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38450c75-a11c-493d-802a-3e893fa1f789 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:08.453157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-38450c75-a11c-493d-802a-3e893fa1f789 None None] MFA Rules not processed for user `a2fbb5beba8a45a5b0a9b0beba0e0d63`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:08.454375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-38450c75-a11c-493d-802a-3e893fa1f789 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:08.516277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 713/1398] 10.222.0.64 () {58 vars in 1059 bytes} [Thu May 26 18:14:08 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:14:08.524699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e444172-a093-4a04-8f68-f86d0e3b9b7f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:08.535991 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e444172-a093-4a04-8f68-f86d0e3b9b7f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:08.539693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1df44b1-78c3-4611-9369-440f244095dd service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbb5beba8a45a5b0a9b0beba0e0d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:08.540355 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df44b1-78c3-4611-9369-440f244095dd service glance] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:08.540636 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df44b1-78c3-4611-9369-440f244095dd service glance] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:08.540909 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1df44b1-78c3-4611-9369-440f244095dd service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:08.551145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df44b1-78c3-4611-9369-440f244095dd service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:08.552584 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1df44b1-78c3-4611-9369-440f244095dd service glance] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:08.562772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 686/1399] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:08.709732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcada7b-4c77-428c-994b-9a3618f98b9a None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:08.710018 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcada7b-4c77-428c-994b-9a3618f98b9a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:08.710295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdcada7b-4c77-428c-994b-9a3618f98b9a None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:08.711706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 714/1400] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:14:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:08.716953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cc67b-0ff4-4bb9-99ba-03e7bd13bd7c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:08.717796 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cc67b-0ff4-4bb9-99ba-03e7bd13bd7c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:08.718081 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e80cc67b-0ff4-4bb9-99ba-03e7bd13bd7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:08.736317 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e80cc67b-0ff4-4bb9-99ba-03e7bd13bd7c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:08.737549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e80cc67b-0ff4-4bb9-99ba-03e7bd13bd7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:08.745376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 687/1401] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:14:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:08.791564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcada7b-4c77-428c-994b-9a3618f98b9a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:08.808534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdcada7b-4c77-428c-994b-9a3618f98b9a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:08.814667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e6332-3aa0-4769-a431-c96d2fc2810d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:08.815393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e6332-3aa0-4769-a431-c96d2fc2810d service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:08.815753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e6332-3aa0-4769-a431-c96d2fc2810d service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:08.816104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e6332-3aa0-4769-a431-c96d2fc2810d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:08.825508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e6332-3aa0-4769-a431-c96d2fc2810d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:08.827249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e6332-3aa0-4769-a431-c96d2fc2810d service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:08.837494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 715/1402] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:09.110785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5a5a7-70fc-4255-a9e1-d9c7762fa051 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:09.111074 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5a5a7-70fc-4255-a9e1-d9c7762fa051 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:09.111355 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f5a5a7-70fc-4255-a9e1-d9c7762fa051 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:09.160055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-72f5a5a7-70fc-4255-a9e1-d9c7762fa051 None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:09.161291 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-72f5a5a7-70fc-4255-a9e1-d9c7762fa051 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:09.198156 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:09.233722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 688/1403] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:14:09 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:14:09.274709 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae97931-cb69-4157-a897-88c0101ac7f2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:09.275069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae97931-cb69-4157-a897-88c0101ac7f2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:09.275414 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dae97931-cb69-4157-a897-88c0101ac7f2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:09.276864 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 716/1404] 10.222.0.64 () {54 vars in 942 bytes} [Thu May 26 18:14:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:09.283109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c5bd0-427d-4097-b068-5dcc5f291fd6 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:09.283403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c5bd0-427d-4097-b068-5dcc5f291fd6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:09.283684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409c5bd0-427d-4097-b068-5dcc5f291fd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:09.331474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-409c5bd0-427d-4097-b068-5dcc5f291fd6 None None] MFA Rules not processed for user `9cb21a6eef0e418182b2dd755096ca77`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:09.332662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-409c5bd0-427d-4097-b068-5dcc5f291fd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:09.408075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 689/1405] 10.222.0.64 () {58 vars in 1039 bytes} [Thu May 26 18:14:09 2022] POST /identity/v3/auth/tokens => generated 3294 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:09.417289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae97931-cb69-4157-a897-88c0101ac7f2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:09.430877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dae97931-cb69-4157-a897-88c0101ac7f2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:09.435716 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4592acd6-d2b2-4b1c-859e-ff3837271987 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:09.436942 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592acd6-d2b2-4b1c-859e-ff3837271987 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:09.437251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592acd6-d2b2-4b1c-859e-ff3837271987 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:09.437527 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4592acd6-d2b2-4b1c-859e-ff3837271987 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:09.445454 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592acd6-d2b2-4b1c-859e-ff3837271987 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:09.447015 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4592acd6-d2b2-4b1c-859e-ff3837271987 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:09.454909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 717/1406] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:14:09 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:14:11.098589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eb2e5-4b24-4df3-91f0-1dee64623fc2 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:11.099150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eb2e5-4b24-4df3-91f0-1dee64623fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:11.099150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-851eb2e5-4b24-4df3-91f0-1dee64623fc2 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:11.100778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 690/1407] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:14:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:11.106099 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e03859-31d8-4bb2-965f-6efffe0a1b32 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:11.106534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e03859-31d8-4bb2-965f-6efffe0a1b32 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:11.106688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15e03859-31d8-4bb2-965f-6efffe0a1b32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:11.126197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-15e03859-31d8-4bb2-965f-6efffe0a1b32 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:11.127406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-15e03859-31d8-4bb2-965f-6efffe0a1b32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:11.136202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 718/1408] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:14:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:11.183893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851eb2e5-4b24-4df3-91f0-1dee64623fc2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:11.203258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-851eb2e5-4b24-4df3-91f0-1dee64623fc2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:11.208740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29ed917a-7f97-4a67-a8b4-b7cbaead1e54 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:11.209602 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed917a-7f97-4a67-a8b4-b7cbaead1e54 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:11.209960 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed917a-7f97-4a67-a8b4-b7cbaead1e54 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:11.210305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29ed917a-7f97-4a67-a8b4-b7cbaead1e54 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:11.220150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed917a-7f97-4a67-a8b4-b7cbaead1e54 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:11.222031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29ed917a-7f97-4a67-a8b4-b7cbaead1e54 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:11.233200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 691/1409] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:21.120332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=55 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:21.227775 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=62 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:14:32.658868 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34783-ba24-4c72-a550-6e58cacca7a1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:32.659496 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34783-ba24-4c72-a550-6e58cacca7a1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:32.659496 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e34783-ba24-4c72-a550-6e58cacca7a1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:32.660828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 719/1410] 10.222.0.64 () {54 vars in 918 bytes} [Thu May 26 18:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:32.665969 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aef99-c352-4008-aeb6-f84864735b48 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:32.666494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aef99-c352-4008-aeb6-f84864735b48 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:32.666494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-290aef99-c352-4008-aeb6-f84864735b48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:32.684396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-290aef99-c352-4008-aeb6-f84864735b48 None None] MFA Rules not processed for user `1ab4efe6f79d4b3ca5618c089c5f3d24`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:32.685603 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-290aef99-c352-4008-aeb6-f84864735b48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:32.693799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 692/1411] 10.222.0.64 () {58 vars in 1015 bytes} [Thu May 26 18:14:32 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:32.708294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840654e0-fb32-45aa-8816-8dce277def6f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:32.708584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840654e0-fb32-45aa-8816-8dce277def6f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:32.708861 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-840654e0-fb32-45aa-8816-8dce277def6f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:32.710255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 720/1412] 10.222.0.64 () {54 vars in 918 bytes} [Thu May 26 18:14:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:32.714821 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d64f14-758d-4082-bce0-74b08eac9514 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:32.715138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d64f14-758d-4082-bce0-74b08eac9514 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:32.715413 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d64f14-758d-4082-bce0-74b08eac9514 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:32.732842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-56d64f14-758d-4082-bce0-74b08eac9514 None None] MFA Rules not processed for user `97f259ac2eb4425f8b4dcffeccdcd439`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:32.734041 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-56d64f14-758d-4082-bce0-74b08eac9514 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:32.742802 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 693/1413] 10.222.0.64 () {58 vars in 1015 bytes} [Thu May 26 18:14:32 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:14:35.408460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3fccb-9171-48f5-822e-621ba15d4108 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:35.409071 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3fccb-9171-48f5-822e-621ba15d4108 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:35.409071 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc3fccb-9171-48f5-822e-621ba15d4108 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:35.410416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 721/1414] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:14:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:35.415891 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f1cb-eec7-420a-82d4-6340f0749fdb None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:35.416323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f1cb-eec7-420a-82d4-6340f0749fdb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:35.416490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e72f1cb-eec7-420a-82d4-6340f0749fdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:35.435531 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-1e72f1cb-eec7-420a-82d4-6340f0749fdb None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:35.436731 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1e72f1cb-eec7-420a-82d4-6340f0749fdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:35.444472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 694/1415] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:14:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:35.487162 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3fccb-9171-48f5-822e-621ba15d4108 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:35.502132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc3fccb-9171-48f5-822e-621ba15d4108 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:35.507466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d467c8d2-2764-4f23-be25-f777a22c3e3d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:35.508104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467c8d2-2764-4f23-be25-f777a22c3e3d service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:35.508390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467c8d2-2764-4f23-be25-f777a22c3e3d service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:35.508667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d467c8d2-2764-4f23-be25-f777a22c3e3d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:35.517231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467c8d2-2764-4f23-be25-f777a22c3e3d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:35.518809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d467c8d2-2764-4f23-be25-f777a22c3e3d service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:35.528021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 722/1416] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:36.489799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0980fa5-83fa-45e6-8123-865356c58288 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:36.490334 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0980fa5-83fa-45e6-8123-865356c58288 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:36.490334 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0980fa5-83fa-45e6-8123-865356c58288 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:36.491641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 695/1417] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:14:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:36.496520 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec9701-8736-49ca-83a2-2fec8b12dc92 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:36.496910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec9701-8736-49ca-83a2-2fec8b12dc92 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:36.497141 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5ec9701-8736-49ca-83a2-2fec8b12dc92 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:36.515239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a5ec9701-8736-49ca-83a2-2fec8b12dc92 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:36.516416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a5ec9701-8736-49ca-83a2-2fec8b12dc92 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:36.524065 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 723/1418] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:14:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:36.682954 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0980fa5-83fa-45e6-8123-865356c58288 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:36.696788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0980fa5-83fa-45e6-8123-865356c58288 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:36.704848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844c8079-d5d7-4dea-8235-f2a02e691660 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:36.705519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c8079-d5d7-4dea-8235-f2a02e691660 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:36.705794 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c8079-d5d7-4dea-8235-f2a02e691660 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:36.706069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844c8079-d5d7-4dea-8235-f2a02e691660 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:36.715648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c8079-d5d7-4dea-8235-f2a02e691660 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:36.717256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844c8079-d5d7-4dea-8235-f2a02e691660 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:36.729231 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 696/1419] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:37.665424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f566f-0f10-411c-8e5e-a9ee0ddc83ca None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:37.665987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f566f-0f10-411c-8e5e-a9ee0ddc83ca None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:37.665987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-277f566f-0f10-411c-8e5e-a9ee0ddc83ca None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:37.667355 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 724/1420] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:14:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:37.672893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de18ae-21ef-4bf4-a7c5-f9156d8647d7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:37.673308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de18ae-21ef-4bf4-a7c5-f9156d8647d7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:37.673477 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59de18ae-21ef-4bf4-a7c5-f9156d8647d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:37.691644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-59de18ae-21ef-4bf4-a7c5-f9156d8647d7 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:37.692827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-59de18ae-21ef-4bf4-a7c5-f9156d8647d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:37.700357 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 697/1421] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:14:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:37.848506 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f566f-0f10-411c-8e5e-a9ee0ddc83ca None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:37.863410 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-277f566f-0f10-411c-8e5e-a9ee0ddc83ca None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:37.868679 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b5b0f0-a3d2-41d5-b9f0-cc6be42a9df8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:37.869351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5b0f0-a3d2-41d5-b9f0-cc6be42a9df8 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:37.869636 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5b0f0-a3d2-41d5-b9f0-cc6be42a9df8 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:37.869913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b5b0f0-a3d2-41d5-b9f0-cc6be42a9df8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:37.877859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5b0f0-a3d2-41d5-b9f0-cc6be42a9df8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:37.879434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83b5b0f0-a3d2-41d5-b9f0-cc6be42a9df8 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:37.888677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 725/1422] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:38.790897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea438a-74ef-49c3-b629-17b43800a66e None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:38.791468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea438a-74ef-49c3-b629-17b43800a66e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:38.791468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ea438a-74ef-49c3-b629-17b43800a66e None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:38.793429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 698/1423] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:14:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:14:38.798549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a8e43-89e1-4724-a498-b1bedb967efa None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:38.798993 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a8e43-89e1-4724-a498-b1bedb967efa None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:38.799107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-720a8e43-89e1-4724-a498-b1bedb967efa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:38.817036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-720a8e43-89e1-4724-a498-b1bedb967efa None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:38.818218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-720a8e43-89e1-4724-a498-b1bedb967efa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:38.825720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 726/1424] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:14:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:38.971510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea438a-74ef-49c3-b629-17b43800a66e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:38.986339 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ea438a-74ef-49c3-b629-17b43800a66e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:38.991788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ad2052-d174-455e-a3dd-73b5b6be04b7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:38.992418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad2052-d174-455e-a3dd-73b5b6be04b7 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:38.992725 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad2052-d174-455e-a3dd-73b5b6be04b7 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:38.993014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ad2052-d174-455e-a3dd-73b5b6be04b7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:39.001766 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad2052-d174-455e-a3dd-73b5b6be04b7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:39.003336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ad2052-d174-455e-a3dd-73b5b6be04b7 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:39.012505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 699/1425] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:39.907059 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075cae-b884-4bfc-90e2-3da3c9d7f0c2 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:39.907636 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075cae-b884-4bfc-90e2-3da3c9d7f0c2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:39.907636 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07075cae-b884-4bfc-90e2-3da3c9d7f0c2 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:39.908970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 727/1426] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:14:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:39.914013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f1ce-8fa2-4216-b5c9-3a7df2bb2b97 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:39.914445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f1ce-8fa2-4216-b5c9-3a7df2bb2b97 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:39.914598 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217f1ce-8fa2-4216-b5c9-3a7df2bb2b97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:39.932517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4217f1ce-8fa2-4216-b5c9-3a7df2bb2b97 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:39.934274 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4217f1ce-8fa2-4216-b5c9-3a7df2bb2b97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:39.941866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 700/1427] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:14:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:40.089929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07075cae-b884-4bfc-90e2-3da3c9d7f0c2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:40.103934 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07075cae-b884-4bfc-90e2-3da3c9d7f0c2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:40.117903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08dbd49e-25b7-4aa0-a3db-084952198c46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:40.118536 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd49e-25b7-4aa0-a3db-084952198c46 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:40.118815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd49e-25b7-4aa0-a3db-084952198c46 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:40.119088 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08dbd49e-25b7-4aa0-a3db-084952198c46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:40.131786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbd49e-25b7-4aa0-a3db-084952198c46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:40.133392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08dbd49e-25b7-4aa0-a3db-084952198c46 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:40.151416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 728/1428] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 62 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:40.988587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d8b36-5fbc-47c4-ad72-731d032195ae None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:40.989170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d8b36-5fbc-47c4-ad72-731d032195ae None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:40.989170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c3d8b36-5fbc-47c4-ad72-731d032195ae None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:40.990529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 701/1429] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:14:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:40.995672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f9ea2-0f23-45da-8b09-837332bd0509 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:40.996205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f9ea2-0f23-45da-8b09-837332bd0509 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:40.996305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28f9ea2-0f23-45da-8b09-837332bd0509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:41.013753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f28f9ea2-0f23-45da-8b09-837332bd0509 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:41.014947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f28f9ea2-0f23-45da-8b09-837332bd0509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:41.022653 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 729/1430] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:14:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:41.171452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d8b36-5fbc-47c4-ad72-731d032195ae None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:41.185698 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c3d8b36-5fbc-47c4-ad72-731d032195ae None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:41.191072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85735702-4420-44ae-a68b-bf01a1e17bee service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:41.191705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85735702-4420-44ae-a68b-bf01a1e17bee service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:41.191992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85735702-4420-44ae-a68b-bf01a1e17bee service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:41.192268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85735702-4420-44ae-a68b-bf01a1e17bee service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:41.200833 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85735702-4420-44ae-a68b-bf01a1e17bee service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:41.202449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85735702-4420-44ae-a68b-bf01a1e17bee service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:41.211849 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 702/1431] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:42.057377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaf2a1-2f98-490c-991a-8ff989633332 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:42.057965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaf2a1-2f98-490c-991a-8ff989633332 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:42.057965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cfaf2a1-2f98-490c-991a-8ff989633332 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:42.059777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 730/1432] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:14:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:42.064802 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a937c70-8463-441c-93fe-1ff7ce006bda None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:42.065223 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a937c70-8463-441c-93fe-1ff7ce006bda None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:42.065376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a937c70-8463-441c-93fe-1ff7ce006bda None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:42.082728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6a937c70-8463-441c-93fe-1ff7ce006bda None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:42.083902 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6a937c70-8463-441c-93fe-1ff7ce006bda None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:42.091436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 703/1433] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:14:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:42.241272 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaf2a1-2f98-490c-991a-8ff989633332 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:42.255043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4cfaf2a1-2f98-490c-991a-8ff989633332 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:42.260302 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03571580-f29b-468a-a7b6-abdcf177f699 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:42.261008 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571580-f29b-468a-a7b6-abdcf177f699 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:42.261320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571580-f29b-468a-a7b6-abdcf177f699 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:42.261597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03571580-f29b-468a-a7b6-abdcf177f699 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:42.269411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03571580-f29b-468a-a7b6-abdcf177f699 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:42.270975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03571580-f29b-468a-a7b6-abdcf177f699 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:42.280624 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 731/1434] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:43.124269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d8cdc-e4f1-40ac-9c3e-31b8af80e621 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:43.124811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d8cdc-e4f1-40ac-9c3e-31b8af80e621 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:43.124811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-539d8cdc-e4f1-40ac-9c3e-31b8af80e621 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:43.126280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 704/1435] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:14:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:43.131128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d21d9-79ff-4f80-87fe-29fd1a185987 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:43.131573 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d21d9-79ff-4f80-87fe-29fd1a185987 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:43.131669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf0d21d9-79ff-4f80-87fe-29fd1a185987 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:43.150342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-bf0d21d9-79ff-4f80-87fe-29fd1a185987 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:43.151784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bf0d21d9-79ff-4f80-87fe-29fd1a185987 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:43.159509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 732/1436] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:14:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:43.306266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d8cdc-e4f1-40ac-9c3e-31b8af80e621 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:43.320651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-539d8cdc-e4f1-40ac-9c3e-31b8af80e621 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:43.325857 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-837e9b3a-e317-4412-a3ca-0902b2a8cac1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:43.326483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e9b3a-e317-4412-a3ca-0902b2a8cac1 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:43.326763 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e9b3a-e317-4412-a3ca-0902b2a8cac1 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:43.327036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-837e9b3a-e317-4412-a3ca-0902b2a8cac1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:43.334848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e9b3a-e317-4412-a3ca-0902b2a8cac1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:43.336432 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-837e9b3a-e317-4412-a3ca-0902b2a8cac1 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:43.345645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 705/1437] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:43 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:44.178063 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a7aac-610e-4854-9c90-520ac2a8dbd3 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:44.178565 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a7aac-610e-4854-9c90-520ac2a8dbd3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:44.178663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-408a7aac-610e-4854-9c90-520ac2a8dbd3 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:44.180015 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 733/1438] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:14:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:44.185220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6f2ff-c833-4680-9086-2d3be1cdda9c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:44.185627 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6f2ff-c833-4680-9086-2d3be1cdda9c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:44.185761 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ca6f2ff-c833-4680-9086-2d3be1cdda9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:44.203666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5ca6f2ff-c833-4680-9086-2d3be1cdda9c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:44.204841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5ca6f2ff-c833-4680-9086-2d3be1cdda9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:44.212409 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 706/1439] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:14:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:44.358713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a7aac-610e-4854-9c90-520ac2a8dbd3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:44.372711 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-408a7aac-610e-4854-9c90-520ac2a8dbd3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:44.377980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f75c16ce-896b-46c1-9548-ac0dfcc3b371 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:44.378607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c16ce-896b-46c1-9548-ac0dfcc3b371 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:44.378889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c16ce-896b-46c1-9548-ac0dfcc3b371 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:44.379163 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f75c16ce-896b-46c1-9548-ac0dfcc3b371 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:44.387467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c16ce-896b-46c1-9548-ac0dfcc3b371 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:44.389055 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f75c16ce-896b-46c1-9548-ac0dfcc3b371 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:44.398142 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 734/1440] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:46.447361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf9498-e188-44c0-bfdb-6a3ee8f5c7e6 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:46.447790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf9498-e188-44c0-bfdb-6a3ee8f5c7e6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:46.447902 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30bf9498-e188-44c0-bfdb-6a3ee8f5c7e6 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:46.450031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 707/1441] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:14:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:46.455215 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5ac92-dad7-456c-a6d7-da1804f8bd32 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:46.455621 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5ac92-dad7-456c-a6d7-da1804f8bd32 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:46.455772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a5ac92-dad7-456c-a6d7-da1804f8bd32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:46.474365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-67a5ac92-dad7-456c-a6d7-da1804f8bd32 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:46.475550 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-67a5ac92-dad7-456c-a6d7-da1804f8bd32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:46.483257 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 735/1442] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:14:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:14:46.521112 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf9498-e188-44c0-bfdb-6a3ee8f5c7e6 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:46.532367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30bf9498-e188-44c0-bfdb-6a3ee8f5c7e6 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:46.535814 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2334be-4fa3-40a9-9b26-bb30f947ef3d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:46.536440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2334be-4fa3-40a9-9b26-bb30f947ef3d service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:46.536722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2334be-4fa3-40a9-9b26-bb30f947ef3d service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:46.537011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2334be-4fa3-40a9-9b26-bb30f947ef3d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:46.545737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2334be-4fa3-40a9-9b26-bb30f947ef3d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:46.547161 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2334be-4fa3-40a9-9b26-bb30f947ef3d service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:46.556427 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 708/1443] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:48.948911 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4689fb2-880e-49e0-a3e3-5a99938ae7f6 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:48.949497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4689fb2-880e-49e0-a3e3-5a99938ae7f6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:48.949497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4689fb2-880e-49e0-a3e3-5a99938ae7f6 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:48.950885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 736/1444] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:14:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:48.956409 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7989dcf-1f2f-4c70-8fa8-2a62ade2ef76 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:48.956786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7989dcf-1f2f-4c70-8fa8-2a62ade2ef76 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:48.957029 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7989dcf-1f2f-4c70-8fa8-2a62ade2ef76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:48.975540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d7989dcf-1f2f-4c70-8fa8-2a62ade2ef76 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:48.976730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d7989dcf-1f2f-4c70-8fa8-2a62ade2ef76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:48.985468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 709/1445] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:14:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:49.021818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4689fb2-880e-49e0-a3e3-5a99938ae7f6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:49.032918 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4689fb2-880e-49e0-a3e3-5a99938ae7f6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:49.036410 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270c476d-4a9c-493a-8dc7-f0761b9c19f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:49.037077 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c476d-4a9c-493a-8dc7-f0761b9c19f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:49.037365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c476d-4a9c-493a-8dc7-f0761b9c19f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:49.037644 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270c476d-4a9c-493a-8dc7-f0761b9c19f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:49.047047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c476d-4a9c-493a-8dc7-f0761b9c19f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:49.048461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-270c476d-4a9c-493a-8dc7-f0761b9c19f0 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:49.057712 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 737/1446] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:51.535559 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c8d5-c7eb-4e26-820e-888e54e9331a None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.536094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c8d5-c7eb-4e26-820e-888e54e9331a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.536094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e22c8d5-c7eb-4e26-820e-888e54e9331a None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.537502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 710/1447] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:14:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:51.543542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d37544-d930-4d72-a34b-ec365d7532df None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.543916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d37544-d930-4d72-a34b-ec365d7532df None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.544130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6d37544-d930-4d72-a34b-ec365d7532df None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.561285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d6d37544-d930-4d72-a34b-ec365d7532df None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:51.562472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d6d37544-d930-4d72-a34b-ec365d7532df None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:51.570183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 738/1448] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:14:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:51.608233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22c8d5-c7eb-4e26-820e-888e54e9331a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:51.618927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e22c8d5-c7eb-4e26-820e-888e54e9331a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:51.622351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df290f6-f429-49ad-b666-06b72822a8c3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:51.622974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df290f6-f429-49ad-b666-06b72822a8c3 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:51.623253 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df290f6-f429-49ad-b666-06b72822a8c3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:51.623526 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df290f6-f429-49ad-b666-06b72822a8c3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:51.632157 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df290f6-f429-49ad-b666-06b72822a8c3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:51.633629 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df290f6-f429-49ad-b666-06b72822a8c3 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:51.643249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 711/1449] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:53.928023 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eba27-708e-427a-bab3-73bc666e4933 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:53.928609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eba27-708e-427a-bab3-73bc666e4933 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:53.928609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b9eba27-708e-427a-bab3-73bc666e4933 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:53.929939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 739/1450] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:14:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:53.935875 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70acbc1-f248-4900-871f-dd0ce701a617 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:53.936307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70acbc1-f248-4900-871f-dd0ce701a617 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:53.936407 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a70acbc1-f248-4900-871f-dd0ce701a617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:53.953730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a70acbc1-f248-4900-871f-dd0ce701a617 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:53.954911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a70acbc1-f248-4900-871f-dd0ce701a617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:53.963086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 712/1451] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:14:53 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:54.001313 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9eba27-708e-427a-bab3-73bc666e4933 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:54.011735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b9eba27-708e-427a-bab3-73bc666e4933 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:54.015152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39f39164-d6f8-4323-96c9-ce17491b2886 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:54.015783 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f39164-d6f8-4323-96c9-ce17491b2886 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:54.016064 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f39164-d6f8-4323-96c9-ce17491b2886 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:54.016358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39f39164-d6f8-4323-96c9-ce17491b2886 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:54.025021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f39164-d6f8-4323-96c9-ce17491b2886 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:54.026431 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39f39164-d6f8-4323-96c9-ce17491b2886 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:54.035527 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 740/1452] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:56.279464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d1139-fdce-4405-9197-f242cfd60a11 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:56.280016 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d1139-fdce-4405-9197-f242cfd60a11 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:56.280016 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-534d1139-fdce-4405-9197-f242cfd60a11 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:56.281415 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 713/1453] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:14:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:56.286652 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12533a-967f-48c8-be94-2f3fe1682f88 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:56.287044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12533a-967f-48c8-be94-2f3fe1682f88 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:56.287219 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da12533a-967f-48c8-be94-2f3fe1682f88 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:56.304470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-da12533a-967f-48c8-be94-2f3fe1682f88 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:56.305685 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-da12533a-967f-48c8-be94-2f3fe1682f88 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:56.313308 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 741/1454] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:14:56 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:14:56.351394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d1139-fdce-4405-9197-f242cfd60a11 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:56.353057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-534d1139-fdce-4405-9197-f242cfd60a11 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:56.365738 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-534d1139-fdce-4405-9197-f242cfd60a11 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:56.369256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6e348aa-014f-4d61-bb1b-d3c10724cb37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:56.369890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e348aa-014f-4d61-bb1b-d3c10724cb37 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:56.370171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e348aa-014f-4d61-bb1b-d3c10724cb37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:56.370447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6e348aa-014f-4d61-bb1b-d3c10724cb37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:56.379135 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e348aa-014f-4d61-bb1b-d3c10724cb37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:56.380564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6e348aa-014f-4d61-bb1b-d3c10724cb37 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:56.390286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 714/1455] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:56 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:14:58.665605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397862fd-96f6-4e4f-bd04-266ad5a00922 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:58.666143 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397862fd-96f6-4e4f-bd04-266ad5a00922 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:58.666260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397862fd-96f6-4e4f-bd04-266ad5a00922 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:58.667622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 742/1456] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:14:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:14:58.672823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54866bb6-16ef-4afe-95c1-7bacab02d4f8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:58.673280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54866bb6-16ef-4afe-95c1-7bacab02d4f8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:58.673429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54866bb6-16ef-4afe-95c1-7bacab02d4f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:58.691517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-54866bb6-16ef-4afe-95c1-7bacab02d4f8 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:14:58.692720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-54866bb6-16ef-4afe-95c1-7bacab02d4f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:14:58.701351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 715/1457] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:14:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:14:58.737790 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397862fd-96f6-4e4f-bd04-266ad5a00922 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:14:58.748835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397862fd-96f6-4e4f-bd04-266ad5a00922 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:14:58.752371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f9fd0e9-204f-4d3c-81ea-71e6110ff293 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:14:58.753024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fd0e9-204f-4d3c-81ea-71e6110ff293 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:14:58.753311 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fd0e9-204f-4d3c-81ea-71e6110ff293 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:14:58.753583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f9fd0e9-204f-4d3c-81ea-71e6110ff293 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:14:58.762975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fd0e9-204f-4d3c-81ea-71e6110ff293 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:14:58.764392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f9fd0e9-204f-4d3c-81ea-71e6110ff293 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:14:58.773874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 743/1458] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:14:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:15:01.000656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3e78d-c438-4149-9cd2-515ee5fe8b0c None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:01.001242 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3e78d-c438-4149-9cd2-515ee5fe8b0c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:01.001242 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74e3e78d-c438-4149-9cd2-515ee5fe8b0c None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:01.002615 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 716/1459] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:15:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:15:01.007901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeef7de-1c6c-4068-b475-4a22a32cd2e6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:01.008329 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeef7de-1c6c-4068-b475-4a22a32cd2e6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:01.008465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beeef7de-1c6c-4068-b475-4a22a32cd2e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:01.026127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-beeef7de-1c6c-4068-b475-4a22a32cd2e6 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:01.027313 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-beeef7de-1c6c-4068-b475-4a22a32cd2e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:01.034932 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 744/1460] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:15:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:01.071315 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3e78d-c438-4149-9cd2-515ee5fe8b0c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:01.081980 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74e3e78d-c438-4149-9cd2-515ee5fe8b0c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:01.085438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-794dc9a1-8111-49b5-968e-a4d0bed55547 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:01.086072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dc9a1-8111-49b5-968e-a4d0bed55547 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:01.086355 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dc9a1-8111-49b5-968e-a4d0bed55547 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:01.086634 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-794dc9a1-8111-49b5-968e-a4d0bed55547 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:01.095960 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794dc9a1-8111-49b5-968e-a4d0bed55547 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:01.097684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-794dc9a1-8111-49b5-968e-a4d0bed55547 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:01.107507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 717/1461] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:15:01 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:15:03.332346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec002139-e093-4b18-8582-4dbf86a31748 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:03.332914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec002139-e093-4b18-8582-4dbf86a31748 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:03.332914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec002139-e093-4b18-8582-4dbf86a31748 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:03.334384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 745/1462] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:15:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:15:03.339541 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7f18e-5631-4926-b41e-419545d6d388 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:03.339960 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7f18e-5631-4926-b41e-419545d6d388 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:03.340111 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f7f18e-5631-4926-b41e-419545d6d388 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:03.346130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=79 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:03.358827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-61f7f18e-5631-4926-b41e-419545d6d388 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:03.360012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-61f7f18e-5631-4926-b41e-419545d6d388 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:03.367647 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 718/1463] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:15:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:03.404135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec002139-e093-4b18-8582-4dbf86a31748 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:03.409544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=73 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:03.415747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec002139-e093-4b18-8582-4dbf86a31748 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:03.419179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-325702ab-62a6-4225-b4fd-e37fe4ae687c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:03.419811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325702ab-62a6-4225-b4fd-e37fe4ae687c service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:03.420093 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325702ab-62a6-4225-b4fd-e37fe4ae687c service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:03.420370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-325702ab-62a6-4225-b4fd-e37fe4ae687c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:03.429040 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325702ab-62a6-4225-b4fd-e37fe4ae687c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:03.430479 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-325702ab-62a6-4225-b4fd-e37fe4ae687c service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:03.440351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 746/1464] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:15:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:15:05.621518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f58bf2-53f0-4c0d-bd51-aab6431bb441 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:05.622101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f58bf2-53f0-4c0d-bd51-aab6431bb441 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:05.622101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f58bf2-53f0-4c0d-bd51-aab6431bb441 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:05.623488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 719/1465] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:15:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:15:05.628638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f900f-c9bd-4615-b821-3f6c608b8e3c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:05.629052 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f900f-c9bd-4615-b821-3f6c608b8e3c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:05.629231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f82f900f-c9bd-4615-b821-3f6c608b8e3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:05.646973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f82f900f-c9bd-4615-b821-3f6c608b8e3c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:05.648147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f82f900f-c9bd-4615-b821-3f6c608b8e3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:05.655713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 747/1466] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:15:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:05.691582 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f58bf2-53f0-4c0d-bd51-aab6431bb441 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:05.702929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f58bf2-53f0-4c0d-bd51-aab6431bb441 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:05.706387 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63f272d4-4554-4576-88dd-1c48522dc51b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:05.707015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f272d4-4554-4576-88dd-1c48522dc51b service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:05.707299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f272d4-4554-4576-88dd-1c48522dc51b service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:05.707573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63f272d4-4554-4576-88dd-1c48522dc51b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:05.716575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f272d4-4554-4576-88dd-1c48522dc51b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:05.718063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63f272d4-4554-4576-88dd-1c48522dc51b service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:05.727693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 720/1467] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:15:05 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:15:07.918455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f9a6a-af48-43e3-9e00-c3e886f292ae None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:07.918455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f9a6a-af48-43e3-9e00-c3e886f292ae None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:07.918455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-153f9a6a-af48-43e3-9e00-c3e886f292ae None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:07.919383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 748/1468] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:15:07 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:15:07.924615 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7292dd-3303-4add-95b1-dec2377cf91b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:07.925078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7292dd-3303-4add-95b1-dec2377cf91b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:07.925196 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f7292dd-3303-4add-95b1-dec2377cf91b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:07.943142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5f7292dd-3303-4add-95b1-dec2377cf91b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:07.944271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5f7292dd-3303-4add-95b1-dec2377cf91b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:07.952659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 721/1469] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:15:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:07.988420 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f9a6a-af48-43e3-9e00-c3e886f292ae None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:07.999508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-153f9a6a-af48-43e3-9e00-c3e886f292ae None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:08.002960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce6dc06-0c19-4bb0-987c-acc0a0ae8bc9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:08.003591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6dc06-0c19-4bb0-987c-acc0a0ae8bc9 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:08.003875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6dc06-0c19-4bb0-987c-acc0a0ae8bc9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:08.004149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce6dc06-0c19-4bb0-987c-acc0a0ae8bc9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:08.013552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6dc06-0c19-4bb0-987c-acc0a0ae8bc9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:08.014978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce6dc06-0c19-4bb0-987c-acc0a0ae8bc9 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:08.024122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 749/1470] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:15:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:15:17.938056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=11 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:18.020083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=14 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:15:40.816789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9554619-d969-4b0e-9b46-1b0127203b2c None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:40.817421 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9554619-d969-4b0e-9b46-1b0127203b2c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:40.817421 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9554619-d969-4b0e-9b46-1b0127203b2c None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:40.818766 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 722/1471] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:15:40.823793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff78d2f-8db0-49a8-9905-a2906196f940 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:40.824244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff78d2f-8db0-49a8-9905-a2906196f940 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:40.824354 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ff78d2f-8db0-49a8-9905-a2906196f940 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:40.842125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5ff78d2f-8db0-49a8-9905-a2906196f940 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:40.843321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5ff78d2f-8db0-49a8-9905-a2906196f940 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:40.851937 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 750/1472] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:15:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:40.898429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd64a55-7756-42bc-8ccc-9efa512cdb1f None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:40.898714 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd64a55-7756-42bc-8ccc-9efa512cdb1f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:40.898989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbd64a55-7756-42bc-8ccc-9efa512cdb1f None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:40.900342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 723/1473] 10.222.0.64 () {54 vars in 962 bytes} [Thu May 26 18:15:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:15:40.905158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71929f2-ec76-42c9-bb75-ae4b859fb584 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:40.905457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71929f2-ec76-42c9-bb75-ae4b859fb584 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:40.905751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e71929f2-ec76-42c9-bb75-ae4b859fb584 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:40.924060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e71929f2-ec76-42c9-bb75-ae4b859fb584 None None] MFA Rules not processed for user `a2fbb5beba8a45a5b0a9b0beba0e0d63`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:40.925290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e71929f2-ec76-42c9-bb75-ae4b859fb584 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:40.931673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 751/1474] 10.222.0.64 () {58 vars in 1059 bytes} [Thu May 26 18:15:40 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:40.938760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd64a55-7756-42bc-8ccc-9efa512cdb1f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:40.949128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbd64a55-7756-42bc-8ccc-9efa512cdb1f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:40.952496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a4f62db-26af-4f45-b630-3c51b6c8dca4 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbb5beba8a45a5b0a9b0beba0e0d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:40.953151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f62db-26af-4f45-b630-3c51b6c8dca4 service glance] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:40.953434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f62db-26af-4f45-b630-3c51b6c8dca4 service glance] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:40.953709 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a4f62db-26af-4f45-b630-3c51b6c8dca4 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:40.962816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f62db-26af-4f45-b630-3c51b6c8dca4 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:40.964236 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a4f62db-26af-4f45-b630-3c51b6c8dca4 service glance] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:40.973615 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 724/1475] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:15:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:15:43.214380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ea90f-cf52-4332-9d32-1a8aaf43b348 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:43.214961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ea90f-cf52-4332-9d32-1a8aaf43b348 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:43.214961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ea90f-cf52-4332-9d32-1a8aaf43b348 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:43.216321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 752/1476] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:15:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:15:43.221632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fdd50-1851-4f26-86df-fa9c8f7ad582 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:43.222025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fdd50-1851-4f26-86df-fa9c8f7ad582 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:43.222189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc5fdd50-1851-4f26-86df-fa9c8f7ad582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:43.239398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fc5fdd50-1851-4f26-86df-fa9c8f7ad582 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:43.241123 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fc5fdd50-1851-4f26-86df-fa9c8f7ad582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:43.249358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 725/1477] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:15:43 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:43.272617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ea90f-cf52-4332-9d32-1a8aaf43b348 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:43.285182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ea90f-cf52-4332-9d32-1a8aaf43b348 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:43.290184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085bd8d-a0a7-4b9d-a590-a08e39db5ea4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:43.290830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085bd8d-a0a7-4b9d-a590-a08e39db5ea4 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:43.291118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085bd8d-a0a7-4b9d-a590-a08e39db5ea4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:43.291400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085bd8d-a0a7-4b9d-a590-a08e39db5ea4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:43.292127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085bd8d-a0a7-4b9d-a590-a08e39db5ea4 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:43.293947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-8085bd8d-a0a7-4b9d-a590-a08e39db5ea4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:15:43.293947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: warnings.warn(msg) May 26 18:15:43.293947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: May 26 18:15:43.295081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085bd8d-a0a7-4b9d-a590-a08e39db5ea4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:43.314961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 753/1478] 10.222.0.64 () {56 vars in 1108 bytes} [Thu May 26 18:15:43 2022] GET /identity/v3/projects => generated 2553 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:15:45.531080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c0249-8e22-485a-866a-666885548525 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:45.531608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c0249-8e22-485a-866a-666885548525 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:45.531608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10c0249-8e22-485a-866a-666885548525 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:45.532949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 726/1479] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:15:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:15:45.538583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62b9c-0f15-41d4-b070-56396860ce1f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:45.538969 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62b9c-0f15-41d4-b070-56396860ce1f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:45.539152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27a62b9c-0f15-41d4-b070-56396860ce1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:45.558093 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-27a62b9c-0f15-41d4-b070-56396860ce1f None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:45.559305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-27a62b9c-0f15-41d4-b070-56396860ce1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:45.567210 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 754/1480] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:15:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:45.610410 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c0249-8e22-485a-866a-666885548525 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:45.625344 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b10c0249-8e22-485a-866a-666885548525 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:45.630588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b21725ff-8821-45f6-8570-7255638eab01 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:45.631218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21725ff-8821-45f6-8570-7255638eab01 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:45.631503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21725ff-8821-45f6-8570-7255638eab01 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:45.631782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b21725ff-8821-45f6-8570-7255638eab01 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:45.639773 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21725ff-8821-45f6-8570-7255638eab01 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:45.641421 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b21725ff-8821-45f6-8570-7255638eab01 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:45.650658 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 727/1481] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:15:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:15:48.010307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846bbab-2363-474d-b539-0e7b55f848c4 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:48.010831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846bbab-2363-474d-b539-0e7b55f848c4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:48.010831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f846bbab-2363-474d-b539-0e7b55f848c4 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:48.012159 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 755/1482] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:15:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:15:48.017461 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee92a2c-5515-440c-a748-e2811abf7bf9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:48.017887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee92a2c-5515-440c-a748-e2811abf7bf9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:48.018000 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ee92a2c-5515-440c-a748-e2811abf7bf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:48.035133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2ee92a2c-5515-440c-a748-e2811abf7bf9 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:48.036824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2ee92a2c-5515-440c-a748-e2811abf7bf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:48.044398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 728/1483] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:15:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:48.079866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846bbab-2363-474d-b539-0e7b55f848c4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:48.090275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f846bbab-2363-474d-b539-0e7b55f848c4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:48.093700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56495111-5f47-47b8-8a00-2e3ad55de903 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:48.094331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56495111-5f47-47b8-8a00-2e3ad55de903 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:48.094859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56495111-5f47-47b8-8a00-2e3ad55de903 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:48.095128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56495111-5f47-47b8-8a00-2e3ad55de903 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:48.104321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56495111-5f47-47b8-8a00-2e3ad55de903 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:48.105765 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56495111-5f47-47b8-8a00-2e3ad55de903 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:48.115538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 756/1484] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:15:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:15:50.356867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34b98-ce5b-4ed1-9a5f-b7135257dd97 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:50.357429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34b98-ce5b-4ed1-9a5f-b7135257dd97 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:50.357526 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a34b98-ce5b-4ed1-9a5f-b7135257dd97 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:50.358824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 729/1485] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:15:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:15:50.364091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2da379-41b9-4d67-86e0-4654b0b12fc2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:50.364577 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2da379-41b9-4d67-86e0-4654b0b12fc2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:50.364686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e2da379-41b9-4d67-86e0-4654b0b12fc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:50.382425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9e2da379-41b9-4d67-86e0-4654b0b12fc2 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:50.383620 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9e2da379-41b9-4d67-86e0-4654b0b12fc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:50.391634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 757/1486] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:15:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:50.429600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a34b98-ce5b-4ed1-9a5f-b7135257dd97 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:50.440058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66a34b98-ce5b-4ed1-9a5f-b7135257dd97 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:50.444180 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a603fcc6-f32d-4aa3-9fd2-1b4c0315b647 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:50.444808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603fcc6-f32d-4aa3-9fd2-1b4c0315b647 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:50.445126 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603fcc6-f32d-4aa3-9fd2-1b4c0315b647 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:50.445409 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a603fcc6-f32d-4aa3-9fd2-1b4c0315b647 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:50.454245 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603fcc6-f32d-4aa3-9fd2-1b4c0315b647 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:50.455676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a603fcc6-f32d-4aa3-9fd2-1b4c0315b647 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:50.465115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 730/1487] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:15:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:15:52.834093 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a6df-ae79-48e6-82a8-7b878323ee72 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:52.834631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a6df-ae79-48e6-82a8-7b878323ee72 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:52.834631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1461a6df-ae79-48e6-82a8-7b878323ee72 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:52.836028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 758/1488] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:15:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:15:52.841440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7baa8-2ccd-47f0-b2c7-93b930d1a5cb None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:52.841866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7baa8-2ccd-47f0-b2c7-93b930d1a5cb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:52.841976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d7baa8-2ccd-47f0-b2c7-93b930d1a5cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:52.860661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d8d7baa8-2ccd-47f0-b2c7-93b930d1a5cb None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:52.861873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d8d7baa8-2ccd-47f0-b2c7-93b930d1a5cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:52.869381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 731/1489] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:15:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:52.909116 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461a6df-ae79-48e6-82a8-7b878323ee72 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:52.920147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1461a6df-ae79-48e6-82a8-7b878323ee72 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:52.923549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54ac73e0-2e0b-4bc2-9c05-8bd9f47474a1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:52.924199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac73e0-2e0b-4bc2-9c05-8bd9f47474a1 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:52.924466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac73e0-2e0b-4bc2-9c05-8bd9f47474a1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:52.924741 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54ac73e0-2e0b-4bc2-9c05-8bd9f47474a1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:52.933484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac73e0-2e0b-4bc2-9c05-8bd9f47474a1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:52.934902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54ac73e0-2e0b-4bc2-9c05-8bd9f47474a1 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:52.944063 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 759/1490] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:15:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:15:55.390567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22738bef-f450-4f49-be15-a7b11a76b266 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:55.391183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22738bef-f450-4f49-be15-a7b11a76b266 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:55.391183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22738bef-f450-4f49-be15-a7b11a76b266 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:55.392465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 732/1491] 10.222.0.64 () {54 vars in 926 bytes} [Thu May 26 18:15:55 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:15:55.398380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0decc0-cc52-406f-84dd-4a93c322ebc9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:55.398828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0decc0-cc52-406f-84dd-4a93c322ebc9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:55.398935 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd0decc0-cc52-406f-84dd-4a93c322ebc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:55.416304 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cd0decc0-cc52-406f-84dd-4a93c322ebc9 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:15:55.417525 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cd0decc0-cc52-406f-84dd-4a93c322ebc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:15:55.425147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 760/1492] 10.222.0.64 () {58 vars in 1023 bytes} [Thu May 26 18:15:55 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:15:55.463352 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22738bef-f450-4f49-be15-a7b11a76b266 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:15:55.474333 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22738bef-f450-4f49-be15-a7b11a76b266 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:15:55.477898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54b97564-51e4-4e1a-ac99-3bb57f3486ac service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:15:55.478527 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b97564-51e4-4e1a-ac99-3bb57f3486ac service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:15:55.478811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b97564-51e4-4e1a-ac99-3bb57f3486ac service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:15:55.479091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54b97564-51e4-4e1a-ac99-3bb57f3486ac service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:15:55.487893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b97564-51e4-4e1a-ac99-3bb57f3486ac service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:15:55.489371 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-54b97564-51e4-4e1a-ac99-3bb57f3486ac service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:15:55.498588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 733/1493] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:15:55 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:16:05.411299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=33 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:16:05.494458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=33 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:34.117979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913da6f-4635-48e7-93c9-e770e43a221c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.118573 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913da6f-4635-48e7-93c9-e770e43a221c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.118573 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2913da6f-4635-48e7-93c9-e770e43a221c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.135965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2913da6f-4635-48e7-93c9-e770e43a221c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:34.137188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2913da6f-4635-48e7-93c9-e770e43a221c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:34.145520 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 761/1494] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:34.155445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61c12a-73c7-431f-9566-97af34cdf8ef None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.155933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61c12a-73c7-431f-9566-97af34cdf8ef None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.156044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe61c12a-73c7-431f-9566-97af34cdf8ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.174183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fe61c12a-73c7-431f-9566-97af34cdf8ef None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:34.175369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fe61c12a-73c7-431f-9566-97af34cdf8ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:34.183287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 734/1495] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:34.187902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913da6f-4635-48e7-93c9-e770e43a221c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:34.197665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2913da6f-4635-48e7-93c9-e770e43a221c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:34.202104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eb3bd-c4ae-495b-aab9-978e4ac65109 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:34.202755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb3bd-c4ae-495b-aab9-978e4ac65109 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.203039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb3bd-c4ae-495b-aab9-978e4ac65109 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.203319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451eb3bd-c4ae-495b-aab9-978e4ac65109 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.204036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eb3bd-c4ae-495b-aab9-978e4ac65109 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:17:34.204347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eb3bd-c4ae-495b-aab9-978e4ac65109 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:34.205395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-451eb3bd-c4ae-495b-aab9-978e4ac65109 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:17:34.205395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: warnings.warn(msg) May 26 18:17:34.205395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: May 26 18:17:34.206278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-451eb3bd-c4ae-495b-aab9-978e4ac65109 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:34.218249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 762/1496] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:17:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:17:34.226731 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61c12a-73c7-431f-9566-97af34cdf8ef None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:34.236416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe61c12a-73c7-431f-9566-97af34cdf8ef None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:34.240901 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3f78b-f052-4b92-89d2-ad6149068088 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:34.241583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3f78b-f052-4b92-89d2-ad6149068088 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.241870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3f78b-f052-4b92-89d2-ad6149068088 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.242147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3f78b-f052-4b92-89d2-ad6149068088 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.242825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3f78b-f052-4b92-89d2-ad6149068088 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:34.244578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-10b3f78b-f052-4b92-89d2-ad6149068088 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:17:34.244578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: warnings.warn(msg) May 26 18:17:34.244578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: May 26 18:17:34.245830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3f78b-f052-4b92-89d2-ad6149068088 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:34.280622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 735/1497] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:17:34 2022] POST /identity/v3/projects => generated 379 bytes in 55 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:17:34.284795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eb3bd-c4ae-495b-aab9-978e4ac65109 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:34.296363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451eb3bd-c4ae-495b-aab9-978e4ac65109 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:34.351939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1310cf3-ff3a-4ac4-b2ad-0fe3ece1c8e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:34.352599 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1310cf3-ff3a-4ac4-b2ad-0fe3ece1c8e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.352883 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1310cf3-ff3a-4ac4-b2ad-0fe3ece1c8e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.353178 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1310cf3-ff3a-4ac4-b2ad-0fe3ece1c8e9 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.353896 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1310cf3-ff3a-4ac4-b2ad-0fe3ece1c8e9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:34.354924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-c1310cf3-ff3a-4ac4-b2ad-0fe3ece1c8e9 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:17:34.354924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: warnings.warn(msg) May 26 18:17:34.354924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: May 26 18:17:34.356125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1310cf3-ff3a-4ac4-b2ad-0fe3ece1c8e9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:34.375079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 763/1498] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:17:34 2022] POST /identity/v3/users => generated 290 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:17:34.379125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3f78b-f052-4b92-89d2-ad6149068088 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:34.389671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3f78b-f052-4b92-89d2-ad6149068088 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:34.394106 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd26dc8-1e48-4b18-b896-3e303ba8317d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:34.394757 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd26dc8-1e48-4b18-b896-3e303ba8317d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.395040 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd26dc8-1e48-4b18-b896-3e303ba8317d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.395320 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd26dc8-1e48-4b18-b896-3e303ba8317d admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.396036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd26dc8-1e48-4b18-b896-3e303ba8317d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:34.397075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-1dd26dc8-1e48-4b18-b896-3e303ba8317d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:17:34.397075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: warnings.warn(msg) May 26 18:17:34.397075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: May 26 18:17:34.397962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd26dc8-1e48-4b18-b896-3e303ba8317d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:34.411141 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 736/1499] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:34.414878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1310cf3-ff3a-4ac4-b2ad-0fe3ece1c8e9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:34.424498 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1310cf3-ff3a-4ac4-b2ad-0fe3ece1c8e9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:34.428909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785a66d0-b409-4d31-be8d-bdd181f27b52 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:34.429593 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a66d0-b409-4d31-be8d-bdd181f27b52 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.429881 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a66d0-b409-4d31-be8d-bdd181f27b52 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.430161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785a66d0-b409-4d31-be8d-bdd181f27b52 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.430877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a66d0-b409-4d31-be8d-bdd181f27b52 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:34.432014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-785a66d0-b409-4d31-be8d-bdd181f27b52 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:17:34.432014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: warnings.warn(msg) May 26 18:17:34.432014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: May 26 18:17:34.432899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-785a66d0-b409-4d31-be8d-bdd181f27b52 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:34.445877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 764/1500] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:17:34 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:17:34.450168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd26dc8-1e48-4b18-b896-3e303ba8317d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:34.459783 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd26dc8-1e48-4b18-b896-3e303ba8317d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:34.464856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509d4f35-e44f-4cee-90c3-5e3cf5a871a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:34.465748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4f35-e44f-4cee-90c3-5e3cf5a871a4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.466035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4f35-e44f-4cee-90c3-5e3cf5a871a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.466314 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509d4f35-e44f-4cee-90c3-5e3cf5a871a4 admin admin] PATH_INFO: `/v3/projects/17a38096440f4c90b5237d758d2641e0/users/113b8c0fce174b8b9100abee33613771/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.480836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d4f35-e44f-4cee-90c3-5e3cf5a871a4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=17a38096440f4c90b5237d758d2641e0, user_id=113b8c0fce174b8b9100abee33613771, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:34.481899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-509d4f35-e44f-4cee-90c3-5e3cf5a871a4 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:17:34.481899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: warnings.warn(msg) May 26 18:17:34.481899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: May 26 18:17:34.483818 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509d4f35-e44f-4cee-90c3-5e3cf5a871a4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:34.496328 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 737/1501] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:17:34 2022] PUT /identity/v3/projects/17a38096440f4c90b5237d758d2641e0/users/113b8c0fce174b8b9100abee33613771/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:34.507419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860916b-8bdf-4f57-89a0-2ad5fc114412 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.507703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860916b-8bdf-4f57-89a0-2ad5fc114412 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.508030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e860916b-8bdf-4f57-89a0-2ad5fc114412 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.534185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e860916b-8bdf-4f57-89a0-2ad5fc114412 None None] MFA Rules not processed for user `113b8c0fce174b8b9100abee33613771`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:34.535389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e860916b-8bdf-4f57-89a0-2ad5fc114412 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:34.596897 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 765/1502] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:17:34 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:34.610387 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b4f9e-45f3-44ef-99db-e55eb75e2689 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.610705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b4f9e-45f3-44ef-99db-e55eb75e2689 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.611005 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57b4f9e-45f3-44ef-99db-e55eb75e2689 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.612394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 738/1503] 10.222.0.64 () {54 vars in 963 bytes} [Thu May 26 18:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:17:34.617344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09affbe2-a809-4447-ae91-b443475fcfc7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.617654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09affbe2-a809-4447-ae91-b443475fcfc7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.617933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09affbe2-a809-4447-ae91-b443475fcfc7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.635685 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-09affbe2-a809-4447-ae91-b443475fcfc7 None None] MFA Rules not processed for user `0c09ffb276b84b2aa8735d6907a0de73`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:34.636798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-09affbe2-a809-4447-ae91-b443475fcfc7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:34.678174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:34.687111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 766/1504] 10.222.0.64 () {58 vars in 1060 bytes} [Thu May 26 18:17:34 2022] POST /identity/v3/auth/tokens => generated 3110 bytes in 71 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:34.694788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b4f9e-45f3-44ef-99db-e55eb75e2689 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:34.705776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57b4f9e-45f3-44ef-99db-e55eb75e2689 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:34.709214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac3605-39bd-42b1-9fff-1407f770f95c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:34.709858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac3605-39bd-42b1-9fff-1407f770f95c service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.710123 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac3605-39bd-42b1-9fff-1407f770f95c service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.710400 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cac3605-39bd-42b1-9fff-1407f770f95c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.718470 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac3605-39bd-42b1-9fff-1407f770f95c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:34.719933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cac3605-39bd-42b1-9fff-1407f770f95c service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:34.729061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 739/1505] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:17:34 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 35 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:17:34.770585 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba60f3-9103-43d7-a1ff-ad5c31fbcec8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.770884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba60f3-9103-43d7-a1ff-ad5c31fbcec8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.771170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dba60f3-9103-43d7-a1ff-ad5c31fbcec8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.772462 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 767/1506] 10.222.0.64 () {52 vars in 829 bytes} [Thu May 26 18:17:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:17:34.776115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac3605-39bd-42b1-9fff-1407f770f95c service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:34.836696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cac3605-39bd-42b1-9fff-1407f770f95c service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:34.841094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:34.841977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.842254 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.842525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] PATH_INFO: `/v3/users/113b8c0fce174b8b9100abee33613771` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.843674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] RBAC: Authorizing `identity:delete_user(user_id=113b8c0fce174b8b9100abee33613771)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:34.844681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:17:34.844681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: warnings.warn(msg) May 26 18:17:34.844681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: May 26 18:17:34.845914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:34.909924 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '113b8c0fce174b8b9100abee33613771'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:34.922055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '113b8c0fce174b8b9100abee33613771'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:34.922812 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '113b8c0fce174b8b9100abee33613771'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:34.940946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '113b8c0fce174b8b9100abee33613771'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:34.944894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=88,keystone:INSERT=3,keystone:DELETE=9 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:34.951642 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '113b8c0fce174b8b9100abee33613771'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:34.959457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 740/1507] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:17:34 2022] DELETE /identity/v3/users/113b8c0fce174b8b9100abee33613771 => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:34.963899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f0392-5f83-4288-b64a-81d761b26eb1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:34.964189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f0392-5f83-4288-b64a-81d761b26eb1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:34.964470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f8f0392-5f83-4288-b64a-81d761b26eb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:34.982325 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7f8f0392-5f83-4288-b64a-81d761b26eb1 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:17:34.983542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7f8f0392-5f83-4288-b64a-81d761b26eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:35.039635 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 768/1508] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:17:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:17:35.049480 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:35.050876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:35.108593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83662864-03cf-4af2-baea-bf4078f04441 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:35.112166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e43c7d0-5ddd-4159-8c46-743ef9dcb586 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:35.112840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43c7d0-5ddd-4159-8c46-743ef9dcb586 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:35.113167 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43c7d0-5ddd-4159-8c46-743ef9dcb586 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:35.113447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e43c7d0-5ddd-4159-8c46-743ef9dcb586 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:35.122915 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43c7d0-5ddd-4159-8c46-743ef9dcb586 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:35.124361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e43c7d0-5ddd-4159-8c46-743ef9dcb586 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:35.133599 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 741/1509] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:17:35 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:17:35.456137 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f0392-5f83-4288-b64a-81d761b26eb1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:17:35.457628 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7f8f0392-5f83-4288-b64a-81d761b26eb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:17:35.470643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f8f0392-5f83-4288-b64a-81d761b26eb1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:17:35.476808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12727c58-6572-4305-9384-4d219f780226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:17:35.477643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12727c58-6572-4305-9384-4d219f780226 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:17:35.478010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12727c58-6572-4305-9384-4d219f780226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:17:35.478888 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12727c58-6572-4305-9384-4d219f780226 admin admin] PATH_INFO: `/v3/projects/17a38096440f4c90b5237d758d2641e0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:17:35.480136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12727c58-6572-4305-9384-4d219f780226 admin admin] RBAC: Authorizing `identity:delete_project(project_id=17a38096440f4c90b5237d758d2641e0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:17:35.481201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-12727c58-6572-4305-9384-4d219f780226 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:17:35.481201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: warnings.warn(msg) May 26 18:17:35.481201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: May 26 18:17:35.482422 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12727c58-6572-4305-9384-4d219f780226 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:17:35.542112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-12727c58-6572-4305-9384-4d219f780226 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '17a38096440f4c90b5237d758d2641e0', 'request_id': 'req-12727c58-6572-4305-9384-4d219f780226'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:35.551307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-12727c58-6572-4305-9384-4d219f780226 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '17a38096440f4c90b5237d758d2641e0', 'request_id': 'req-12727c58-6572-4305-9384-4d219f780226'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:35.557217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-12727c58-6572-4305-9384-4d219f780226 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '17a38096440f4c90b5237d758d2641e0', 'request_id': 'req-12727c58-6572-4305-9384-4d219f780226'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:35.574972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-12727c58-6572-4305-9384-4d219f780226 admin admin] The token cache is being invalidate because project 17a38096440f4c90b5237d758d2641e0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:17:35.575257 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-12727c58-6572-4305-9384-4d219f780226 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:35.575891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-12727c58-6572-4305-9384-4d219f780226 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:17:35.577542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 769/1510] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:17:35 2022] DELETE /identity/v3/projects/17a38096440f4c90b5237d758d2641e0 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:17:45.129578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=1,keystone:SELECT=28 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:17:45.572066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=55,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:27.129239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63af374-5114-405d-9272-99a7258fb27d None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:27.129861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63af374-5114-405d-9272-99a7258fb27d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:27.129861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63af374-5114-405d-9272-99a7258fb27d None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:27.131246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 742/1511] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:19:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:19:27.135986 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8acfae-cb5f-4d83-88af-7f05991c4894 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:27.136402 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8acfae-cb5f-4d83-88af-7f05991c4894 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:27.136536 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf8acfae-cb5f-4d83-88af-7f05991c4894 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:27.154939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cf8acfae-cb5f-4d83-88af-7f05991c4894 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:27.156129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cf8acfae-cb5f-4d83-88af-7f05991c4894 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:27.212931 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 770/1512] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:19:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:27.378599 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63af374-5114-405d-9272-99a7258fb27d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:27.380286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a63af374-5114-405d-9272-99a7258fb27d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:27.451582 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63af374-5114-405d-9272-99a7258fb27d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:27.456811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22d0c784-2aea-417d-b29d-8c28f3744049 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:27.457490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c784-2aea-417d-b29d-8c28f3744049 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:27.457772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c784-2aea-417d-b29d-8c28f3744049 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:27.458048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22d0c784-2aea-417d-b29d-8c28f3744049 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:27.465911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c784-2aea-417d-b29d-8c28f3744049 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:27.467495 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22d0c784-2aea-417d-b29d-8c28f3744049 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:27.476618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 743/1513] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:19:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:28.349920 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457e523-d2c0-468a-96a2-2463eacfa7ad None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:28.350470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457e523-d2c0-468a-96a2-2463eacfa7ad None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:28.350470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8457e523-d2c0-468a-96a2-2463eacfa7ad None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:28.351901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 771/1514] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:19:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:19:28.356937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6b69c-d0fb-4231-bdbc-3b0c617a3213 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:28.357384 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6b69c-d0fb-4231-bdbc-3b0c617a3213 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:28.357532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe6b69c-d0fb-4231-bdbc-3b0c617a3213 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:28.377058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2fe6b69c-d0fb-4231-bdbc-3b0c617a3213 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:28.378250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2fe6b69c-d0fb-4231-bdbc-3b0c617a3213 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:28.386005 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 744/1515] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:19:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:28.537905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457e523-d2c0-468a-96a2-2463eacfa7ad None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:28.552512 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8457e523-d2c0-468a-96a2-2463eacfa7ad None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:28.557959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311a48fb-9657-4ac3-9efa-440c7154e5d0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:28.558605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a48fb-9657-4ac3-9efa-440c7154e5d0 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:28.558914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a48fb-9657-4ac3-9efa-440c7154e5d0 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:28.559186 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311a48fb-9657-4ac3-9efa-440c7154e5d0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:28.567976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a48fb-9657-4ac3-9efa-440c7154e5d0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:28.569600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311a48fb-9657-4ac3-9efa-440c7154e5d0 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:28.576900 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548398e-4472-4152-af6a-3f7753c4f4ef None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:28.577324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548398e-4472-4152-af6a-3f7753c4f4ef None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:28.577610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8548398e-4472-4152-af6a-3f7753c4f4ef None None] PATH_INFO: `/v3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:28.578718 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 772/1516] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:19:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:28.579572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 745/1517] 10.222.0.74 () {54 vars in 925 bytes} [Thu May 26 18:19:28 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:19:28.585352 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd980d0-0283-4554-9eac-baa597a08b2b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:28.585577 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd980d0-0283-4554-9eac-baa597a08b2b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:28.585854 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfd980d0-0283-4554-9eac-baa597a08b2b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:28.603279 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-dfd980d0-0283-4554-9eac-baa597a08b2b None None] MFA Rules not processed for user `1ab4efe6f79d4b3ca5618c089c5f3d24`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:28.604460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dfd980d0-0283-4554-9eac-baa597a08b2b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:28.669317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 773/1518] 10.222.0.74 () {58 vars in 1015 bytes} [Thu May 26 18:19:28 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:37.716424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6d93d-d916-4fb8-bda2-983ae867fed9 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:37.717034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6d93d-d916-4fb8-bda2-983ae867fed9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:37.717034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbd6d93d-d916-4fb8-bda2-983ae867fed9 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:37.718357 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 746/1519] 10.222.0.64 () {54 vars in 960 bytes} [Thu May 26 18:19:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:19:37.723147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39682698-21c1-4734-9578-e7e65519bb66 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:37.723549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39682698-21c1-4734-9578-e7e65519bb66 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:37.723701 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39682698-21c1-4734-9578-e7e65519bb66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:37.741368 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-39682698-21c1-4734-9578-e7e65519bb66 None None] MFA Rules not processed for user `1ab4efe6f79d4b3ca5618c089c5f3d24`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:37.742548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-39682698-21c1-4734-9578-e7e65519bb66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:37.750711 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 774/1520] 10.222.0.64 () {58 vars in 1057 bytes} [Thu May 26 18:19:37 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:37.758439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6d93d-d916-4fb8-bda2-983ae867fed9 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:37.772245 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbd6d93d-d916-4fb8-bda2-983ae867fed9 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:37.777134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-03cd5433-5b21-42c3-a715-db32b6331156 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab4efe6f79d4b3ca5618c089c5f3d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:37.777756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd5433-5b21-42c3-a715-db32b6331156 service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:37.778040 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd5433-5b21-42c3-a715-db32b6331156 service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:37.778318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03cd5433-5b21-42c3-a715-db32b6331156 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:37.786507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd5433-5b21-42c3-a715-db32b6331156 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:37.788090 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-03cd5433-5b21-42c3-a715-db32b6331156 service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:37.797564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 747/1521] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:19:37 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:19:39.828704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332aea2-6427-4690-8ced-3fa2a068dba0 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:39.829182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332aea2-6427-4690-8ced-3fa2a068dba0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:39.829299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e332aea2-6427-4690-8ced-3fa2a068dba0 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:39.830697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 775/1522] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:19:39 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:19:39.835639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e614555-d3fc-4d0f-b9d0-f692964dc46f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:39.836126 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e614555-d3fc-4d0f-b9d0-f692964dc46f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:39.836236 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e614555-d3fc-4d0f-b9d0-f692964dc46f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:39.855424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0e614555-d3fc-4d0f-b9d0-f692964dc46f None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:39.856604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0e614555-d3fc-4d0f-b9d0-f692964dc46f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:39.866195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 748/1523] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:19:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:40.019532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332aea2-6427-4690-8ced-3fa2a068dba0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:40.034748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e332aea2-6427-4690-8ced-3fa2a068dba0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:40.040318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c47fc44-664d-428c-9807-b39dbfb79e91 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:40.040958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47fc44-664d-428c-9807-b39dbfb79e91 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:40.041274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47fc44-664d-428c-9807-b39dbfb79e91 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:40.041557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c47fc44-664d-428c-9807-b39dbfb79e91 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:40.050282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47fc44-664d-428c-9807-b39dbfb79e91 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:40.051875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c47fc44-664d-428c-9807-b39dbfb79e91 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:40.061328 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 776/1524] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:19:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:19:40.924111 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71096a-c46d-4728-877d-f0463b5ebe59 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:40.924726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71096a-c46d-4728-877d-f0463b5ebe59 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:40.924726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e71096a-c46d-4728-877d-f0463b5ebe59 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:40.926108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 749/1525] 127.0.0.1 () {54 vars in 901 bytes} [Thu May 26 18:19:40 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:19:40.930960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336f572-7237-45b8-9640-58baa578460e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:40.931367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336f572-7237-45b8-9640-58baa578460e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:40.931518 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3336f572-7237-45b8-9640-58baa578460e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:40.949610 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3336f572-7237-45b8-9640-58baa578460e None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:40.950793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3336f572-7237-45b8-9640-58baa578460e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:40.958461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 777/1526] 127.0.0.1 () {58 vars in 998 bytes} [Thu May 26 18:19:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:41.108689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71096a-c46d-4728-877d-f0463b5ebe59 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:41.123309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e71096a-c46d-4728-877d-f0463b5ebe59 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:41.129224 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a493961-6840-444f-aeca-a909b97b8e45 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:41.129851 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a493961-6840-444f-aeca-a909b97b8e45 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:41.130133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a493961-6840-444f-aeca-a909b97b8e45 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:41.130410 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a493961-6840-444f-aeca-a909b97b8e45 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:41.138284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a493961-6840-444f-aeca-a909b97b8e45 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:41.139852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a493961-6840-444f-aeca-a909b97b8e45 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:41.149387 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 750/1527] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:19:41 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:45.444457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fb6d4-3a6b-4783-a57f-2b6378f4e973 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:45.444970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fb6d4-3a6b-4783-a57f-2b6378f4e973 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:45.444970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-941fb6d4-3a6b-4783-a57f-2b6378f4e973 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:45.446341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 778/1528] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:19:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:19:45.451560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf26321-4c02-405f-94dd-463b37e1a253 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:45.451962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf26321-4c02-405f-94dd-463b37e1a253 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:45.452145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cf26321-4c02-405f-94dd-463b37e1a253 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:45.469820 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3cf26321-4c02-405f-94dd-463b37e1a253 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:45.471045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3cf26321-4c02-405f-94dd-463b37e1a253 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:45.478716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 751/1529] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:19:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:45.515120 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fb6d4-3a6b-4783-a57f-2b6378f4e973 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:45.516771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-941fb6d4-3a6b-4783-a57f-2b6378f4e973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:45.572753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-941fb6d4-3a6b-4783-a57f-2b6378f4e973 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:45.576302 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb24ef8-42a3-4c84-8a07-49cf5c1d76f7 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:45.576940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb24ef8-42a3-4c84-8a07-49cf5c1d76f7 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:45.577261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb24ef8-42a3-4c84-8a07-49cf5c1d76f7 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:45.577543 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb24ef8-42a3-4c84-8a07-49cf5c1d76f7 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:45.586497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb24ef8-42a3-4c84-8a07-49cf5c1d76f7 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:45.587920 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb24ef8-42a3-4c84-8a07-49cf5c1d76f7 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:45.592822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:19:45.597793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 779/1530] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:19:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:47.766166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900786b3-eca3-4035-ae8f-13300fc7e402 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:47.767382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900786b3-eca3-4035-ae8f-13300fc7e402 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:47.767382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-900786b3-eca3-4035-ae8f-13300fc7e402 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:47.768597 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 752/1531] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:19:47 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:19:47.773713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3aecb-59d4-42e8-9489-5251e451364b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:47.774114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3aecb-59d4-42e8-9489-5251e451364b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:47.774274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f3aecb-59d4-42e8-9489-5251e451364b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:47.792555 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-65f3aecb-59d4-42e8-9489-5251e451364b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:47.793778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-65f3aecb-59d4-42e8-9489-5251e451364b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:47.801609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 780/1532] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:19:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:19:47.836699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900786b3-eca3-4035-ae8f-13300fc7e402 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:47.847801 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-900786b3-eca3-4035-ae8f-13300fc7e402 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:47.851243 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c7800c9-23a1-4649-8c4e-04d1e2f6aacf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:47.851865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7800c9-23a1-4649-8c4e-04d1e2f6aacf service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:47.852144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7800c9-23a1-4649-8c4e-04d1e2f6aacf service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:47.852418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c7800c9-23a1-4649-8c4e-04d1e2f6aacf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:47.861423 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7800c9-23a1-4649-8c4e-04d1e2f6aacf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:47.862848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c7800c9-23a1-4649-8c4e-04d1e2f6aacf service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:47.871952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 753/1533] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:19:47 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:51.590582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edfd87-8707-4569-bfd9-0a76ed81b5c8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:51.591126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edfd87-8707-4569-bfd9-0a76ed81b5c8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:51.591126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82edfd87-8707-4569-bfd9-0a76ed81b5c8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:51.592520 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 781/1534] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:19:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:19:51.598480 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca7296-4c2b-4a65-8873-7098af246cd1 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:51.598925 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca7296-4c2b-4a65-8873-7098af246cd1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:51.599068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ca7296-4c2b-4a65-8873-7098af246cd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:51.616894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f7ca7296-4c2b-4a65-8873-7098af246cd1 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:51.618097 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f7ca7296-4c2b-4a65-8873-7098af246cd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:51.625747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 754/1535] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:19:51 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:19:51.896595 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edfd87-8707-4569-bfd9-0a76ed81b5c8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:51.898250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-82edfd87-8707-4569-bfd9-0a76ed81b5c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:51.953388 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82edfd87-8707-4569-bfd9-0a76ed81b5c8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:51.957471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2d07f1b-b4ac-4485-b3ad-3949957ab9b2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:51.958106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d07f1b-b4ac-4485-b3ad-3949957ab9b2 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:51.958390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d07f1b-b4ac-4485-b3ad-3949957ab9b2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:51.958666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2d07f1b-b4ac-4485-b3ad-3949957ab9b2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:51.967340 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d07f1b-b4ac-4485-b3ad-3949957ab9b2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:51.968753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2d07f1b-b4ac-4485-b3ad-3949957ab9b2 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:51.978009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 782/1536] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:19:51 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:19:54.175321 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9427dd-07ce-47fd-953c-29aaf60a9b45 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:54.175800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9427dd-07ce-47fd-953c-29aaf60a9b45 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:54.175907 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9427dd-07ce-47fd-953c-29aaf60a9b45 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:54.177285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 755/1537] 127.0.0.1 () {54 vars in 916 bytes} [Thu May 26 18:19:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:19:54.182762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dde8af-f275-4b1d-857b-f7924899086e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:54.183224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dde8af-f275-4b1d-857b-f7924899086e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:54.183322 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0dde8af-f275-4b1d-857b-f7924899086e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:54.202547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c0dde8af-f275-4b1d-857b-f7924899086e None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:19:54.203750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c0dde8af-f275-4b1d-857b-f7924899086e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:54.211547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 783/1538] 127.0.0.1 () {58 vars in 1013 bytes} [Thu May 26 18:19:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:19:54.482819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9427dd-07ce-47fd-953c-29aaf60a9b45 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:19:54.484471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fb9427dd-07ce-47fd-953c-29aaf60a9b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:19:54.497456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9427dd-07ce-47fd-953c-29aaf60a9b45 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:19:54.501004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c97259c9-cf76-4e02-888d-1147178a3526 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:19:54.501660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97259c9-cf76-4e02-888d-1147178a3526 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:19:54.501947 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97259c9-cf76-4e02-888d-1147178a3526 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:19:54.502228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c97259c9-cf76-4e02-888d-1147178a3526 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:19:54.510976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97259c9-cf76-4e02-888d-1147178a3526 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:19:54.512398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c97259c9-cf76-4e02-888d-1147178a3526 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:19:54.522177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 756/1539] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:19:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:20:04.195826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=32 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:20:04.518195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=70 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:34.888600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e3a90-ac10-4bab-856c-ac21c132cc7b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:34.889258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e3a90-ac10-4bab-856c-ac21c132cc7b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:34.889258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee8e3a90-ac10-4bab-856c-ac21c132cc7b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:34.917698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ee8e3a90-ac10-4bab-856c-ac21c132cc7b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:34.919271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ee8e3a90-ac10-4bab-856c-ac21c132cc7b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:34.922928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a1d2e-028f-4ed8-b2c6-37faa92a2665 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:34.923949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a1d2e-028f-4ed8-b2c6-37faa92a2665 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:34.924467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a64a1d2e-028f-4ed8-b2c6-37faa92a2665 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:34.933853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 784/1540] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 46 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:34.944282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813575b-100e-42f6-b78f-b9ea91a87ee6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:34.944598 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813575b-100e-42f6-b78f-b9ea91a87ee6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:34.944848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4813575b-100e-42f6-b78f-b9ea91a87ee6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:34.963232 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a64a1d2e-028f-4ed8-b2c6-37faa92a2665 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:34.964830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a64a1d2e-028f-4ed8-b2c6-37faa92a2665 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:34.969738 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4813575b-100e-42f6-b78f-b9ea91a87ee6 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:34.971434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4813575b-100e-42f6-b78f-b9ea91a87ee6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:34.982133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 757/1541] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 26 18:21:34.987806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 785/1542] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:21:34.992897 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813575b-100e-42f6-b78f-b9ea91a87ee6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:34.993379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c554c-c867-424a-bcfe-93f6ec49e7b9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:34.993892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c554c-c867-424a-bcfe-93f6ec49e7b9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:34.994392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3c554c-c867-424a-bcfe-93f6ec49e7b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.014091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4813575b-100e-42f6-b78f-b9ea91a87ee6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.022156 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-1a3c554c-c867-424a-bcfe-93f6ec49e7b9 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:35.023741 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1a3c554c-c867-424a-bcfe-93f6ec49e7b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:35.029014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3365bc69-98bd-4820-9ac4-814c3195a3ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.029014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365bc69-98bd-4820-9ac4-814c3195a3ac admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.029014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365bc69-98bd-4820-9ac4-814c3195a3ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.029014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3365bc69-98bd-4820-9ac4-814c3195a3ac admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.029481 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365bc69-98bd-4820-9ac4-814c3195a3ac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:21:35.029481 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365bc69-98bd-4820-9ac4-814c3195a3ac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.030689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3365bc69-98bd-4820-9ac4-814c3195a3ac admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.047080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 758/1543] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:35.048820 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05bd7a-29e7-427f-90f0-c4ca3f081e1d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.049364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05bd7a-29e7-427f-90f0-c4ca3f081e1d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.049887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df05bd7a-29e7-427f-90f0-c4ca3f081e1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.059510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 786/1544] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:21:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 67 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:21:35.061192 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4a8e9-8f7d-417a-924f-6e798fc61b0e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.061872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4a8e9-8f7d-417a-924f-6e798fc61b0e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.062385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf4a8e9-8f7d-417a-924f-6e798fc61b0e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.091546 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-df05bd7a-29e7-427f-90f0-c4ca3f081e1d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:35.093094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-df05bd7a-29e7-427f-90f0-c4ca3f081e1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:35.106591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-adf4a8e9-8f7d-417a-924f-6e798fc61b0e None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:35.107876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-adf4a8e9-8f7d-417a-924f-6e798fc61b0e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:35.108221 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 759/1545] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:35.126586 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05bd7a-29e7-427f-90f0-c4ca3f081e1d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.141098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 787/1546] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:21:35.141098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4a8e9-8f7d-417a-924f-6e798fc61b0e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.150343 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df05bd7a-29e7-427f-90f0-c4ca3f081e1d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.170899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53efb222-e903-454f-88d7-8277a1e49801 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.171974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efb222-e903-454f-88d7-8277a1e49801 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.172483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efb222-e903-454f-88d7-8277a1e49801 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.173012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53efb222-e903-454f-88d7-8277a1e49801 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.174531 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efb222-e903-454f-88d7-8277a1e49801 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:21:35.175062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efb222-e903-454f-88d7-8277a1e49801 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.176303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-53efb222-e903-454f-88d7-8277a1e49801 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required May 26 18:21:35.176303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: warnings.warn(msg) May 26 18:21:35.176303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: May 26 18:21:35.177369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf4a8e9-8f7d-417a-924f-6e798fc61b0e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.177965 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53efb222-e903-454f-88d7-8277a1e49801 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.197859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ba8a04-456b-4d06-aa47-b8aafd23513c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.198543 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba8a04-456b-4d06-aa47-b8aafd23513c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.198831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba8a04-456b-4d06-aa47-b8aafd23513c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.199110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ba8a04-456b-4d06-aa47-b8aafd23513c admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.199817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba8a04-456b-4d06-aa47-b8aafd23513c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.200309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 760/1547] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 91 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:21:35.200844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-b6ba8a04-456b-4d06-aa47-b8aafd23513c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:21:35.200844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: warnings.warn(msg) May 26 18:21:35.200844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: May 26 18:21:35.202182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ba8a04-456b-4d06-aa47-b8aafd23513c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.202482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c05a56-2836-4d00-a5c7-6fc9b85e6aae None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.202984 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c05a56-2836-4d00-a5c7-6fc9b85e6aae None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.203474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3c05a56-2836-4d00-a5c7-6fc9b85e6aae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.244279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c3c05a56-2836-4d00-a5c7-6fc9b85e6aae None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:35.245659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c3c05a56-2836-4d00-a5c7-6fc9b85e6aae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:35.265454 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 788/1548] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/projects => generated 403 bytes in 129 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:35.266838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0ab9c-04de-4023-8998-474ed9178fa6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.267133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0ab9c-04de-4023-8998-474ed9178fa6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.267459 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86c0ab9c-04de-4023-8998-474ed9178fa6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.270473 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 761/1549] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 69 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:35.272134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b1b22-f4d1-470e-b5a3-9d5cf58ed60b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.272134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b1b22-f4d1-470e-b5a3-9d5cf58ed60b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.272916 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-543b1b22-f4d1-470e-b5a3-9d5cf58ed60b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.296892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-86c0ab9c-04de-4023-8998-474ed9178fa6 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:35.297660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-543b1b22-f4d1-470e-b5a3-9d5cf58ed60b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:35.298363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-86c0ab9c-04de-4023-8998-474ed9178fa6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:35.299974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-543b1b22-f4d1-470e-b5a3-9d5cf58ed60b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:35.367470 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 762/1550] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:35.367716 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 789/1551] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:35.368354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b1b22-f4d1-470e-b5a3-9d5cf58ed60b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.368481 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0ab9c-04de-4023-8998-474ed9178fa6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.378600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86c0ab9c-04de-4023-8998-474ed9178fa6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.379702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-543b1b22-f4d1-470e-b5a3-9d5cf58ed60b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.383130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee534c0-9a0f-417a-ba56-b026733694a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.383794 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee534c0-9a0f-417a-ba56-b026733694a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.384076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee534c0-9a0f-417a-ba56-b026733694a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.384196 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b32743-02be-44f0-a0e9-529ac4413eb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.384351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ee534c0-9a0f-417a-ba56-b026733694a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.384768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b32743-02be-44f0-a0e9-529ac4413eb3 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.385068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee534c0-9a0f-417a-ba56-b026733694a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.385200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b32743-02be-44f0-a0e9-529ac4413eb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.385345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b32743-02be-44f0-a0e9-529ac4413eb3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.386020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b32743-02be-44f0-a0e9-529ac4413eb3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.387014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ee534c0-9a0f-417a-ba56-b026733694a4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.387919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60b32743-02be-44f0-a0e9-529ac4413eb3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.411096 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 790/1552] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/users => generated 302 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:35.411096 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee534c0-9a0f-417a-ba56-b026733694a4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.416999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 763/1553] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/projects => generated 385 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:35.416999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232ba2a-2667-4034-a400-46ecf7f88635 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.416999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232ba2a-2667-4034-a400-46ecf7f88635 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.416999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4232ba2a-2667-4034-a400-46ecf7f88635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.421315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ee534c0-9a0f-417a-ba56-b026733694a4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.434567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4232ba2a-2667-4034-a400-46ecf7f88635 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:35.435768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4232ba2a-2667-4034-a400-46ecf7f88635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:35.479161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c626b45d-eaec-4c16-b92b-5324343697b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.479824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626b45d-eaec-4c16-b92b-5324343697b1 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.480358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626b45d-eaec-4c16-b92b-5324343697b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.480634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c626b45d-eaec-4c16-b92b-5324343697b1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.481379 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626b45d-eaec-4c16-b92b-5324343697b1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:21:35.481688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626b45d-eaec-4c16-b92b-5324343697b1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.483317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c626b45d-eaec-4c16-b92b-5324343697b1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.505570 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 764/1554] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:35.505798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 791/1555] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:21:35.505910 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0e217-86d6-42ee-8a3c-3c248af50cc5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.505910 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0e217-86d6-42ee-8a3c-3c248af50cc5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.505910 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0eb0e217-86d6-42ee-8a3c-3c248af50cc5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.506183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d0ec1-6be0-4146-b72b-18e3631c00cb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.506183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d0ec1-6be0-4146-b72b-18e3631c00cb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.506183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f4d0ec1-6be0-4146-b72b-18e3631c00cb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.518886 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0f4d0ec1-6be0-4146-b72b-18e3631c00cb None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:35.520080 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0f4d0ec1-6be0-4146-b72b-18e3631c00cb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:35.520342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0eb0e217-86d6-42ee-8a3c-3c248af50cc5 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:35.521546 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0eb0e217-86d6-42ee-8a3c-3c248af50cc5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:35.527765 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 792/1556] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:35.528513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d0ec1-6be0-4146-b72b-18e3631c00cb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.537755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 765/1557] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:35.537755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3be077-f915-4a29-933e-7cf3fac47182 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.537755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3be077-f915-4a29-933e-7cf3fac47182 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.537755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b3be077-f915-4a29-933e-7cf3fac47182 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.538966 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f4d0ec1-6be0-4146-b72b-18e3631c00cb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.543684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ea866-a2df-4c3b-bc39-4a1b53118a8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.544341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea866-a2df-4c3b-bc39-4a1b53118a8f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.544623 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea866-a2df-4c3b-bc39-4a1b53118a8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.544896 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52ea866-a2df-4c3b-bc39-4a1b53118a8f admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.545666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ea866-a2df-4c3b-bc39-4a1b53118a8f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:21:35.545970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ea866-a2df-4c3b-bc39-4a1b53118a8f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.547551 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a52ea866-a2df-4c3b-bc39-4a1b53118a8f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.556173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2b3be077-f915-4a29-933e-7cf3fac47182 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:35.557405 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2b3be077-f915-4a29-933e-7cf3fac47182 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:35.559694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 793/1558] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:21:35.560464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ea866-a2df-4c3b-bc39-4a1b53118a8f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.565363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:35.565591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 766/1559] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:35.566353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3be077-f915-4a29-933e-7cf3fac47182 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.570969 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a52ea866-a2df-4c3b-bc39-4a1b53118a8f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.575742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b3be077-f915-4a29-933e-7cf3fac47182 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.577444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4eb6d0-d64a-4073-93c0-e0ea060d0969 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.578285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4eb6d0-d64a-4073-93c0-e0ea060d0969 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.578572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4eb6d0-d64a-4073-93c0-e0ea060d0969 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.578853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e4eb6d0-d64a-4073-93c0-e0ea060d0969 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.579578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4eb6d0-d64a-4073-93c0-e0ea060d0969 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.580510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f205804-758e-425d-8e04-3accf33469fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.581190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f205804-758e-425d-8e04-3accf33469fc admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.581472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f205804-758e-425d-8e04-3accf33469fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.581579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e4eb6d0-d64a-4073-93c0-e0ea060d0969 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.581746 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f205804-758e-425d-8e04-3accf33469fc admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.582421 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f205804-758e-425d-8e04-3accf33469fc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.583431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-4f205804-758e-425d-8e04-3accf33469fc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:21:35.583431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: warnings.warn(msg) May 26 18:21:35.583431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: May 26 18:21:35.584627 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f205804-758e-425d-8e04-3accf33469fc admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.592312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 794/1560] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:35.593103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4eb6d0-d64a-4073-93c0-e0ea060d0969 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.605962 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e4eb6d0-d64a-4073-93c0-e0ea060d0969 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.610673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-853f26c3-97f2-4925-be3c-cd55c1eb2d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.611912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f26c3-97f2-4925-be3c-cd55c1eb2d75 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.612197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f26c3-97f2-4925-be3c-cd55c1eb2d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.612300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 767/1561] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/users => generated 293 bytes in 43 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:35.612481 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-853f26c3-97f2-4925-be3c-cd55c1eb2d75 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.613191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f26c3-97f2-4925-be3c-cd55c1eb2d75 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.613608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf8e4a-e155-4043-8e7a-8e9f0a295ec5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.613895 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf8e4a-e155-4043-8e7a-8e9f0a295ec5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.614179 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fcf8e4a-e155-4043-8e7a-8e9f0a295ec5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.615078 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-853f26c3-97f2-4925-be3c-cd55c1eb2d75 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.631707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3fcf8e4a-e155-4043-8e7a-8e9f0a295ec5 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:35.632867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3fcf8e4a-e155-4043-8e7a-8e9f0a295ec5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:35.640486 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 768/1562] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:35.641859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a1eb-7b4a-483e-b058-b10d40f1c168 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.642090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 795/1563] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:35.642220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a1eb-7b4a-483e-b058-b10d40f1c168 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.642434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d8a1eb-7b4a-483e-b058-b10d40f1c168 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.643982 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef9997-074a-421f-9f5e-356e09226221 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.644446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef9997-074a-421f-9f5e-356e09226221 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.644735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26ef9997-074a-421f-9f5e-356e09226221 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.650147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:35.663854 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-96d8a1eb-7b4a-483e-b058-b10d40f1c168 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:35.664455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-26ef9997-074a-421f-9f5e-356e09226221 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:35.664978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-96d8a1eb-7b4a-483e-b058-b10d40f1c168 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:35.665677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-26ef9997-074a-421f-9f5e-356e09226221 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:35.723085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 769/1564] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:35.723927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a1eb-7b4a-483e-b058-b10d40f1c168 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.728244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 796/1565] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:35.729485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef9997-074a-421f-9f5e-356e09226221 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.734064 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d8a1eb-7b4a-483e-b058-b10d40f1c168 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.739511 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e13e3a-9651-476e-9e6a-ff35e31f6eb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.740162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e13e3a-9651-476e-9e6a-ff35e31f6eb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.740449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e13e3a-9651-476e-9e6a-ff35e31f6eb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.740729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14e13e3a-9651-476e-9e6a-ff35e31f6eb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.741339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26ef9997-074a-421f-9f5e-356e09226221 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.741488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e13e3a-9651-476e-9e6a-ff35e31f6eb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:21:35.741801 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e13e3a-9651-476e-9e6a-ff35e31f6eb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.743409 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14e13e3a-9651-476e-9e6a-ff35e31f6eb6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.745846 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2da68d-2e90-46e2-93bb-921ad26511e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.746476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da68d-2e90-46e2-93bb-921ad26511e7 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.746753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da68d-2e90-46e2-93bb-921ad26511e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.747043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a2da68d-2e90-46e2-93bb-921ad26511e7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.747698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2da68d-2e90-46e2-93bb-921ad26511e7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.749607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a2da68d-2e90-46e2-93bb-921ad26511e7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.754743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 770/1566] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:21:35.755532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e13e3a-9651-476e-9e6a-ff35e31f6eb6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.765281 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14e13e3a-9651-476e-9e6a-ff35e31f6eb6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.770862 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e4459-3b46-4157-be94-58604b68aab3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.771572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e4459-3b46-4157-be94-58604b68aab3 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.771796 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e4459-3b46-4157-be94-58604b68aab3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.772077 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-676e4459-3b46-4157-be94-58604b68aab3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.772788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e4459-3b46-4157-be94-58604b68aab3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.774415 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-676e4459-3b46-4157-be94-58604b68aab3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.775242 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 797/1567] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/projects => generated 387 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:35.776068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2da68d-2e90-46e2-93bb-921ad26511e7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.788621 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 771/1568] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:35.789532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e4459-3b46-4157-be94-58604b68aab3 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.799397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-676e4459-3b46-4157-be94-58604b68aab3 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.841409 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a2da68d-2e90-46e2-93bb-921ad26511e7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.846661 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bfbb2-291c-4b57-b261-e5b687deddb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.847330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bfbb2-291c-4b57-b261-e5b687deddb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.847617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bfbb2-291c-4b57-b261-e5b687deddb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.847897 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f8bfbb2-291c-4b57-b261-e5b687deddb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.848744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8bfbb2-291c-4b57-b261-e5b687deddb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.850404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f8bfbb2-291c-4b57-b261-e5b687deddb1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.855671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac336fe1-e3df-415f-9b1a-ff5490ebbb8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.856356 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac336fe1-e3df-415f-9b1a-ff5490ebbb8c admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.856637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac336fe1-e3df-415f-9b1a-ff5490ebbb8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.856909 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac336fe1-e3df-415f-9b1a-ff5490ebbb8c admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.857653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac336fe1-e3df-415f-9b1a-ff5490ebbb8c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:21:35.857961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac336fe1-e3df-415f-9b1a-ff5490ebbb8c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.859538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac336fe1-e3df-415f-9b1a-ff5490ebbb8c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.860943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 798/1569] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:35.862318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bfbb2-291c-4b57-b261-e5b687deddb1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.873010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f8bfbb2-291c-4b57-b261-e5b687deddb1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.874396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 772/1570] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:21:35.875285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac336fe1-e3df-415f-9b1a-ff5490ebbb8c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.880350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116b54d-042a-4df8-8ebb-9fb84dedeea9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.882126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116b54d-042a-4df8-8ebb-9fb84dedeea9 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.882414 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116b54d-042a-4df8-8ebb-9fb84dedeea9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.882690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3116b54d-042a-4df8-8ebb-9fb84dedeea9 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.883366 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116b54d-042a-4df8-8ebb-9fb84dedeea9 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.885311 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3116b54d-042a-4df8-8ebb-9fb84dedeea9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.885678 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac336fe1-e3df-415f-9b1a-ff5490ebbb8c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.890288 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb95d7b-1e6c-4ba1-a656-2451644fe4f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.890945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb95d7b-1e6c-4ba1-a656-2451644fe4f5 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.891209 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb95d7b-1e6c-4ba1-a656-2451644fe4f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.891487 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb95d7b-1e6c-4ba1-a656-2451644fe4f5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.892192 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb95d7b-1e6c-4ba1-a656-2451644fe4f5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:21:35.893060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb95d7b-1e6c-4ba1-a656-2451644fe4f5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.894639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb95d7b-1e6c-4ba1-a656-2451644fe4f5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.906566 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 773/1571] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:21:35.910791 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 799/1572] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/users => generated 288 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:35.911328 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb95d7b-1e6c-4ba1-a656-2451644fe4f5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.911436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116b54d-042a-4df8-8ebb-9fb84dedeea9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.918794 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3116b54d-042a-4df8-8ebb-9fb84dedeea9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.920656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb95d7b-1e6c-4ba1-a656-2451644fe4f5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.923475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7aa33-9262-4968-8637-575cd0eed4d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.924135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7aa33-9262-4968-8637-575cd0eed4d6 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.924418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7aa33-9262-4968-8637-575cd0eed4d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.924691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93b7aa33-9262-4968-8637-575cd0eed4d6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.925395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7aa33-9262-4968-8637-575cd0eed4d6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.925503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c5c52-483e-4e7a-a988-500020725a27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.926323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c5c52-483e-4e7a-a988-500020725a27 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.926709 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c5c52-483e-4e7a-a988-500020725a27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.927071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-603c5c52-483e-4e7a-a988-500020725a27 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.927295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93b7aa33-9262-4968-8637-575cd0eed4d6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.927789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c5c52-483e-4e7a-a988-500020725a27 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:21:35.928102 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c5c52-483e-4e7a-a988-500020725a27 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.929730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-603c5c52-483e-4e7a-a988-500020725a27 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.941325 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 774/1573] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:21:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:21:35.942092 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c5c52-483e-4e7a-a988-500020725a27 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.951327 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-603c5c52-483e-4e7a-a988-500020725a27 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:35.956494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816586a-3704-4ca2-b924-e58d800b96e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:35.957194 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816586a-3704-4ca2-b924-e58d800b96e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:35.957478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816586a-3704-4ca2-b924-e58d800b96e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:35.957753 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c816586a-3704-4ca2-b924-e58d800b96e1 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:35.958425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816586a-3704-4ca2-b924-e58d800b96e1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:35.963124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 800/1574] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:35.963281 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c816586a-3704-4ca2-b924-e58d800b96e1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:35.963389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7aa33-9262-4968-8637-575cd0eed4d6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.966343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:35.980580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 775/1575] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:21:35 2022] POST /identity/v3/users => generated 294 bytes in 39 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:35.981310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816586a-3704-4ca2-b924-e58d800b96e1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:35.990575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c816586a-3704-4ca2-b924-e58d800b96e1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.016361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:36.026331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93b7aa33-9262-4968-8637-575cd0eed4d6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.030879 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38187e28-e572-4210-82f9-c1e5137ba54f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.031761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38187e28-e572-4210-82f9-c1e5137ba54f admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.032049 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38187e28-e572-4210-82f9-c1e5137ba54f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.032343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38187e28-e572-4210-82f9-c1e5137ba54f admin admin] PATH_INFO: `/v3/projects/f5c63069e6a44e01877ad58691297b62/users/cb6ebd49757d475c954973da976f0c67/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.047249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38187e28-e572-4210-82f9-c1e5137ba54f admin admin] RBAC: Authorizing `identity:create_grant(project_id=f5c63069e6a44e01877ad58691297b62, user_id=cb6ebd49757d475c954973da976f0c67, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.048290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-38187e28-e572-4210-82f9-c1e5137ba54f admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:21:36.048290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: warnings.warn(msg) May 26 18:21:36.048290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: May 26 18:21:36.049585 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324de628-f026-4d5e-a60d-327f2d724f29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.050377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38187e28-e572-4210-82f9-c1e5137ba54f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.050502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324de628-f026-4d5e-a60d-327f2d724f29 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.050841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324de628-f026-4d5e-a60d-327f2d724f29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.051213 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-324de628-f026-4d5e-a60d-327f2d724f29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.052094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324de628-f026-4d5e-a60d-327f2d724f29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.053827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-324de628-f026-4d5e-a60d-327f2d724f29 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.063116 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 801/1576] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:35 2022] PUT /identity/v3/projects/f5c63069e6a44e01877ad58691297b62/users/cb6ebd49757d475c954973da976f0c67/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:36.063894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38187e28-e572-4210-82f9-c1e5137ba54f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.064312 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 776/1577] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:35 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:36.065243 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324de628-f026-4d5e-a60d-327f2d724f29 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.076076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-324de628-f026-4d5e-a60d-327f2d724f29 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.127344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38187e28-e572-4210-82f9-c1e5137ba54f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.131842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb36ac-e649-496b-9b04-8e98148ee044 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.132050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4f09b-546d-47fa-82c3-dbdd90fdfad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.132503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb36ac-e649-496b-9b04-8e98148ee044 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.132702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4f09b-546d-47fa-82c3-dbdd90fdfad5 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.132820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb36ac-e649-496b-9b04-8e98148ee044 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.133003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4f09b-546d-47fa-82c3-dbdd90fdfad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.133106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7efb36ac-e649-496b-9b04-8e98148ee044 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.133283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9af4f09b-546d-47fa-82c3-dbdd90fdfad5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.133890 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb36ac-e649-496b-9b04-8e98148ee044 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.134102 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4f09b-546d-47fa-82c3-dbdd90fdfad5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.135734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9af4f09b-546d-47fa-82c3-dbdd90fdfad5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.136045 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7efb36ac-e649-496b-9b04-8e98148ee044 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.146368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 777/1578] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 81 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:36.147073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4f09b-546d-47fa-82c3-dbdd90fdfad5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.156476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9af4f09b-546d-47fa-82c3-dbdd90fdfad5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.161585 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91774d3-4dce-4491-a9ea-75cb874bd462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.162216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91774d3-4dce-4491-a9ea-75cb874bd462 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.162498 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91774d3-4dce-4491-a9ea-75cb874bd462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.162774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b91774d3-4dce-4491-a9ea-75cb874bd462 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.163479 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91774d3-4dce-4491-a9ea-75cb874bd462 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.165420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b91774d3-4dce-4491-a9ea-75cb874bd462 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.166801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 802/1579] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:21:36 2022] POST /identity/v3/projects => generated 365 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:36.167644 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb36ac-e649-496b-9b04-8e98148ee044 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.198695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 778/1580] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:21:36 2022] POST /identity/v3/projects => generated 377 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:36.199431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91774d3-4dce-4491-a9ea-75cb874bd462 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.230422 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7efb36ac-e649-496b-9b04-8e98148ee044 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.246236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:36.260856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b91774d3-4dce-4491-a9ea-75cb874bd462 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.265435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c1fdd-0e0f-44c4-adbf-639b84f622c3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.266108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c1fdd-0e0f-44c4-adbf-639b84f622c3 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.266480 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c1fdd-0e0f-44c4-adbf-639b84f622c3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.266760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-652c1fdd-0e0f-44c4-adbf-639b84f622c3 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.267509 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c1fdd-0e0f-44c4-adbf-639b84f622c3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.269957 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-652c1fdd-0e0f-44c4-adbf-639b84f622c3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.287257 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2a573db-fe65-4fa9-8017-56776ed077f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.287923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a573db-fe65-4fa9-8017-56776ed077f9 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.288210 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a573db-fe65-4fa9-8017-56776ed077f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.288499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2a573db-fe65-4fa9-8017-56776ed077f9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.289214 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a573db-fe65-4fa9-8017-56776ed077f9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.292434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 779/1581] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:21:36 2022] POST /identity/v3/users => generated 292 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:36.292434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c1fdd-0e0f-44c4-adbf-639b84f622c3 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.292656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2a573db-fe65-4fa9-8017-56776ed077f9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.299958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-652c1fdd-0e0f-44c4-adbf-639b84f622c3 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.304491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b9b4c-b7eb-4c07-b515-f8cc4eb9f200 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.305155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b9b4c-b7eb-4c07-b515-f8cc4eb9f200 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.305439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b9b4c-b7eb-4c07-b515-f8cc4eb9f200 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.305715 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-506b9b4c-b7eb-4c07-b515-f8cc4eb9f200 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.306423 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b9b4c-b7eb-4c07-b515-f8cc4eb9f200 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.308002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-506b9b4c-b7eb-4c07-b515-f8cc4eb9f200 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.317502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 803/1582] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:21:36 2022] POST /identity/v3/projects => generated 365 bytes in 150 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:36.321977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 780/1583] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:36.321977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b9b4c-b7eb-4c07-b515-f8cc4eb9f200 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.322209 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a65ec2-972a-439a-bdc2-20942e971b8b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.322209 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a65ec2-972a-439a-bdc2-20942e971b8b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.322393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06a65ec2-972a-439a-bdc2-20942e971b8b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.332047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-506b9b4c-b7eb-4c07-b515-f8cc4eb9f200 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.339175 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-06a65ec2-972a-439a-bdc2-20942e971b8b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:36.340358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-06a65ec2-972a-439a-bdc2-20942e971b8b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:36.343977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:36.389349 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b13a3-ef4a-45d8-8589-6ac303ce5193 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.390337 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b13a3-ef4a-45d8-8589-6ac303ce5193 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.391215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b13a3-ef4a-45d8-8589-6ac303ce5193 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.391519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e81b13a3-ef4a-45d8-8589-6ac303ce5193 admin admin] PATH_INFO: `/v3/projects/0d44a99c284744069fb1f97f9c9649f0/users/4f1948e8724647bd893015835a50d8db/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.398340 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 804/1584] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:36.401638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a65ec2-972a-439a-bdc2-20942e971b8b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.407118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b13a3-ef4a-45d8-8589-6ac303ce5193 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d44a99c284744069fb1f97f9c9649f0, user_id=4f1948e8724647bd893015835a50d8db, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.409011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06a65ec2-972a-439a-bdc2-20942e971b8b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.410183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e81b13a3-ef4a-45d8-8589-6ac303ce5193 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.413883 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71ce34-366a-4431-94eb-f536d5ff6824 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.414615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71ce34-366a-4431-94eb-f536d5ff6824 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.414970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71ce34-366a-4431-94eb-f536d5ff6824 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.415278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad71ce34-366a-4431-94eb-f536d5ff6824 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.416159 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71ce34-366a-4431-94eb-f536d5ff6824 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.417899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad71ce34-366a-4431-94eb-f536d5ff6824 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.422976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 781/1585] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:36 2022] PUT /identity/v3/projects/0d44a99c284744069fb1f97f9c9649f0/users/4f1948e8724647bd893015835a50d8db/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 102 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:36.423787 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b13a3-ef4a-45d8-8589-6ac303ce5193 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.429144 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 805/1586] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:36.429885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71ce34-366a-4431-94eb-f536d5ff6824 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.440121 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad71ce34-366a-4431-94eb-f536d5ff6824 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.483335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e81b13a3-ef4a-45d8-8589-6ac303ce5193 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.487923 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344843f-afcd-4605-9ff5-292f4db4f61a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.488587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344843f-afcd-4605-9ff5-292f4db4f61a admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.488862 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344843f-afcd-4605-9ff5-292f4db4f61a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.489173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5344843f-afcd-4605-9ff5-292f4db4f61a admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.489852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344843f-afcd-4605-9ff5-292f4db4f61a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.491760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5344843f-afcd-4605-9ff5-292f4db4f61a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.498666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fa921-b166-447c-ba10-0deb0cf193bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.499741 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fa921-b166-447c-ba10-0deb0cf193bd admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.499942 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fa921-b166-447c-ba10-0deb0cf193bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.500223 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e6fa921-b166-447c-ba10-0deb0cf193bd admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.501007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6fa921-b166-447c-ba10-0deb0cf193bd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.503517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e6fa921-b166-447c-ba10-0deb0cf193bd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.511521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 782/1587] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:21:36 2022] POST /identity/v3/users => generated 283 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:36.512209 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344843f-afcd-4605-9ff5-292f4db4f61a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.523862 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5344843f-afcd-4605-9ff5-292f4db4f61a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.528168 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 806/1588] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:21:36 2022] POST /identity/v3/users => generated 289 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:36.528168 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fa921-b166-447c-ba10-0deb0cf193bd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.528495 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcff054-08d1-4580-a8df-91969a724820 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.529173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff054-08d1-4580-a8df-91969a724820 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.529452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff054-08d1-4580-a8df-91969a724820 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.529725 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebcff054-08d1-4580-a8df-91969a724820 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.530436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcff054-08d1-4580-a8df-91969a724820 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.532022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ebcff054-08d1-4580-a8df-91969a724820 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.535953 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e6fa921-b166-447c-ba10-0deb0cf193bd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.541601 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a197e7c-870d-4167-aec9-2afe1945d735 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.542090 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 783/1589] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:36.542465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a197e7c-870d-4167-aec9-2afe1945d735 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.542749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a197e7c-870d-4167-aec9-2afe1945d735 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.542867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcff054-08d1-4580-a8df-91969a724820 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.543111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a197e7c-870d-4167-aec9-2afe1945d735 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.543723 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a197e7c-870d-4167-aec9-2afe1945d735 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.545840 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a197e7c-870d-4167-aec9-2afe1945d735 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.552271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ebcff054-08d1-4580-a8df-91969a724820 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.557845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2735166e-1380-48c8-a3b2-8a06532892ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.558572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735166e-1380-48c8-a3b2-8a06532892ad admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.558853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735166e-1380-48c8-a3b2-8a06532892ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.559154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2735166e-1380-48c8-a3b2-8a06532892ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.559939 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735166e-1380-48c8-a3b2-8a06532892ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.561760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2735166e-1380-48c8-a3b2-8a06532892ad admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.566377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 807/1590] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:21:36 2022] POST /identity/v3/users => generated 283 bytes in 41 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:36.567273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a197e7c-870d-4167-aec9-2afe1945d735 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.575061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 784/1591] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:36.578537 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:36.578671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e16d-c216-40d3-a2a5-84bfdecadd15 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.578671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e16d-c216-40d3-a2a5-84bfdecadd15 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.578671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8e9e16d-c216-40d3-a2a5-84bfdecadd15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.594406 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b8e9e16d-c216-40d3-a2a5-84bfdecadd15 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:36.595919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b8e9e16d-c216-40d3-a2a5-84bfdecadd15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:36.603823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 785/1592] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:36.607192 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e16d-c216-40d3-a2a5-84bfdecadd15 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.614570 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8e9e16d-c216-40d3-a2a5-84bfdecadd15 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.619211 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4e803-4383-4f26-aac5-6a4e73f9ed25 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.620112 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4e803-4383-4f26-aac5-6a4e73f9ed25 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.620394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4e803-4383-4f26-aac5-6a4e73f9ed25 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.620667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5be4e803-4383-4f26-aac5-6a4e73f9ed25 admin admin] PATH_INFO: `/v3/projects/be2b13dd00dd45e3aae6a231b8e60a1c/users/b2d13c401ad84870a8d76d49a8054056/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.631097 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a197e7c-870d-4167-aec9-2afe1945d735 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.634677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9928db4-8d82-4384-a0c2-c18020d64a90 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.635317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9928db4-8d82-4384-a0c2-c18020d64a90 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.635607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4e803-4383-4f26-aac5-6a4e73f9ed25 admin admin] RBAC: Authorizing `identity:create_grant(project_id=be2b13dd00dd45e3aae6a231b8e60a1c, user_id=b2d13c401ad84870a8d76d49a8054056, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.635742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9928db4-8d82-4384-a0c2-c18020d64a90 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.635874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9928db4-8d82-4384-a0c2-c18020d64a90 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.638326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5be4e803-4383-4f26-aac5-6a4e73f9ed25 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.645959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9928db4-8d82-4384-a0c2-c18020d64a90 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.647538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9928db4-8d82-4384-a0c2-c18020d64a90 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.652184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 786/1593] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:36 2022] PUT /identity/v3/projects/be2b13dd00dd45e3aae6a231b8e60a1c/users/b2d13c401ad84870a8d76d49a8054056/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:36.653868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4e803-4383-4f26-aac5-6a4e73f9ed25 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.657632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 808/1594] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:36.658487 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9928db4-8d82-4384-a0c2-c18020d64a90 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.667697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9928db4-8d82-4384-a0c2-c18020d64a90 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.699256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:36.724163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5be4e803-4383-4f26-aac5-6a4e73f9ed25 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.728785 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94b96e-d3eb-4869-8e1a-6fbd3ec4723c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.729101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66321512-51e3-4253-b97b-76482936db17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.729720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94b96e-d3eb-4869-8e1a-6fbd3ec4723c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.729830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66321512-51e3-4253-b97b-76482936db17 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.730309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66321512-51e3-4253-b97b-76482936db17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.730534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94b96e-d3eb-4869-8e1a-6fbd3ec4723c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.730720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66321512-51e3-4253-b97b-76482936db17 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.731044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d94b96e-d3eb-4869-8e1a-6fbd3ec4723c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.731330 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66321512-51e3-4253-b97b-76482936db17 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.731973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94b96e-d3eb-4869-8e1a-6fbd3ec4723c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.732970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66321512-51e3-4253-b97b-76482936db17 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.733944 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d94b96e-d3eb-4869-8e1a-6fbd3ec4723c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.745060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 787/1595] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:36.748299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 809/1596] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:36.748299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94b96e-d3eb-4869-8e1a-6fbd3ec4723c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.748955 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66321512-51e3-4253-b97b-76482936db17 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.759353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d94b96e-d3eb-4869-8e1a-6fbd3ec4723c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.762624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66321512-51e3-4253-b97b-76482936db17 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.764725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d79dd-7e62-46e0-974e-7645697d4035 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.765526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d79dd-7e62-46e0-974e-7645697d4035 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.765965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d79dd-7e62-46e0-974e-7645697d4035 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.766383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e22d79dd-7e62-46e0-974e-7645697d4035 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.767149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d79dd-7e62-46e0-974e-7645697d4035 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.767438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bf7e5-3dbf-4f85-8951-c48f73412f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.768103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bf7e5-3dbf-4f85-8951-c48f73412f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.768385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bf7e5-3dbf-4f85-8951-c48f73412f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.768659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-983bf7e5-3dbf-4f85-8951-c48f73412f8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.768845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e22d79dd-7e62-46e0-974e-7645697d4035 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.769422 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bf7e5-3dbf-4f85-8951-c48f73412f8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.771004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-983bf7e5-3dbf-4f85-8951-c48f73412f8a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.782978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 810/1597] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:36.782978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d79dd-7e62-46e0-974e-7645697d4035 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.783344 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 788/1598] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:36.784072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bf7e5-3dbf-4f85-8951-c48f73412f8a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.795942 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e22d79dd-7e62-46e0-974e-7645697d4035 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.801960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eaf64b-cb1e-4d74-88b1-0028be298216 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.802877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaf64b-cb1e-4d74-88b1-0028be298216 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.803158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaf64b-cb1e-4d74-88b1-0028be298216 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.803433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eaf64b-cb1e-4d74-88b1-0028be298216 admin admin] PATH_INFO: `/v3/projects/965c959e78ab4d17ad6b86d20a9e7b0e/users/301f5bb1404040d2b7e5c9b55312d515/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.820291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eaf64b-cb1e-4d74-88b1-0028be298216 admin admin] RBAC: Authorizing `identity:create_grant(project_id=965c959e78ab4d17ad6b86d20a9e7b0e, user_id=301f5bb1404040d2b7e5c9b55312d515, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.823239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2eaf64b-cb1e-4d74-88b1-0028be298216 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.838844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 811/1599] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:36 2022] PUT /identity/v3/projects/965c959e78ab4d17ad6b86d20a9e7b0e/users/301f5bb1404040d2b7e5c9b55312d515/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:36.840147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f93e6f-3d7b-42c9-8e03-037e2abc7058 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.840508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f93e6f-3d7b-42c9-8e03-037e2abc7058 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.840793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7f93e6f-3d7b-42c9-8e03-037e2abc7058 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.870361 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e7f93e6f-3d7b-42c9-8e03-037e2abc7058 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:36.871596 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e7f93e6f-3d7b-42c9-8e03-037e2abc7058 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:36.878313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-983bf7e5-3dbf-4f85-8951-c48f73412f8a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.938243 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b6666-9ce4-43e2-821d-abf314c1d496 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.938916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 812/1600] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:36.939946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6666-9ce4-43e2-821d-abf314c1d496 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.939946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6666-9ce4-43e2-821d-abf314c1d496 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.940230 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f93e6f-3d7b-42c9-8e03-037e2abc7058 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.940351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7b6666-9ce4-43e2-821d-abf314c1d496 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.952891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7f93e6f-3d7b-42c9-8e03-037e2abc7058 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.953120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b6666-9ce4-43e2-821d-abf314c1d496 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.954564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7b6666-9ce4-43e2-821d-abf314c1d496 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.958399 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a87511-655b-4c0e-b8a1-3d717c852d60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.959331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a87511-655b-4c0e-b8a1-3d717c852d60 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.959861 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a87511-655b-4c0e-b8a1-3d717c852d60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.960499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7a87511-655b-4c0e-b8a1-3d717c852d60 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.961503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a87511-655b-4c0e-b8a1-3d717c852d60 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.963975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7a87511-655b-4c0e-b8a1-3d717c852d60 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.965515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 789/1601] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 182 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:36.966409 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b6666-9ce4-43e2-821d-abf314c1d496 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.974608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:36.977902 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7b6666-9ce4-43e2-821d-abf314c1d496 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:36.980829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 813/1602] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:36.981864 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a87511-655b-4c0e-b8a1-3d717c852d60 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:36.989215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fd4f5-235c-45d0-b802-02c27d66d67e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:36.989810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fd4f5-235c-45d0-b802-02c27d66d67e admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:36.990095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fd4f5-235c-45d0-b802-02c27d66d67e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:36.990908 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5fd4f5-235c-45d0-b802-02c27d66d67e admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:36.991874 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fd4f5-235c-45d0-b802-02c27d66d67e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:36.993848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d5fd4f5-235c-45d0-b802-02c27d66d67e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:36.994572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7a87511-655b-4c0e-b8a1-3d717c852d60 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:37.002864 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7396f36e-e1a1-4d85-aa8b-89d4a1635438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:37.003717 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f36e-e1a1-4d85-aa8b-89d4a1635438 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:37.004063 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f36e-e1a1-4d85-aa8b-89d4a1635438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:37.004416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7396f36e-e1a1-4d85-aa8b-89d4a1635438 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:37.005362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396f36e-e1a1-4d85-aa8b-89d4a1635438 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:37.007119 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 790/1603] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:37.008080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fd4f5-235c-45d0-b802-02c27d66d67e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:37.009948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7396f36e-e1a1-4d85-aa8b-89d4a1635438 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:37.032208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d5fd4f5-235c-45d0-b802-02c27d66d67e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:37.033750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 814/1604] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:36 2022] GET /identity/v3/roles => generated 1420 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:37.035866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b0995-e031-4de3-aa02-d924a87d1ad2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:37.036880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b0995-e031-4de3-aa02-d924a87d1ad2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:37.037981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b0995-e031-4de3-aa02-d924a87d1ad2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:37.043904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ef886-580c-4be7-8e1a-0c8bc775d5eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:37.044901 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef886-580c-4be7-8e1a-0c8bc775d5eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:37.045257 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef886-580c-4be7-8e1a-0c8bc775d5eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:37.045935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391ef886-580c-4be7-8e1a-0c8bc775d5eb admin admin] PATH_INFO: `/v3/projects/8f763b2938124a8e941c075770df5704/users/a07b3f7297064a829104a585472eb10e/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:37.073759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ef886-580c-4be7-8e1a-0c8bc775d5eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=8f763b2938124a8e941c075770df5704, user_id=a07b3f7297064a829104a585472eb10e, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:37.076765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-391ef886-580c-4be7-8e1a-0c8bc775d5eb admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:37.082923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-831b0995-e031-4de3-aa02-d924a87d1ad2 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:37.084545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-831b0995-e031-4de3-aa02-d924a87d1ad2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:37.096521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 791/1605] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:37 2022] PUT /identity/v3/projects/8f763b2938124a8e941c075770df5704/users/a07b3f7297064a829104a585472eb10e/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 89 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:37.099228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ef886-580c-4be7-8e1a-0c8bc775d5eb admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:37.103771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-391ef886-580c-4be7-8e1a-0c8bc775d5eb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:37.198811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:37.209962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391ef886-580c-4be7-8e1a-0c8bc775d5eb admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:37.220035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156add6-3d4d-4897-897b-e1d587e943f0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:37.221955 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156add6-3d4d-4897-897b-e1d587e943f0 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:37.222305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156add6-3d4d-4897-897b-e1d587e943f0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:37.222589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3156add6-3d4d-4897-897b-e1d587e943f0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:37.229840 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 815/1606] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:37.231466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b0995-e031-4de3-aa02-d924a87d1ad2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:37.239098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156add6-3d4d-4897-897b-e1d587e943f0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:37.242545 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3156add6-3d4d-4897-897b-e1d587e943f0 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:37.252439 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b0995-e031-4de3-aa02-d924a87d1ad2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:37.259671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 792/1607] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 161 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:37.261198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156add6-3d4d-4897-897b-e1d587e943f0 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:37.264841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5451142-73e5-4e15-bafa-7cb7f7dcdc7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:37.265937 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5451142-73e5-4e15-bafa-7cb7f7dcdc7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:37.266046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5451142-73e5-4e15-bafa-7cb7f7dcdc7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:37.268878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5451142-73e5-4e15-bafa-7cb7f7dcdc7c admin admin] PATH_INFO: `/v3/projects/7ad0456f492447268046fd6c7b112ce3/users/2a7dbd3208a74fcfb443f9b5b8546929/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:37.284172 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3156add6-3d4d-4897-897b-e1d587e943f0 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:37.295323 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5451142-73e5-4e15-bafa-7cb7f7dcdc7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=7ad0456f492447268046fd6c7b112ce3, user_id=2a7dbd3208a74fcfb443f9b5b8546929, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:37.296646 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e0adef-a787-403f-a08e-580be4280d7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:37.297857 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0adef-a787-403f-a08e-580be4280d7b admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:37.297857 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0adef-a787-403f-a08e-580be4280d7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:37.298090 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e0adef-a787-403f-a08e-580be4280d7b admin admin] PATH_INFO: `/v3/projects/0f43909270b841ff86969e55949c213b/users/f85ef7eb24b14d41a72e5e1ef0c96e70/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:37.304516 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5451142-73e5-4e15-bafa-7cb7f7dcdc7c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:37.321361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0adef-a787-403f-a08e-580be4280d7b admin admin] RBAC: Authorizing `identity:create_grant(project_id=0f43909270b841ff86969e55949c213b, user_id=f85ef7eb24b14d41a72e5e1ef0c96e70, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:37.326982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e0adef-a787-403f-a08e-580be4280d7b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:37.327180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 816/1608] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:37 2022] PUT /identity/v3/projects/7ad0456f492447268046fd6c7b112ce3/users/2a7dbd3208a74fcfb443f9b5b8546929/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:37.328278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5451142-73e5-4e15-bafa-7cb7f7dcdc7c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:37.353652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 793/1609] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:37 2022] PUT /identity/v3/projects/0f43909270b841ff86969e55949c213b/users/f85ef7eb24b14d41a72e5e1ef0c96e70/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:37.355683 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bc804-7c19-4aa9-9ac4-8a5477ef77de None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:37.356135 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bc804-7c19-4aa9-9ac4-8a5477ef77de None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:37.356733 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e70bc804-7c19-4aa9-9ac4-8a5477ef77de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:37.392226 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e70bc804-7c19-4aa9-9ac4-8a5477ef77de None None] MFA Rules not processed for user `a07b3f7297064a829104a585472eb10e`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:37.394256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e70bc804-7c19-4aa9-9ac4-8a5477ef77de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:37.422425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5451142-73e5-4e15-bafa-7cb7f7dcdc7c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:37.526740 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565820a6-dfe0-4bf8-9857-e2629f5f2846 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:37.528341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565820a6-dfe0-4bf8-9857-e2629f5f2846 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:37.528632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565820a6-dfe0-4bf8-9857-e2629f5f2846 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:37.528908 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565820a6-dfe0-4bf8-9857-e2629f5f2846 admin admin] PATH_INFO: `/v3/projects/bdf68adb27e049dab85c2111c0a6d789/users/98d97558826649609198cb0c477adb3a/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:37.536956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 794/1610] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:37.538701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bc804-7c19-4aa9-9ac4-8a5477ef77de None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:37.553785 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565820a6-dfe0-4bf8-9857-e2629f5f2846 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bdf68adb27e049dab85c2111c0a6d789, user_id=98d97558826649609198cb0c477adb3a, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:37.557382 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-565820a6-dfe0-4bf8-9857-e2629f5f2846 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:37.560716 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:37.574808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 817/1611] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:37 2022] PUT /identity/v3/projects/bdf68adb27e049dab85c2111c0a6d789/users/98d97558826649609198cb0c477adb3a/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 247 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:37.576240 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774897b2-399f-4ef7-8e86-6f1ff96e4282 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:37.576601 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774897b2-399f-4ef7-8e86-6f1ff96e4282 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:37.577038 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-774897b2-399f-4ef7-8e86-6f1ff96e4282 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:37.641208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e70bc804-7c19-4aa9-9ac4-8a5477ef77de None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:37.644950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-774897b2-399f-4ef7-8e86-6f1ff96e4282 None None] MFA Rules not processed for user `2a7dbd3208a74fcfb443f9b5b8546929`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:37.647079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-774897b2-399f-4ef7-8e86-6f1ff96e4282 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:37.706907 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e80de97-e47c-4dc5-a7e1-f0e105836608 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:37.707863 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80de97-e47c-4dc5-a7e1-f0e105836608 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:37.708305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80de97-e47c-4dc5-a7e1-f0e105836608 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:37.708730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e80de97-e47c-4dc5-a7e1-f0e105836608 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:37.739679 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 818/1612] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:37.741145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaae7fa-29d6-435c-b50e-cc456efdc0e8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:37.741518 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaae7fa-29d6-435c-b50e-cc456efdc0e8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:37.742166 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afaae7fa-29d6-435c-b50e-cc456efdc0e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:37.763067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:37.773655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-afaae7fa-29d6-435c-b50e-cc456efdc0e8 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:37.775401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-afaae7fa-29d6-435c-b50e-cc456efdc0e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:37.837677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80de97-e47c-4dc5-a7e1-f0e105836608 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:37.843372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e80de97-e47c-4dc5-a7e1-f0e105836608 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:37.861976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 819/1613] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:37.864176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2c1fd-ac98-42eb-8045-206bae648614 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:37.864475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2c1fd-ac98-42eb-8045-206bae648614 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:37.865017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e2c1fd-ac98-42eb-8045-206bae648614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:37.874671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 795/1614] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:37 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 337 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:37.876017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e717-8480-447c-9506-b18dfbeba08f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:37.876305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e717-8480-447c-9506-b18dfbeba08f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:37.876585 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e71e717-8480-447c-9506-b18dfbeba08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:37.896759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-51e2c1fd-ac98-42eb-8045-206bae648614 None None] MFA Rules not processed for user `cb6ebd49757d475c954973da976f0c67`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:37.898234 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-51e2c1fd-ac98-42eb-8045-206bae648614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:37.953676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0e71e717-8480-447c-9506-b18dfbeba08f None None] MFA Rules not processed for user `98d97558826649609198cb0c477adb3a`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:37.956519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0e71e717-8480-447c-9506-b18dfbeba08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:38.003547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 820/1615] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:38.006186 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6ac5d-b15e-44c8-aa8b-e4107398c05f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:38.007025 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6ac5d-b15e-44c8-aa8b-e4107398c05f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:38.007605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-baf6ac5d-b15e-44c8-aa8b-e4107398c05f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:38.009669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 821/1616] 10.222.0.64 () {54 vars in 961 bytes} [Thu May 26 18:21:38 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:21:38.010631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6ac5d-b15e-44c8-aa8b-e4107398c05f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:38.046291 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 796/1617] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:37 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:38.047193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71e717-8480-447c-9506-b18dfbeba08f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:38.058065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e71e717-8480-447c-9506-b18dfbeba08f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:38.060578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:38.065024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310a6eb-2ad8-4813-84a6-2a475c9cb68a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:38.065915 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310a6eb-2ad8-4813-84a6-2a475c9cb68a service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:38.066204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310a6eb-2ad8-4813-84a6-2a475c9cb68a service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:38.066505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6310a6eb-2ad8-4813-84a6-2a475c9cb68a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:38.079629 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310a6eb-2ad8-4813-84a6-2a475c9cb68a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:38.082303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6310a6eb-2ad8-4813-84a6-2a475c9cb68a service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:38.097146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 797/1618] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:38.098845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310a6eb-2ad8-4813-84a6-2a475c9cb68a service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:38.111548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6310a6eb-2ad8-4813-84a6-2a475c9cb68a service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:38.118959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b57e098-ee5a-47e4-97c5-acdd919ab444 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:38.119724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e098-ee5a-47e4-97c5-acdd919ab444 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:38.120013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e098-ee5a-47e4-97c5-acdd919ab444 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:38.120305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b57e098-ee5a-47e4-97c5-acdd919ab444 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:38.122067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57e098-ee5a-47e4-97c5-acdd919ab444 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:38.125768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b57e098-ee5a-47e4-97c5-acdd919ab444 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:38.187788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 798/1619] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:21:38 2022] POST /identity/v3/projects => generated 405 bytes in 87 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:38.187966 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-baf6ac5d-b15e-44c8-aa8b-e4107398c05f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:38.188054 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544cc74-1558-44ae-82d3-af45a52a90f4 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:38.188054 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544cc74-1558-44ae-82d3-af45a52a90f4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:38.188054 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8544cc74-1558-44ae-82d3-af45a52a90f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:38.217236 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8544cc74-1558-44ae-82d3-af45a52a90f4 None None] MFA Rules not processed for user `97f259ac2eb4425f8b4dcffeccdcd439`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:38.218838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8544cc74-1558-44ae-82d3-af45a52a90f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:38.288685 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78c472-b808-4b7f-b74b-9bb7e45ab16c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:38.289506 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78c472-b808-4b7f-b74b-9bb7e45ab16c service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:38.290396 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78c472-b808-4b7f-b74b-9bb7e45ab16c service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:38.290684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a78c472-b808-4b7f-b74b-9bb7e45ab16c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:38.316705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 799/1620] 10.222.0.64 () {58 vars in 1058 bytes} [Thu May 26 18:21:38 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:38.318577 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544cc74-1558-44ae-82d3-af45a52a90f4 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:38.338300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:38.430479 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78c472-b808-4b7f-b74b-9bb7e45ab16c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:38.432582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a78c472-b808-4b7f-b74b-9bb7e45ab16c service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:38.461485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 822/1621] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:38 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 451 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:38.463923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78c472-b808-4b7f-b74b-9bb7e45ab16c service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:38.478479 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8544cc74-1558-44ae-82d3-af45a52a90f4 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:38.491240 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c0b9a-978f-4430-9ba7-97f08e05038c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:38.491672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c0b9a-978f-4430-9ba7-97f08e05038c admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:38.492136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c0b9a-978f-4430-9ba7-97f08e05038c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:38.493756 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a78c472-b808-4b7f-b74b-9bb7e45ab16c service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:38.494289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a22c0b9a-978f-4430-9ba7-97f08e05038c admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:38.495186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c0b9a-978f-4430-9ba7-97f08e05038c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:38.498123 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a22c0b9a-978f-4430-9ba7-97f08e05038c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:38.515740 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb476579-04d4-44ff-bd3a-b20d770a9eff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:38.517086 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb476579-04d4-44ff-bd3a-b20d770a9eff admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:38.517678 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb476579-04d4-44ff-bd3a-b20d770a9eff admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:38.518088 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb476579-04d4-44ff-bd3a-b20d770a9eff admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:38.519091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb476579-04d4-44ff-bd3a-b20d770a9eff admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:38.521503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb476579-04d4-44ff-bd3a-b20d770a9eff admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:38.571428 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 800/1622] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:21:38 2022] POST /identity/v3/projects => generated 365 bytes in 252 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:38.574239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c0b9a-978f-4430-9ba7-97f08e05038c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:38.575076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 823/1623] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:21:38 2022] POST /identity/v3/users => generated 309 bytes in 113 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:38.578254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb476579-04d4-44ff-bd3a-b20d770a9eff admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:38.605349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb476579-04d4-44ff-bd3a-b20d770a9eff admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:38.732586 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a22c0b9a-978f-4430-9ba7-97f08e05038c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:38.743863 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e591dc-3f3e-42df-939e-c1fee740ea24 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:38.745808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e591dc-3f3e-42df-939e-c1fee740ea24 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:38.746387 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e591dc-3f3e-42df-939e-c1fee740ea24 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:38.747268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e591dc-3f3e-42df-939e-c1fee740ea24 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:38.776653 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794bcad-957f-4509-b1a4-5103c95aa549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:38.777420 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794bcad-957f-4509-b1a4-5103c95aa549 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:38.779745 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794bcad-957f-4509-b1a4-5103c95aa549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:38.780186 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b794bcad-957f-4509-b1a4-5103c95aa549 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:38.784347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794bcad-957f-4509-b1a4-5103c95aa549 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:38.789237 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b794bcad-957f-4509-b1a4-5103c95aa549 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:38.834130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:38.842379 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 824/1624] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:21:38 2022] POST /identity/v3/users => generated 289 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:38.849431 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794bcad-957f-4509-b1a4-5103c95aa549 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:38.884335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b794bcad-957f-4509-b1a4-5103c95aa549 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:38.892793 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e591dc-3f3e-42df-939e-c1fee740ea24 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:38.894986 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e591dc-3f3e-42df-939e-c1fee740ea24 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:38.902236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0b1f3-e710-4c2c-808f-330b51485146 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:38.903760 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0b1f3-e710-4c2c-808f-330b51485146 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:38.904144 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0b1f3-e710-4c2c-808f-330b51485146 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:38.905704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f0b1f3-e710-4c2c-808f-330b51485146 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:38.906615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0b1f3-e710-4c2c-808f-330b51485146 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:38.909644 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f0b1f3-e710-4c2c-808f-330b51485146 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:38.923661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 801/1625] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:38 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 351 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:38.924540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e591dc-3f3e-42df-939e-c1fee740ea24 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:38.933531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 825/1626] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:38.939941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0b1f3-e710-4c2c-808f-330b51485146 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:38.945760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e591dc-3f3e-42df-939e-c1fee740ea24 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:38.952614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f59b86-f925-44fa-8738-e490aac2be73 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:38.955737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f59b86-f925-44fa-8738-e490aac2be73 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:38.956830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f59b86-f925-44fa-8738-e490aac2be73 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:38.957368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47f59b86-f925-44fa-8738-e490aac2be73 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:38.958403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f59b86-f925-44fa-8738-e490aac2be73 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:38.961630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47f59b86-f925-44fa-8738-e490aac2be73 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:38.968133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f0b1f3-e710-4c2c-808f-330b51485146 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:38.982541 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4b0c9-5723-4848-90e1-da93570f18d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:38.983644 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b0c9-5723-4848-90e1-da93570f18d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:38.984590 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b0c9-5723-4848-90e1-da93570f18d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:38.985027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 802/1627] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:38 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:38.986401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bb4b0c9-5723-4848-90e1-da93570f18d3 admin admin] PATH_INFO: `/v3/projects/58594db6c7f641bcb392552a49c75189/users/2e8e5985ac4941b3951072c16aa1d0fa/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:38.992574 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f59b86-f925-44fa-8738-e490aac2be73 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:39.028870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47f59b86-f925-44fa-8738-e490aac2be73 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:39.042685 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4b0c9-5723-4848-90e1-da93570f18d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58594db6c7f641bcb392552a49c75189, user_id=2e8e5985ac4941b3951072c16aa1d0fa, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:39.051481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870a1fc-6b87-441a-8ebc-e5d8520be1d3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:39.052744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870a1fc-6b87-441a-8ebc-e5d8520be1d3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:39.053050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870a1fc-6b87-441a-8ebc-e5d8520be1d3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:39.053329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d870a1fc-6b87-441a-8ebc-e5d8520be1d3 admin admin] PATH_INFO: `/v3/projects/588820ce6896446282dbec62e3352340/users/86477bc508f1447584c4ff5eb73380d7/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:39.055771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2bb4b0c9-5723-4848-90e1-da93570f18d3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:39.095507 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 826/1628] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:38 2022] PUT /identity/v3/projects/58594db6c7f641bcb392552a49c75189/users/2e8e5985ac4941b3951072c16aa1d0fa/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:21:39.100600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4b0c9-5723-4848-90e1-da93570f18d3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:39.114933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870a1fc-6b87-441a-8ebc-e5d8520be1d3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=588820ce6896446282dbec62e3352340, user_id=86477bc508f1447584c4ff5eb73380d7, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:39.128780 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d870a1fc-6b87-441a-8ebc-e5d8520be1d3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:39.137930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:39.180331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 803/1629] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:38 2022] PUT /identity/v3/projects/588820ce6896446282dbec62e3352340/users/86477bc508f1447584c4ff5eb73380d7/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:39.183352 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870a1fc-6b87-441a-8ebc-e5d8520be1d3 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:39.297944 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bb4b0c9-5723-4848-90e1-da93570f18d3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:39.375852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d870a1fc-6b87-441a-8ebc-e5d8520be1d3 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:39.389979 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275a27a5-9343-4b5f-8e28-c89c5403ea00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:39.390675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a27a5-9343-4b5f-8e28-c89c5403ea00 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:39.391951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a27a5-9343-4b5f-8e28-c89c5403ea00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:39.396157 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275a27a5-9343-4b5f-8e28-c89c5403ea00 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:39.416711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a27a5-9343-4b5f-8e28-c89c5403ea00 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:39.426970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275a27a5-9343-4b5f-8e28-c89c5403ea00 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:39.468543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 804/1630] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:39.476455 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b086b73-291a-4832-8779-f8977b6dea4a None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:39.477383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b086b73-291a-4832-8779-f8977b6dea4a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:39.477859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b086b73-291a-4832-8779-f8977b6dea4a None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:39.479421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cce5dbb-825b-4d3f-88b1-233a72158d92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:39.481996 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce5dbb-825b-4d3f-88b1-233a72158d92 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:39.482867 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce5dbb-825b-4d3f-88b1-233a72158d92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:39.483710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 805/1631] 10.222.0.64 () {54 vars in 912 bytes} [Thu May 26 18:21:39 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:21:39.484229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cce5dbb-825b-4d3f-88b1-233a72158d92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:39.485415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce5dbb-825b-4d3f-88b1-233a72158d92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:39.487309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b086b73-291a-4832-8779-f8977b6dea4a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:39.491131 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cce5dbb-825b-4d3f-88b1-233a72158d92 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:39.523768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b086b73-291a-4832-8779-f8977b6dea4a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:39.524214 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 827/1632] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:39 2022] GET /identity/v3/roles => generated 1420 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:39.526775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a5ba3-459f-4280-9653-0039a3185c62 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:39.529255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a5ba3-459f-4280-9653-0039a3185c62 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:39.529255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-877a5ba3-459f-4280-9653-0039a3185c62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:39.538277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19593cf7-e564-4125-965e-ca153f5e39a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:39.540207 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19593cf7-e564-4125-965e-ca153f5e39a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:39.541760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19593cf7-e564-4125-965e-ca153f5e39a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:39.542336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19593cf7-e564-4125-965e-ca153f5e39a8 admin admin] PATH_INFO: `/v3/projects/588820ce6896446282dbec62e3352340/users/86477bc508f1447584c4ff5eb73380d7/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:39.547811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19593cf7-e564-4125-965e-ca153f5e39a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=588820ce6896446282dbec62e3352340, user_id=86477bc508f1447584c4ff5eb73380d7, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:39.560503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19593cf7-e564-4125-965e-ca153f5e39a8 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:39.581207 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-877a5ba3-459f-4280-9653-0039a3185c62 None None] MFA Rules not processed for user `97f259ac2eb4425f8b4dcffeccdcd439`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:39.587521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-877a5ba3-459f-4280-9653-0039a3185c62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:39.593085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 806/1633] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:39 2022] PUT /identity/v3/projects/588820ce6896446282dbec62e3352340/users/86477bc508f1447584c4ff5eb73380d7/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:39.596723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19593cf7-e564-4125-965e-ca153f5e39a8 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:39.757022 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:39.779938 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 828/1634] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:21:39 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:39.783189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9bb31-0e2c-4ea0-bfd6-7581b87f147b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:39.783915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9bb31-0e2c-4ea0-bfd6-7581b87f147b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:39.784321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d9bb31-0e2c-4ea0-bfd6-7581b87f147b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:39.791495 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19593cf7-e564-4125-965e-ca153f5e39a8 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:39.800969 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8546d9-fb7b-4c54-bf9e-88da6c2507f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:39.803525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8546d9-fb7b-4c54-bf9e-88da6c2507f1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:39.804002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8546d9-fb7b-4c54-bf9e-88da6c2507f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:39.804439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e8546d9-fb7b-4c54-bf9e-88da6c2507f1 admin admin] PATH_INFO: `/v3/projects/58594db6c7f641bcb392552a49c75189/users/2e8e5985ac4941b3951072c16aa1d0fa/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:39.807943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8546d9-fb7b-4c54-bf9e-88da6c2507f1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=58594db6c7f641bcb392552a49c75189, user_id=2e8e5985ac4941b3951072c16aa1d0fa, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:39.810909 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e8546d9-fb7b-4c54-bf9e-88da6c2507f1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:39.825052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 807/1635] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:39 2022] PUT /identity/v3/projects/58594db6c7f641bcb392552a49c75189/users/2e8e5985ac4941b3951072c16aa1d0fa/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:39.830745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8546d9-fb7b-4c54-bf9e-88da6c2507f1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:39.851064 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-29d9bb31-0e2c-4ea0-bfd6-7581b87f147b None None] MFA Rules not processed for user `86477bc508f1447584c4ff5eb73380d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:39.857601 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-29d9bb31-0e2c-4ea0-bfd6-7581b87f147b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:39.978434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e8546d9-fb7b-4c54-bf9e-88da6c2507f1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:39.998851 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36309f6e-39c6-4f6c-b5ac-b655ac26aa4b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:39.999522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36309f6e-39c6-4f6c-b5ac-b655ac26aa4b service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:39.999807 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36309f6e-39c6-4f6c-b5ac-b655ac26aa4b service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:40.000118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36309f6e-39c6-4f6c-b5ac-b655ac26aa4b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:40.052049 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:40.065691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 829/1636] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:39 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 285 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:40.075202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9bb31-0e2c-4ea0-bfd6-7581b87f147b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:40.088567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d9bb31-0e2c-4ea0-bfd6-7581b87f147b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:40.097484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3660d3-f9e0-406b-ac0f-9b497d052ef3 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:40.098174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3660d3-f9e0-406b-ac0f-9b497d052ef3 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:40.098456 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3660d3-f9e0-406b-ac0f-9b497d052ef3 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:40.098735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3660d3-f9e0-406b-ac0f-9b497d052ef3 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:40.121446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3660d3-f9e0-406b-ac0f-9b497d052ef3 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:40.123484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3660d3-f9e0-406b-ac0f-9b497d052ef3 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:40.143646 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36309f6e-39c6-4f6c-b5ac-b655ac26aa4b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:40.145146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36309f6e-39c6-4f6c-b5ac-b655ac26aa4b service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:40.149065 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 830/1637] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:40 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:21:40.160799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 808/1638] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:39 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 330 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:40.281980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3660d3-f9e0-406b-ac0f-9b497d052ef3 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:40.306446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3660d3-f9e0-406b-ac0f-9b497d052ef3 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:40.311017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e63a6f9-cf85-4629-98d4-c2637c352efb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:40.311789 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a6f9-cf85-4629-98d4-c2637c352efb service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:40.312229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a6f9-cf85-4629-98d4-c2637c352efb service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:40.312609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e63a6f9-cf85-4629-98d4-c2637c352efb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:40.409809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63a6f9-cf85-4629-98d4-c2637c352efb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:40.411563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e63a6f9-cf85-4629-98d4-c2637c352efb service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:40.426024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 831/1639] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:40 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:40.957410 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c07f4d-0ffb-4fa0-8256-57ff1d879a27 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:40.958176 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c07f4d-0ffb-4fa0-8256-57ff1d879a27 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:40.958671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c07f4d-0ffb-4fa0-8256-57ff1d879a27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:41.006837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d9c07f4d-0ffb-4fa0-8256-57ff1d879a27 None None] MFA Rules not processed for user `f85ef7eb24b14d41a72e5e1ef0c96e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:41.010504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d9c07f4d-0ffb-4fa0-8256-57ff1d879a27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:41.209277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d005e40-2830-4e97-a32e-aff098ed5f4f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:41.209859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d005e40-2830-4e97-a32e-aff098ed5f4f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:41.209859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d005e40-2830-4e97-a32e-aff098ed5f4f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:41.210419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 809/1640] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:40 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:41.271233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0d005e40-2830-4e97-a32e-aff098ed5f4f None None] MFA Rules not processed for user `f85ef7eb24b14d41a72e5e1ef0c96e70`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:41.272826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0d005e40-2830-4e97-a32e-aff098ed5f4f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:41.286106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 832/1641] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:21:41.292578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c07f4d-0ffb-4fa0-8256-57ff1d879a27 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:41.309334 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c07f4d-0ffb-4fa0-8256-57ff1d879a27 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:41.316836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3adac32-dba1-4b2a-8a85-668ceede6ab6 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:41.317631 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adac32-dba1-4b2a-8a85-668ceede6ab6 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:41.317982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adac32-dba1-4b2a-8a85-668ceede6ab6 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:41.318524 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3adac32-dba1-4b2a-8a85-668ceede6ab6 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:41.341364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adac32-dba1-4b2a-8a85-668ceede6ab6 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:41.343207 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3adac32-dba1-4b2a-8a85-668ceede6ab6 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:41.357438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 810/1642] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:41 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 66 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:21:41.610547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb5ea8-0004-46a0-9cc9-ce598085afdd None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:41.611698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb5ea8-0004-46a0-9cc9-ce598085afdd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:41.612177 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1cb5ea8-0004-46a0-9cc9-ce598085afdd None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:41.614425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 833/1643] 10.222.0.64 () {54 vars in 961 bytes} [Thu May 26 18:21:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:21:41.627445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f058b5-905a-4d50-9829-dd0a7cf4abee None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:41.627962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f058b5-905a-4d50-9829-dd0a7cf4abee None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:41.628392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4f058b5-905a-4d50-9829-dd0a7cf4abee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:41.660327 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d4f058b5-905a-4d50-9829-dd0a7cf4abee None None] MFA Rules not processed for user `97f259ac2eb4425f8b4dcffeccdcd439`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:41.661921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d4f058b5-905a-4d50-9829-dd0a7cf4abee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:41.679518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 811/1644] 10.222.0.64 () {58 vars in 1058 bytes} [Thu May 26 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:41.688905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded45206-f181-4987-a39c-d4b995a0472f None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:41.692657 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded45206-f181-4987-a39c-d4b995a0472f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:41.693099 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded45206-f181-4987-a39c-d4b995a0472f None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:41.694717 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 834/1645] 10.222.0.64 () {54 vars in 912 bytes} [Thu May 26 18:21:41 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:21:41.705816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba1bbf-c732-4bab-855c-d0b9392fc7d8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:41.706881 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba1bbf-c732-4bab-855c-d0b9392fc7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:41.707260 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faba1bbf-c732-4bab-855c-d0b9392fc7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:41.731270 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-faba1bbf-c732-4bab-855c-d0b9392fc7d8 None None] MFA Rules not processed for user `97f259ac2eb4425f8b4dcffeccdcd439`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:41.733310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-faba1bbf-c732-4bab-855c-d0b9392fc7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:41.754641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 812/1646] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:21:41 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:41.762295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded45206-f181-4987-a39c-d4b995a0472f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:41.779834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded45206-f181-4987-a39c-d4b995a0472f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:41.786730 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d5797bd-7024-4657-a342-3163f1ad436e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:41.787587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5797bd-7024-4657-a342-3163f1ad436e service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:41.787726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5797bd-7024-4657-a342-3163f1ad436e service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:41.787902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d5797bd-7024-4657-a342-3163f1ad436e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:41.803696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5797bd-7024-4657-a342-3163f1ad436e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:41.805605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d5797bd-7024-4657-a342-3163f1ad436e service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:41.848704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 835/1647] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:42.088142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1c23-7031-41f8-a704-cb9b46c13930 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:42.090260 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1c23-7031-41f8-a704-cb9b46c13930 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:42.090896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34aa1c23-7031-41f8-a704-cb9b46c13930 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:42.094031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 813/1648] 10.222.0.64 () {54 vars in 912 bytes} [Thu May 26 18:21:42 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:21:42.101814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acf709-35ba-4975-b688-c22e6978e380 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:42.102122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acf709-35ba-4975-b688-c22e6978e380 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:42.102378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99acf709-35ba-4975-b688-c22e6978e380 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:42.190848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-99acf709-35ba-4975-b688-c22e6978e380 None None] MFA Rules not processed for user `1b725c28490f4f90b5eec565cd0fb603`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:42.192287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-99acf709-35ba-4975-b688-c22e6978e380 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:42.249891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:42.303917 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 836/1649] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:21:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:42.460560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa1c23-7031-41f8-a704-cb9b46c13930 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:42.525275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34aa1c23-7031-41f8-a704-cb9b46c13930 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:42.525275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f22b88-4841-4910-aa01-496169adcda9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:42.525275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22b88-4841-4910-aa01-496169adcda9 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:42.525275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22b88-4841-4910-aa01-496169adcda9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:42.525798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f22b88-4841-4910-aa01-496169adcda9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:42.525798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f22b88-4841-4910-aa01-496169adcda9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:42.525798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f22b88-4841-4910-aa01-496169adcda9 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:42.540399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 814/1650] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 80 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:43.673986 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d561029-e199-4687-bff2-c6cbd4c3969e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:43.674856 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d561029-e199-4687-bff2-c6cbd4c3969e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:43.675271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d561029-e199-4687-bff2-c6cbd4c3969e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:43.677303 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 837/1651] 10.222.0.64 () {54 vars in 960 bytes} [Thu May 26 18:21:43 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:21:43.706427 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5da9de-6991-4df6-a660-8a05722f2c6e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:43.707442 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5da9de-6991-4df6-a660-8a05722f2c6e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:43.707938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe5da9de-6991-4df6-a660-8a05722f2c6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:43.761359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fe5da9de-6991-4df6-a660-8a05722f2c6e None None] MFA Rules not processed for user `1ab4efe6f79d4b3ca5618c089c5f3d24`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:43.765691 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fe5da9de-6991-4df6-a660-8a05722f2c6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:43.828314 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1919b3d-4765-412f-8133-106307dfc607 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:43.828688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1919b3d-4765-412f-8133-106307dfc607 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:43.829184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1919b3d-4765-412f-8133-106307dfc607 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:43.961927 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e1919b3d-4765-412f-8133-106307dfc607 None None] MFA Rules not processed for user `2e8e5985ac4941b3951072c16aa1d0fa`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:43.963184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e1919b3d-4765-412f-8133-106307dfc607 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:43.986808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:44.041811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 815/1652] 10.222.0.64 () {58 vars in 1057 bytes} [Thu May 26 18:21:43 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 337 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:21:44.051456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5da9de-6991-4df6-a660-8a05722f2c6e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:44.074059 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe5da9de-6991-4df6-a660-8a05722f2c6e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:44.092170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41a9beed-52ee-4105-8832-4fd3450cb6f4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab4efe6f79d4b3ca5618c089c5f3d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:44.092856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9beed-52ee-4105-8832-4fd3450cb6f4 service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:44.093188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9beed-52ee-4105-8832-4fd3450cb6f4 service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:44.093469 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41a9beed-52ee-4105-8832-4fd3450cb6f4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:44.098622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-41a9beed-52ee-4105-8832-4fd3450cb6f4 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:44.136658 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9beed-52ee-4105-8832-4fd3450cb6f4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:44.148756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41a9beed-52ee-4105-8832-4fd3450cb6f4 service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:44.184899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 816/1653] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:21:44.274883 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 838/1654] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:43 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 442 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:21:47.695190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93adda-ed39-4651-b6b4-f307f87637b8 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:47.695963 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93adda-ed39-4651-b6b4-f307f87637b8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:47.696383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e93adda-ed39-4651-b6b4-f307f87637b8 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:47.704275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 817/1655] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 26 18:21:47 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:21:47.765003 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4418-cc62-4d41-b2ff-9f07ee4dc361 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:47.766086 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4418-cc62-4d41-b2ff-9f07ee4dc361 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:47.766493 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a93a4418-cc62-4d41-b2ff-9f07ee4dc361 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:47.794126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a93a4418-cc62-4d41-b2ff-9f07ee4dc361 None None] MFA Rules not processed for user `1ab4efe6f79d4b3ca5618c089c5f3d24`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:47.795591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a93a4418-cc62-4d41-b2ff-9f07ee4dc361 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:47.823806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 839/1656] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 26 18:21:47 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:47.857493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93adda-ed39-4651-b6b4-f307f87637b8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:47.880751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e93adda-ed39-4651-b6b4-f307f87637b8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:47.896419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfe40c1a-fc0a-4467-94bd-70c80854addc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab4efe6f79d4b3ca5618c089c5f3d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:47.897122 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe40c1a-fc0a-4467-94bd-70c80854addc service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:47.897413 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe40c1a-fc0a-4467-94bd-70c80854addc service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:47.897692 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfe40c1a-fc0a-4467-94bd-70c80854addc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:47.926230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe40c1a-fc0a-4467-94bd-70c80854addc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:47.928073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfe40c1a-fc0a-4467-94bd-70c80854addc service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:47.967586 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 818/1657] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:48.536264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a4418-cc62-4d41-b2ff-9f07ee4dc361 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:48.740065 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a93a4418-cc62-4d41-b2ff-9f07ee4dc361 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:48.750455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-674a7cd5-4397-4ae9-b93b-46880fe1a02d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:48.751739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a7cd5-4397-4ae9-b93b-46880fe1a02d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:48.752228 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a7cd5-4397-4ae9-b93b-46880fe1a02d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:48.752726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-674a7cd5-4397-4ae9-b93b-46880fe1a02d admin admin] PATH_INFO: `/v3/users/a07b3f7297064a829104a585472eb10e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:48.754713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a7cd5-4397-4ae9-b93b-46880fe1a02d admin admin] RBAC: Authorizing `identity:delete_user(user_id=a07b3f7297064a829104a585472eb10e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:48.758008 dv-cinder-843493-1-smb devstack@keystone.service[80231]: WARNING py.warnings [None req-674a7cd5-4397-4ae9-b93b-46880fe1a02d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:21:48.758008 dv-cinder-843493-1-smb devstack@keystone.service[80231]: warnings.warn(msg) May 26 18:21:48.758008 dv-cinder-843493-1-smb devstack@keystone.service[80231]: May 26 18:21:48.768712 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-674a7cd5-4397-4ae9-b93b-46880fe1a02d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:48.897884 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483da41-6808-44a6-8d12-66f0477ea09a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:48.898899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483da41-6808-44a6-8d12-66f0477ea09a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:48.899385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0483da41-6808-44a6-8d12-66f0477ea09a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:48.928096 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-674a7cd5-4397-4ae9-b93b-46880fe1a02d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a07b3f7297064a829104a585472eb10e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:48.929356 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-674a7cd5-4397-4ae9-b93b-46880fe1a02d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a07b3f7297064a829104a585472eb10e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:48.939791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0483da41-6808-44a6-8d12-66f0477ea09a None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:48.944602 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0483da41-6808-44a6-8d12-66f0477ea09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:48.966730 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-674a7cd5-4397-4ae9-b93b-46880fe1a02d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a07b3f7297064a829104a585472eb10e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:48.967972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-674a7cd5-4397-4ae9-b93b-46880fe1a02d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a07b3f7297064a829104a585472eb10e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:49.014313 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=8 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:49.038251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-674a7cd5-4397-4ae9-b93b-46880fe1a02d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a07b3f7297064a829104a585472eb10e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:49.073762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 840/1658] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:21:48 2022] DELETE /identity/v3/users/a07b3f7297064a829104a585472eb10e => generated 0 bytes in 542 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:49.078348 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280c7e6-c671-45ac-b3b3-f844e570ee65 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:49.078963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280c7e6-c671-45ac-b3b3-f844e570ee65 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:49.079508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6280c7e6-c671-45ac-b3b3-f844e570ee65 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:49.123268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6280c7e6-c671-45ac-b3b3-f844e570ee65 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:49.126712 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6280c7e6-c671-45ac-b3b3-f844e570ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:49.147128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 819/1659] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:21:48 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (3 switches on core 0) May 26 18:21:49.269133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 841/1660] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:21:49.311438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483da41-6808-44a6-8d12-66f0477ea09a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:49.313199 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0483da41-6808-44a6-8d12-66f0477ea09a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:49.335556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0483da41-6808-44a6-8d12-66f0477ea09a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:49.406685 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280c7e6-c671-45ac-b3b3-f844e570ee65 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:49.409810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6280c7e6-c671-45ac-b3b3-f844e570ee65 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:49.472864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b769b6-99b1-4119-b68f-16caeffbbfcc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:49.473859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b769b6-99b1-4119-b68f-16caeffbbfcc service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:49.474254 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b769b6-99b1-4119-b68f-16caeffbbfcc service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:49.474643 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b769b6-99b1-4119-b68f-16caeffbbfcc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:49.528897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b769b6-99b1-4119-b68f-16caeffbbfcc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:49.535175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b769b6-99b1-4119-b68f-16caeffbbfcc service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:49.576363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 820/1661] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 266 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:49.880762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6280c7e6-c671-45ac-b3b3-f844e570ee65 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:49.890638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90ffc044-26de-4a23-93c6-ab1cfe1ebe07 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:49.891579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffc044-26de-4a23-93c6-ab1cfe1ebe07 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:49.893535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffc044-26de-4a23-93c6-ab1cfe1ebe07 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:49.893961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90ffc044-26de-4a23-93c6-ab1cfe1ebe07 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:49.955575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b769b6-99b1-4119-b68f-16caeffbbfcc service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:49.963279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-26b769b6-99b1-4119-b68f-16caeffbbfcc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:50.010062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b769b6-99b1-4119-b68f-16caeffbbfcc service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:50.039185 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e824b82-c448-4ed1-8b00-1de75f4f896e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:50.045167 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e824b82-c448-4ed1-8b00-1de75f4f896e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:50.048173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e824b82-c448-4ed1-8b00-1de75f4f896e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:50.048705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e824b82-c448-4ed1-8b00-1de75f4f896e admin admin] PATH_INFO: `/v3/users/98d97558826649609198cb0c477adb3a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:50.050305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e824b82-c448-4ed1-8b00-1de75f4f896e admin admin] RBAC: Authorizing `identity:delete_user(user_id=98d97558826649609198cb0c477adb3a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:50.052905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e824b82-c448-4ed1-8b00-1de75f4f896e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:50.072157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffc044-26de-4a23-93c6-ab1cfe1ebe07 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:50.079985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90ffc044-26de-4a23-93c6-ab1cfe1ebe07 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:50.107301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 842/1662] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:21:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 701 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) May 26 18:21:50.150005 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6e824b82-c448-4ed1-8b00-1de75f4f896e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98d97558826649609198cb0c477adb3a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:50.200199 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6e824b82-c448-4ed1-8b00-1de75f4f896e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98d97558826649609198cb0c477adb3a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:50.201354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6e824b82-c448-4ed1-8b00-1de75f4f896e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98d97558826649609198cb0c477adb3a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:50.254071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6e824b82-c448-4ed1-8b00-1de75f4f896e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98d97558826649609198cb0c477adb3a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:50.259801 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:50.280084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6e824b82-c448-4ed1-8b00-1de75f4f896e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98d97558826649609198cb0c477adb3a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:50.289335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 821/1663] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:21:49 2022] DELETE /identity/v3/users/98d97558826649609198cb0c477adb3a => generated 0 bytes in 335 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:21:50.294795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab734ad6-0732-46dc-b12b-350f2e6ebb74 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:50.295084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab734ad6-0732-46dc-b12b-350f2e6ebb74 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:50.295314 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab734ad6-0732-46dc-b12b-350f2e6ebb74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:50.347641 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ab734ad6-0732-46dc-b12b-350f2e6ebb74 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:50.361559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ab734ad6-0732-46dc-b12b-350f2e6ebb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:50.403383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:DELETE=2,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:50.537501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 843/1664] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 242 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:50.573095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e824b82-c448-4ed1-8b00-1de75f4f896e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:50.574568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6e824b82-c448-4ed1-8b00-1de75f4f896e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:50.737107 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e824b82-c448-4ed1-8b00-1de75f4f896e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:50.749880 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bafb0b9-7b27-4584-a345-a2b35ebe0de6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:50.753379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafb0b9-7b27-4584-a345-a2b35ebe0de6 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:50.756226 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafb0b9-7b27-4584-a345-a2b35ebe0de6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:50.757198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bafb0b9-7b27-4584-a345-a2b35ebe0de6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:50.825048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafb0b9-7b27-4584-a345-a2b35ebe0de6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:50.831309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bafb0b9-7b27-4584-a345-a2b35ebe0de6 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:50.871339 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 822/1665] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:50 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 299 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:52.034380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab734ad6-0732-46dc-b12b-350f2e6ebb74 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:52.036350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ab734ad6-0732-46dc-b12b-350f2e6ebb74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:52.106531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab734ad6-0732-46dc-b12b-350f2e6ebb74 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:52.127373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f620e7c-a418-4f0c-892b-3b8852e7b10e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:52.129235 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f620e7c-a418-4f0c-892b-3b8852e7b10e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:52.130472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f620e7c-a418-4f0c-892b-3b8852e7b10e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:52.132359 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f620e7c-a418-4f0c-892b-3b8852e7b10e admin admin] PATH_INFO: `/v3/users/2a7dbd3208a74fcfb443f9b5b8546929` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:52.137029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f620e7c-a418-4f0c-892b-3b8852e7b10e admin admin] RBAC: Authorizing `identity:delete_user(user_id=2a7dbd3208a74fcfb443f9b5b8546929)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:52.140001 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f620e7c-a418-4f0c-892b-3b8852e7b10e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:52.278066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1f620e7c-a418-4f0c-892b-3b8852e7b10e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2a7dbd3208a74fcfb443f9b5b8546929'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:52.280022 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1f620e7c-a418-4f0c-892b-3b8852e7b10e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2a7dbd3208a74fcfb443f9b5b8546929'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:52.299129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1f620e7c-a418-4f0c-892b-3b8852e7b10e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2a7dbd3208a74fcfb443f9b5b8546929'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:52.301791 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1f620e7c-a418-4f0c-892b-3b8852e7b10e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2a7dbd3208a74fcfb443f9b5b8546929'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:52.376899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1f620e7c-a418-4f0c-892b-3b8852e7b10e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2a7dbd3208a74fcfb443f9b5b8546929'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:52.405412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 844/1666] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:21:52 2022] DELETE /identity/v3/users/2a7dbd3208a74fcfb443f9b5b8546929 => generated 0 bytes in 371 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:52.416184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df1ed9-94a2-4390-a74e-778719b980f5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:52.416699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df1ed9-94a2-4390-a74e-778719b980f5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:52.417957 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19df1ed9-94a2-4390-a74e-778719b980f5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:52.458226 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-19df1ed9-94a2-4390-a74e-778719b980f5 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:52.460429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-19df1ed9-94a2-4390-a74e-778719b980f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:52.619182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140b79b-6a57-4459-a5c9-f53c0658e8d1 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:52.619472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140b79b-6a57-4459-a5c9-f53c0658e8d1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:52.619760 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c140b79b-6a57-4459-a5c9-f53c0658e8d1 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:52.622383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 845/1667] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 26 18:21:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:21:52.660547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4529b-80a2-4ead-af65-9a3b25009d83 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:52.661124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4529b-80a2-4ead-af65-9a3b25009d83 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:52.661460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35e4529b-80a2-4ead-af65-9a3b25009d83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:52.673116 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 823/1668] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:52.705500 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-35e4529b-80a2-4ead-af65-9a3b25009d83 None None] MFA Rules not processed for user `1ab4efe6f79d4b3ca5618c089c5f3d24`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:52.706765 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-35e4529b-80a2-4ead-af65-9a3b25009d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:52.784449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df1ed9-94a2-4390-a74e-778719b980f5 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:52.787888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-19df1ed9-94a2-4390-a74e-778719b980f5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:52.838697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19df1ed9-94a2-4390-a74e-778719b980f5 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:52.857436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5c7fd-6e2e-4775-9d99-e22e5ddaedae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:52.858952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5c7fd-6e2e-4775-9d99-e22e5ddaedae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:52.859448 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5c7fd-6e2e-4775-9d99-e22e5ddaedae admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:52.859963 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5b5c7fd-6e2e-4775-9d99-e22e5ddaedae admin admin] PATH_INFO: `/v3/users/cb6ebd49757d475c954973da976f0c67` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:52.864316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5c7fd-6e2e-4775-9d99-e22e5ddaedae admin admin] RBAC: Authorizing `identity:delete_user(user_id=cb6ebd49757d475c954973da976f0c67)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:52.870995 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5b5c7fd-6e2e-4775-9d99-e22e5ddaedae admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:52.915339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 846/1669] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 26 18:21:52 2022] POST /identity/v3/auth/tokens => generated 3298 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:52.916294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4529b-80a2-4ead-af65-9a3b25009d83 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:52.921058 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-35e4529b-80a2-4ead-af65-9a3b25009d83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:53.021277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:53.041333 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c5b5c7fd-6e2e-4775-9d99-e22e5ddaedae admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cb6ebd49757d475c954973da976f0c67'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:53.065967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c5b5c7fd-6e2e-4775-9d99-e22e5ddaedae admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cb6ebd49757d475c954973da976f0c67'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:53.067508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c5b5c7fd-6e2e-4775-9d99-e22e5ddaedae admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cb6ebd49757d475c954973da976f0c67'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:53.085982 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35e4529b-80a2-4ead-af65-9a3b25009d83 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:53.100818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbf5cd-9c7e-4a88-9fb5-0854c57a9c94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:53.101916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbf5cd-9c7e-4a88-9fb5-0854c57a9c94 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:53.102616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbf5cd-9c7e-4a88-9fb5-0854c57a9c94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:53.103117 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5dbf5cd-9c7e-4a88-9fb5-0854c57a9c94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:53.121229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbf5cd-9c7e-4a88-9fb5-0854c57a9c94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:53.121524 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c5b5c7fd-6e2e-4775-9d99-e22e5ddaedae admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cb6ebd49757d475c954973da976f0c67'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:53.124073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5dbf5cd-9c7e-4a88-9fb5-0854c57a9c94 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:53.162989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c5b5c7fd-6e2e-4775-9d99-e22e5ddaedae admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cb6ebd49757d475c954973da976f0c67'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:53.167476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 847/1670] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 252 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:53.174396 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbf5cd-9c7e-4a88-9fb5-0854c57a9c94 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:53.180255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a5dbf5cd-9c7e-4a88-9fb5-0854c57a9c94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:53.200453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 824/1671] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:21:52 2022] DELETE /identity/v3/users/cb6ebd49757d475c954973da976f0c67 => generated 0 bytes in 413 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:53.223175 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5dbf5cd-9c7e-4a88-9fb5-0854c57a9c94 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:53.414007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:53.414915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:53.415372 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:53.415595 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] PATH_INFO: `/v3/projects/bdf68adb27e049dab85c2111c0a6d789` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:53.417741 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bdf68adb27e049dab85c2111c0a6d789)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:53.419821 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:53.461679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5c7fd-6e2e-4775-9d99-e22e5ddaedae admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:53.463236 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c5b5c7fd-6e2e-4775-9d99-e22e5ddaedae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:53.481868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:INSERT=2,keystone:DELETE=11,keystone:SELECT=87 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:53.561444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bdf68adb27e049dab85c2111c0a6d789', 'request_id': 'req-f983be76-883a-4fd9-864f-337597f32d81'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:53.581729 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bdf68adb27e049dab85c2111c0a6d789', 'request_id': 'req-f983be76-883a-4fd9-864f-337597f32d81'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:53.589896 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bdf68adb27e049dab85c2111c0a6d789', 'request_id': 'req-f983be76-883a-4fd9-864f-337597f32d81'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:53.618658 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] The token cache is being invalidate because project bdf68adb27e049dab85c2111c0a6d789 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:21:53.618961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:53.619707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:53.624748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 848/1672] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:21:53 2022] DELETE /identity/v3/projects/bdf68adb27e049dab85c2111c0a6d789 => generated 0 bytes in 456 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:53.629063 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:53.631502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:53.699221 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5b5c7fd-6e2e-4775-9d99-e22e5ddaedae admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:53.857576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f983be76-883a-4fd9-864f-337597f32d81 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:53.890245 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216ffa3-8829-4e64-a867-4452cc230990 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab4efe6f79d4b3ca5618c089c5f3d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:53.890767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216ffa3-8829-4e64-a867-4452cc230990 service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:53.891052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216ffa3-8829-4e64-a867-4452cc230990 service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:53.891333 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3216ffa3-8829-4e64-a867-4452cc230990 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:53.894711 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ddf16f2-845f-4765-89ea-a0ac47070ae3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:53.898182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf16f2-845f-4765-89ea-a0ac47070ae3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:53.900213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf16f2-845f-4765-89ea-a0ac47070ae3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:53.901379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3216ffa3-8829-4e64-a867-4452cc230990 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:53.901851 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ddf16f2-845f-4765-89ea-a0ac47070ae3 admin admin] PATH_INFO: `/v3/users/86477bc508f1447584c4ff5eb73380d7` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:53.910245 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf16f2-845f-4765-89ea-a0ac47070ae3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86477bc508f1447584c4ff5eb73380d7)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:53.916667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ddf16f2-845f-4765-89ea-a0ac47070ae3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:53.927485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216ffa3-8829-4e64-a867-4452cc230990 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:53.932185 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3216ffa3-8829-4e64-a867-4452cc230990 service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:53.941208 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:53.965454 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 825/1673] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 500 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:21:54.052388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216ffa3-8829-4e64-a867-4452cc230990 service placement] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:54.055577 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3216ffa3-8829-4e64-a867-4452cc230990 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:54.056241 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5ddf16f2-845f-4765-89ea-a0ac47070ae3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86477bc508f1447584c4ff5eb73380d7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:54.058384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5ddf16f2-845f-4765-89ea-a0ac47070ae3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86477bc508f1447584c4ff5eb73380d7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:54.077792 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3216ffa3-8829-4e64-a867-4452cc230990 service placement] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:54.091262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5ddf16f2-845f-4765-89ea-a0ac47070ae3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86477bc508f1447584c4ff5eb73380d7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:54.091787 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d55d7db-680c-44e1-9947-507600598922 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:54.092443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d7db-680c-44e1-9947-507600598922 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:54.092736 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d7db-680c-44e1-9947-507600598922 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:54.093049 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d55d7db-680c-44e1-9947-507600598922 admin admin] PATH_INFO: `/v3/projects/8f763b2938124a8e941c075770df5704` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:54.095643 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55d7db-680c-44e1-9947-507600598922 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8f763b2938124a8e941c075770df5704)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:54.096697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: WARNING py.warnings [None req-3d55d7db-680c-44e1-9947-507600598922 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required May 26 18:21:54.096697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: warnings.warn(msg) May 26 18:21:54.096697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: May 26 18:21:54.097529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5ddf16f2-845f-4765-89ea-a0ac47070ae3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86477bc508f1447584c4ff5eb73380d7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:54.098239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d55d7db-680c-44e1-9947-507600598922 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:54.149242 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5ddf16f2-845f-4765-89ea-a0ac47070ae3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86477bc508f1447584c4ff5eb73380d7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:54.195090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 849/1674] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:21:53 2022] DELETE /identity/v3/users/86477bc508f1447584c4ff5eb73380d7 => generated 0 bytes in 566 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:21:54.196548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a34ba-b065-4058-ab9b-bea540eca2c4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:54.196861 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a34ba-b065-4058-ab9b-bea540eca2c4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:54.197182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-391a34ba-b065-4058-ab9b-bea540eca2c4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:54.243672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3d55d7db-680c-44e1-9947-507600598922 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8f763b2938124a8e941c075770df5704', 'request_id': 'req-3d55d7db-680c-44e1-9947-507600598922'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:54.265051 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3d55d7db-680c-44e1-9947-507600598922 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8f763b2938124a8e941c075770df5704', 'request_id': 'req-3d55d7db-680c-44e1-9947-507600598922'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:54.278120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3d55d7db-680c-44e1-9947-507600598922 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8f763b2938124a8e941c075770df5704', 'request_id': 'req-3d55d7db-680c-44e1-9947-507600598922'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:54.305618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-391a34ba-b065-4058-ab9b-bea540eca2c4 None None] MFA Rules not processed for user `4f1948e8724647bd893015835a50d8db`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:54.306898 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-391a34ba-b065-4058-ab9b-bea540eca2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:54.311567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3d55d7db-680c-44e1-9947-507600598922 admin admin] The token cache is being invalidate because project 8f763b2938124a8e941c075770df5704 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:21:54.311920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3d55d7db-680c-44e1-9947-507600598922 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:54.312768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3d55d7db-680c-44e1-9947-507600598922 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:54.317020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 826/1675] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:21:54 2022] DELETE /identity/v3/projects/8f763b2938124a8e941c075770df5704 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:54.322227 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7db20f-625f-418f-b15d-f3e889ecd79a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:54.322629 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7db20f-625f-418f-b15d-f3e889ecd79a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:54.323168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d7db20f-625f-418f-b15d-f3e889ecd79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:54.388805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9d7db20f-625f-418f-b15d-f3e889ecd79a None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:54.390499 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9d7db20f-625f-418f-b15d-f3e889ecd79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:54.451463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:54.546047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 850/1676] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 350 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:54.565829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a34ba-b065-4058-ab9b-bea540eca2c4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:54.567472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-391a34ba-b065-4058-ab9b-bea540eca2c4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:54.595472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 827/1677] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 275 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:21:54.605221 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f1b8c-6f7c-42de-9b2c-398f4c5bb741 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:54.605824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f1b8c-6f7c-42de-9b2c-398f4c5bb741 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:54.606319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b67f1b8c-6f7c-42de-9b2c-398f4c5bb741 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:54.717473 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b67f1b8c-6f7c-42de-9b2c-398f4c5bb741 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:54.718872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b67f1b8c-6f7c-42de-9b2c-398f4c5bb741 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:54.731788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 828/1678] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:21:54.733357 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4330382-1e3a-4043-896d-7d5843b3c77b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:54.733719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4330382-1e3a-4043-896d-7d5843b3c77b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:54.734138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4330382-1e3a-4043-896d-7d5843b3c77b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:54.789608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-391a34ba-b065-4058-ab9b-bea540eca2c4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:54.807580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1574378-eee5-4f1d-baec-c3c223830093 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:54.808247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1574378-eee5-4f1d-baec-c3c223830093 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:54.808535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1574378-eee5-4f1d-baec-c3c223830093 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:54.808817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1574378-eee5-4f1d-baec-c3c223830093 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:54.817296 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a4330382-1e3a-4043-896d-7d5843b3c77b None None] MFA Rules not processed for user `301f5bb1404040d2b7e5c9b55312d515`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:54.822578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a4330382-1e3a-4043-896d-7d5843b3c77b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:54.835941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1574378-eee5-4f1d-baec-c3c223830093 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:54.840268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1574378-eee5-4f1d-baec-c3c223830093 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:54.857421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:54.892614 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 851/1679] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:54 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 327 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:54.898262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1574378-eee5-4f1d-baec-c3c223830093 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:54.964735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1574378-eee5-4f1d-baec-c3c223830093 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:54.982472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9cade-25b3-4329-a436-dd4a73a7077b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:54.984937 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9cade-25b3-4329-a436-dd4a73a7077b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:54.987546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9cade-25b3-4329-a436-dd4a73a7077b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:54.987862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b9cade-25b3-4329-a436-dd4a73a7077b admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:54.989837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9cade-25b3-4329-a436-dd4a73a7077b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:21:54.990214 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9cade-25b3-4329-a436-dd4a73a7077b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:55.001916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b9cade-25b3-4329-a436-dd4a73a7077b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:55.030560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 829/1680] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:54 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 298 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:55.042799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90d63-191c-4488-98a2-5141af220838 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:55.043353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90d63-191c-4488-98a2-5141af220838 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:55.043717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63c90d63-191c-4488-98a2-5141af220838 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:55.067916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 852/1681] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:21:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:21:55.069420 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9cade-25b3-4329-a436-dd4a73a7077b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:55.078346 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-63c90d63-191c-4488-98a2-5141af220838 None None] MFA Rules not processed for user `301f5bb1404040d2b7e5c9b55312d515`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:55.079874 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-63c90d63-191c-4488-98a2-5141af220838 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:55.104185 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 830/1682] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 63 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:21:55.121668 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b9cade-25b3-4329-a436-dd4a73a7077b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:55.149942 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33090d47-ca96-402e-bf46-1e5b442bd749 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:55.151271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33090d47-ca96-402e-bf46-1e5b442bd749 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:55.153831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33090d47-ca96-402e-bf46-1e5b442bd749 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:55.154547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33090d47-ca96-402e-bf46-1e5b442bd749 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:55.156095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33090d47-ca96-402e-bf46-1e5b442bd749 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:55.165332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33090d47-ca96-402e-bf46-1e5b442bd749 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:55.258972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 853/1683] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:21:55 2022] POST /identity/v3/projects => generated 403 bytes in 190 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:55.259734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90d63-191c-4488-98a2-5141af220838 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:55.288573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63c90d63-191c-4488-98a2-5141af220838 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:55.338369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33090d47-ca96-402e-bf46-1e5b442bd749 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:55.494527 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33090d47-ca96-402e-bf46-1e5b442bd749 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:55.505211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc12d830-bd59-4c3d-95fa-cc24e4702f21 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:55.505889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12d830-bd59-4c3d-95fa-cc24e4702f21 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:55.506176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12d830-bd59-4c3d-95fa-cc24e4702f21 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:55.506455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc12d830-bd59-4c3d-95fa-cc24e4702f21 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:55.530954 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1208d-d099-4094-8557-e12238cec486 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:55.532117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1208d-d099-4094-8557-e12238cec486 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:55.551347 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1208d-d099-4094-8557-e12238cec486 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:55.563271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bd1208d-d099-4094-8557-e12238cec486 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:55.564953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1208d-d099-4094-8557-e12238cec486 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:55.567733 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bd1208d-d099-4094-8557-e12238cec486 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:55.606088 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 831/1684] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:21:55 2022] POST /identity/v3/users => generated 302 bytes in 347 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:55.607114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1208d-d099-4094-8557-e12238cec486 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:55.649739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bd1208d-d099-4094-8557-e12238cec486 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:55.670608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5681ce3-c20d-4c0b-a019-8247d2ebf25d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:55.671304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5681ce3-c20d-4c0b-a019-8247d2ebf25d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:55.671587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5681ce3-c20d-4c0b-a019-8247d2ebf25d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:55.671864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5681ce3-c20d-4c0b-a019-8247d2ebf25d admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:55.672598 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5681ce3-c20d-4c0b-a019-8247d2ebf25d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:55.680701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5681ce3-c20d-4c0b-a019-8247d2ebf25d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:55.701956 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12d830-bd59-4c3d-95fa-cc24e4702f21 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:55.703669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc12d830-bd59-4c3d-95fa-cc24e4702f21 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:55.708709 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 832/1685] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:55.712347 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5681ce3-c20d-4c0b-a019-8247d2ebf25d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:55.729111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 854/1686] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:55 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 391 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:21:55.735800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5681ce3-c20d-4c0b-a019-8247d2ebf25d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:55.751857 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df70b3a-2b8e-4361-8b20-e6c1a9d55982 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:55.751857 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df70b3a-2b8e-4361-8b20-e6c1a9d55982 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:55.751857 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0df70b3a-2b8e-4361-8b20-e6c1a9d55982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:55.755634 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58c69f-5407-4184-a7fe-6ff062e94adb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:55.756325 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58c69f-5407-4184-a7fe-6ff062e94adb admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:55.756697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58c69f-5407-4184-a7fe-6ff062e94adb admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:55.756975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a58c69f-5407-4184-a7fe-6ff062e94adb admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:55.757880 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58c69f-5407-4184-a7fe-6ff062e94adb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:55.759670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a58c69f-5407-4184-a7fe-6ff062e94adb admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:55.778251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0df70b3a-2b8e-4361-8b20-e6c1a9d55982 None None] MFA Rules not processed for user `1b725c28490f4f90b5eec565cd0fb603`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:55.779655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0df70b3a-2b8e-4361-8b20-e6c1a9d55982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:55.813154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 833/1687] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:55 2022] GET /identity/v3/roles => generated 1420 bytes in 99 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:55.813892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58c69f-5407-4184-a7fe-6ff062e94adb admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:55.849467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a58c69f-5407-4184-a7fe-6ff062e94adb admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:55.869066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b308a-3943-41a5-9637-115d2257c316 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:55.871445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b308a-3943-41a5-9637-115d2257c316 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:55.872807 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b308a-3943-41a5-9637-115d2257c316 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:55.873908 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23b308a-3943-41a5-9637-115d2257c316 admin admin] PATH_INFO: `/v3/projects/707693ce2bbd4f2cb2703a2e5f612d1f/users/c4af560007274853a45c9177b7530e06/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:55.881350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:55.916859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 855/1688] 10.222.0.74 () {58 vars in 1015 bytes} [Thu May 26 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:21:55.946430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b308a-3943-41a5-9637-115d2257c316 admin admin] RBAC: Authorizing `identity:create_grant(project_id=707693ce2bbd4f2cb2703a2e5f612d1f, user_id=c4af560007274853a45c9177b7530e06, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:55.955800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f23b308a-3943-41a5-9637-115d2257c316 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:55.986026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 834/1689] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:55 2022] PUT /identity/v3/projects/707693ce2bbd4f2cb2703a2e5f612d1f/users/c4af560007274853a45c9177b7530e06/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 163 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:55.990876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790327f-5fff-498c-88b8-0b0597de84bb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:55.991262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790327f-5fff-498c-88b8-0b0597de84bb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:55.991612 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6790327f-5fff-498c-88b8-0b0597de84bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:56.012387 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b308a-3943-41a5-9637-115d2257c316 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:56.018994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f23b308a-3943-41a5-9637-115d2257c316 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:56.029324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:56.066371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6790327f-5fff-498c-88b8-0b0597de84bb None None] MFA Rules not processed for user `c4af560007274853a45c9177b7530e06`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:56.067674 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6790327f-5fff-498c-88b8-0b0597de84bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:56.146179 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23b308a-3943-41a5-9637-115d2257c316 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:56.164160 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88bfa0-4c44-428a-94b9-49db4f70b584 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:56.164961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88bfa0-4c44-428a-94b9-49db4f70b584 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:56.165254 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88bfa0-4c44-428a-94b9-49db4f70b584 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:56.165506 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c88bfa0-4c44-428a-94b9-49db4f70b584 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:56.177940 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88bfa0-4c44-428a-94b9-49db4f70b584 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:56.180356 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c88bfa0-4c44-428a-94b9-49db4f70b584 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:56.194969 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 835/1690] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:56 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 183 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:21:56.210898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88bfa0-4c44-428a-94b9-49db4f70b584 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:56.213858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3c88bfa0-4c44-428a-94b9-49db4f70b584 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:56.254172 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 856/1691] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:55 2022] POST /identity/v3/auth/tokens => generated 3270 bytes in 264 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:56.258449 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790327f-5fff-498c-88b8-0b0597de84bb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:56.324716 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6790327f-5fff-498c-88b8-0b0597de84bb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:56.330568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c2549-7ff2-492b-8727-e88e7c3de83f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:56.331248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c2549-7ff2-492b-8727-e88e7c3de83f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:56.331531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c2549-7ff2-492b-8727-e88e7c3de83f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:56.331811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c2549-7ff2-492b-8727-e88e7c3de83f admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:56.332516 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c2549-7ff2-492b-8727-e88e7c3de83f admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:56.334629 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c2549-7ff2-492b-8727-e88e7c3de83f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:56.375119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 857/1692] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:21:56 2022] POST /identity/v3/projects => generated 405 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:21:56.378472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c2549-7ff2-492b-8727-e88e7c3de83f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:56.423858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c88bfa0-4c44-428a-94b9-49db4f70b584 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:56.533343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c2549-7ff2-492b-8727-e88e7c3de83f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:56.550121 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b6763-66f8-49e2-adaf-c117e07cd3d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:56.550812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b6763-66f8-49e2-adaf-c117e07cd3d7 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:56.551088 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b6763-66f8-49e2-adaf-c117e07cd3d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:56.551359 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a18b6763-66f8-49e2-adaf-c117e07cd3d7 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:56.552325 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b6763-66f8-49e2-adaf-c117e07cd3d7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:56.556427 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a18b6763-66f8-49e2-adaf-c117e07cd3d7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:56.605279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:56.606172 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:56.606745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:56.606745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] PATH_INFO: `/v3/projects/f5c63069e6a44e01877ad58691297b62` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:56.613775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 858/1693] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:21:56 2022] POST /identity/v3/users => generated 309 bytes in 235 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:21:56.615704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f5c63069e6a44e01877ad58691297b62)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:56.617739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b6763-66f8-49e2-adaf-c117e07cd3d7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:56.624930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:56.642917 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a18b6763-66f8-49e2-adaf-c117e07cd3d7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:56.663687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad1a1e-5df2-4f9d-9d47-70774bf212cf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:56.664517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad1a1e-5df2-4f9d-9d47-70774bf212cf admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:56.665022 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad1a1e-5df2-4f9d-9d47-70774bf212cf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:56.665447 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caad1a1e-5df2-4f9d-9d47-70774bf212cf admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:56.667902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad1a1e-5df2-4f9d-9d47-70774bf212cf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:56.670452 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caad1a1e-5df2-4f9d-9d47-70774bf212cf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:56.717749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 859/1694] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:56 2022] GET /identity/v3/roles => generated 1420 bytes in 101 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:56.725280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad1a1e-5df2-4f9d-9d47-70774bf212cf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:56.743126 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=1,keystone:DELETE=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:56.752961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:56.764734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f5c63069e6a44e01877ad58691297b62', 'request_id': 'req-d88c6c42-d51f-4833-8094-eecc8545aca0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:56.774434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caad1a1e-5df2-4f9d-9d47-70774bf212cf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:56.783916 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f5c63069e6a44e01877ad58691297b62', 'request_id': 'req-d88c6c42-d51f-4833-8094-eecc8545aca0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:56.795055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f5c63069e6a44e01877ad58691297b62', 'request_id': 'req-d88c6c42-d51f-4833-8094-eecc8545aca0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:56.823819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] The token cache is being invalidate because project f5c63069e6a44e01877ad58691297b62 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:21:56.825415 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:56.827239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:56.832626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 836/1695] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:21:56 2022] DELETE /identity/v3/projects/f5c63069e6a44e01877ad58691297b62 => generated 0 bytes in 637 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:56.837273 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:56.847019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:57.006214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88c6c42-d51f-4833-8094-eecc8545aca0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:57.027394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6baf6ac3-24ac-4ef8-88e7-b1e630ea0318 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:57.028304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf6ac3-24ac-4ef8-88e7-b1e630ea0318 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:57.028591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf6ac3-24ac-4ef8-88e7-b1e630ea0318 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:57.029739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6baf6ac3-24ac-4ef8-88e7-b1e630ea0318 admin admin] PATH_INFO: `/v3/users/2e8e5985ac4941b3951072c16aa1d0fa` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:57.034135 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf6ac3-24ac-4ef8-88e7-b1e630ea0318 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2e8e5985ac4941b3951072c16aa1d0fa)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:57.037037 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d898ec88-bfe3-4058-929f-be69106f50c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:57.042184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898ec88-bfe3-4058-929f-be69106f50c1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:57.042480 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898ec88-bfe3-4058-929f-be69106f50c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:57.042792 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d898ec88-bfe3-4058-929f-be69106f50c1 admin admin] PATH_INFO: `/v3/projects/9aa35bfced3549219c432f8e2cc62cd6/users/ea5aff8de336472c8aee89b01eecb070/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:57.044484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6baf6ac3-24ac-4ef8-88e7-b1e630ea0318 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:57.087929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898ec88-bfe3-4058-929f-be69106f50c1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa35bfced3549219c432f8e2cc62cd6, user_id=ea5aff8de336472c8aee89b01eecb070, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:57.090684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d898ec88-bfe3-4058-929f-be69106f50c1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:57.147616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 860/1696] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:56 2022] PUT /identity/v3/projects/9aa35bfced3549219c432f8e2cc62cd6/users/ea5aff8de336472c8aee89b01eecb070/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 420 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:57.149201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843a2e9-25ca-4e46-a562-8e1e0f9b726e None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:57.149501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843a2e9-25ca-4e46-a562-8e1e0f9b726e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:57.149786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f843a2e9-25ca-4e46-a562-8e1e0f9b726e None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:57.158647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 861/1697] 10.222.0.64 () {54 vars in 912 bytes} [Thu May 26 18:21:57 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:21:57.159622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843a2e9-25ca-4e46-a562-8e1e0f9b726e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:57.162941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f843a2e9-25ca-4e46-a562-8e1e0f9b726e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:57.347817 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6baf6ac3-24ac-4ef8-88e7-b1e630ea0318 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2e8e5985ac4941b3951072c16aa1d0fa'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:57.386004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6baf6ac3-24ac-4ef8-88e7-b1e630ea0318 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2e8e5985ac4941b3951072c16aa1d0fa'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:57.389199 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6baf6ac3-24ac-4ef8-88e7-b1e630ea0318 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2e8e5985ac4941b3951072c16aa1d0fa'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:57.431416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6baf6ac3-24ac-4ef8-88e7-b1e630ea0318 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2e8e5985ac4941b3951072c16aa1d0fa'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:57.457533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6baf6ac3-24ac-4ef8-88e7-b1e630ea0318 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2e8e5985ac4941b3951072c16aa1d0fa'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:57.469112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f843a2e9-25ca-4e46-a562-8e1e0f9b726e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:57.482485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 837/1698] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:21:56 2022] DELETE /identity/v3/users/2e8e5985ac4941b3951072c16aa1d0fa => generated 0 bytes in 641 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:57.486934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54b8d7-af7a-4019-a92f-6f6d6ad6fe9c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:57.487260 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54b8d7-af7a-4019-a92f-6f6d6ad6fe9c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:57.488710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e54b8d7-af7a-4019-a92f-6f6d6ad6fe9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:57.490234 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73c8162c-617e-4e93-8ea4-a1e612aabcb4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:57.493211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8162c-617e-4e93-8ea4-a1e612aabcb4 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:57.493546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8162c-617e-4e93-8ea4-a1e612aabcb4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:57.493836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73c8162c-617e-4e93-8ea4-a1e612aabcb4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:57.494596 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8162c-617e-4e93-8ea4-a1e612aabcb4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:57.501871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73c8162c-617e-4e93-8ea4-a1e612aabcb4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:57.552602 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8e54b8d7-af7a-4019-a92f-6f6d6ad6fe9c None None] MFA Rules not processed for user `1b725c28490f4f90b5eec565cd0fb603`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:57.552798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 862/1699] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:21:57 2022] GET /identity/v3/roles => generated 1420 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:21:57.553983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89179d-370f-45e6-b026-c83786d8483c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:57.554272 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89179d-370f-45e6-b026-c83786d8483c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:57.554547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c89179d-370f-45e6-b026-c83786d8483c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:57.555791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8e54b8d7-af7a-4019-a92f-6f6d6ad6fe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:57.620418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2c89179d-370f-45e6-b026-c83786d8483c None None] MFA Rules not processed for user `b2d13c401ad84870a8d76d49a8054056`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:57.621906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2c89179d-370f-45e6-b026-c83786d8483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:57.689916 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:57.737548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 838/1700] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:21:57 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:57.738704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54b8d7-af7a-4019-a92f-6f6d6ad6fe9c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:57.743578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8e54b8d7-af7a-4019-a92f-6f6d6ad6fe9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:57.771319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 863/1701] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:57 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:57.772308 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89179d-370f-45e6-b026-c83786d8483c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:57.775648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2c89179d-370f-45e6-b026-c83786d8483c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:57.816339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:57.917679 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c89179d-370f-45e6-b026-c83786d8483c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:57.928125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a7d15-5845-4c5d-9db8-979744d0a438 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:57.929112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a7d15-5845-4c5d-9db8-979744d0a438 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:57.929452 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a7d15-5845-4c5d-9db8-979744d0a438 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:57.929660 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245a7d15-5845-4c5d-9db8-979744d0a438 admin admin] PATH_INFO: `/v3/projects/9aa35bfced3549219c432f8e2cc62cd6/users/ea5aff8de336472c8aee89b01eecb070/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:57.933718 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a7d15-5845-4c5d-9db8-979744d0a438 admin admin] RBAC: Authorizing `identity:create_grant(project_id=9aa35bfced3549219c432f8e2cc62cd6, user_id=ea5aff8de336472c8aee89b01eecb070, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:57.942831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245a7d15-5845-4c5d-9db8-979744d0a438 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:57.960143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e54b8d7-af7a-4019-a92f-6f6d6ad6fe9c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:57.983782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:57.987645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:57.991933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:57.992721 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] PATH_INFO: `/v3/projects/7ad0456f492447268046fd6c7b112ce3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:57.996432 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] RBAC: Authorizing `identity:delete_project(project_id=7ad0456f492447268046fd6c7b112ce3)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:57.998484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 864/1702] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:21:57 2022] PUT /identity/v3/projects/9aa35bfced3549219c432f8e2cc62cd6/users/ea5aff8de336472c8aee89b01eecb070/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:58.006127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a7d15-5845-4c5d-9db8-979744d0a438 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:58.010388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:58.013796 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-245a7d15-5845-4c5d-9db8-979744d0a438 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:58.264210 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7ad0456f492447268046fd6c7b112ce3', 'request_id': 'req-eb637a88-2efa-4a42-b1eb-949e4db3200e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:58.283033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7ad0456f492447268046fd6c7b112ce3', 'request_id': 'req-eb637a88-2efa-4a42-b1eb-949e4db3200e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:58.289626 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245a7d15-5845-4c5d-9db8-979744d0a438 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:58.298320 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7ad0456f492447268046fd6c7b112ce3', 'request_id': 'req-eb637a88-2efa-4a42-b1eb-949e4db3200e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:58.335220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] The token cache is being invalidate because project 7ad0456f492447268046fd6c7b112ce3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:21:58.335640 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:58.343902 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:58.346598 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 839/1703] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:21:57 2022] DELETE /identity/v3/projects/7ad0456f492447268046fd6c7b112ce3 => generated 0 bytes in 608 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:58.347196 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:58.350086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:58.423612 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-089d60f9-e65f-4463-ad5a-45d7cec41e94 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:58.424453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d60f9-e65f-4463-ad5a-45d7cec41e94 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:58.425025 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d60f9-e65f-4463-ad5a-45d7cec41e94 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:58.425415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-089d60f9-e65f-4463-ad5a-45d7cec41e94 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:58.431056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-089d60f9-e65f-4463-ad5a-45d7cec41e94 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:58.451984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d60f9-e65f-4463-ad5a-45d7cec41e94 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:58.454570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-089d60f9-e65f-4463-ad5a-45d7cec41e94 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:58.476936 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 865/1704] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:57 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:58.480603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0e570-acd3-439c-8f8e-b93a9ce44d6e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:58.483068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0e570-acd3-439c-8f8e-b93a9ce44d6e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:58.490453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44f0e570-acd3-439c-8f8e-b93a9ce44d6e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:58.551589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-44f0e570-acd3-439c-8f8e-b93a9ce44d6e None None] MFA Rules not processed for user `ea5aff8de336472c8aee89b01eecb070`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:58.553015 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-44f0e570-acd3-439c-8f8e-b93a9ce44d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:58.565417 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb637a88-2efa-4a42-b1eb-949e4db3200e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:58.589098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e52e965-33dc-43aa-9c64-5b48473a2abd service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:58.589798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52e965-33dc-43aa-9c64-5b48473a2abd service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:58.590206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52e965-33dc-43aa-9c64-5b48473a2abd service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:58.590546 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e52e965-33dc-43aa-9c64-5b48473a2abd service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:58.606440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7e52e965-33dc-43aa-9c64-5b48473a2abd service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:58.626099 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:58.652285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 866/1705] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:58 2022] POST /identity/v3/auth/tokens => generated 3339 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:58.653457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0e570-acd3-439c-8f8e-b93a9ce44d6e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:58.654933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-44f0e570-acd3-439c-8f8e-b93a9ce44d6e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:58.678547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:58.733505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44f0e570-acd3-439c-8f8e-b93a9ce44d6e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:58.739866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:58.740850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:58.741281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:58.741669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] PATH_INFO: `/v3/projects/58594db6c7f641bcb392552a49c75189` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:58.743937 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] RBAC: Authorizing `identity:delete_project(project_id=58594db6c7f641bcb392552a49c75189)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:58.746547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:58.810952 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '58594db6c7f641bcb392552a49c75189', 'request_id': 'req-dd00e097-ec81-4acb-b7e8-2515cdf04d21'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:58.828714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '58594db6c7f641bcb392552a49c75189', 'request_id': 'req-dd00e097-ec81-4acb-b7e8-2515cdf04d21'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:58.848848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '58594db6c7f641bcb392552a49c75189', 'request_id': 'req-dd00e097-ec81-4acb-b7e8-2515cdf04d21'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:58.865602 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52e965-33dc-43aa-9c64-5b48473a2abd service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:58.867157 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e52e965-33dc-43aa-9c64-5b48473a2abd service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:58.876355 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] The token cache is being invalidate because project 58594db6c7f641bcb392552a49c75189 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:21:58.877016 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:58.878401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:58.882112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 867/1706] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:21:58 2022] DELETE /identity/v3/projects/58594db6c7f641bcb392552a49c75189 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:58.883654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:58.886973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:58.909932 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 840/1707] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:58 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 563 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:21:58.933223 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a4b5f-a269-4fb5-a7e3-e9b6817becf2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:58.934084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a4b5f-a269-4fb5-a7e3-e9b6817becf2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:58.936429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e2a4b5f-a269-4fb5-a7e3-e9b6817becf2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:59.021217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4e2a4b5f-a269-4fb5-a7e3-e9b6817becf2 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:59.026452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4e2a4b5f-a269-4fb5-a7e3-e9b6817becf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:59.218867 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd00e097-ec81-4acb-b7e8-2515cdf04d21 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:59.267774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:59.269265 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:59.269571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:59.269841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b admin admin] PATH_INFO: `/v3/projects/588820ce6896446282dbec62e3352340` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:59.272830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b admin admin] RBAC: Authorizing `identity:delete_project(project_id=588820ce6896446282dbec62e3352340)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:21:59.274298 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 841/1708] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 351 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:21:59.275194 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a4b5f-a269-4fb5-a7e3-e9b6817becf2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:21:59.278163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4e2a4b5f-a269-4fb5-a7e3-e9b6817becf2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:59.286072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:21:59.411132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:21:59.526563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '588820ce6896446282dbec62e3352340', 'request_id': 'req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:59.531531 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e2a4b5f-a269-4fb5-a7e3-e9b6817becf2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:21:59.567411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '588820ce6896446282dbec62e3352340', 'request_id': 'req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:59.597553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '588820ce6896446282dbec62e3352340', 'request_id': 'req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:59.681839 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b admin admin] The token cache is being invalidate because project 588820ce6896446282dbec62e3352340 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:21:59.682161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:59.696118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6e6c38c1-429d-4571-bb3a-cd1d5457c64b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:21:59.708171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 868/1709] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:21:58 2022] DELETE /identity/v3/projects/588820ce6896446282dbec62e3352340 => generated 0 bytes in 820 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:21:59.714624 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03e851-5776-493c-a888-0d5a578a79dc None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:59.714822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03e851-5776-493c-a888-0d5a578a79dc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:59.719231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c03e851-5776-493c-a888-0d5a578a79dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:59.827243 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7342a12b-2986-4c79-8f83-f551d735e014 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:21:59.828442 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342a12b-2986-4c79-8f83-f551d735e014 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:21:59.828967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5c03e851-5776-493c-a888-0d5a578a79dc None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:21:59.829228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342a12b-2986-4c79-8f83-f551d735e014 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:21:59.830149 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7342a12b-2986-4c79-8f83-f551d735e014 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:21:59.830710 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5c03e851-5776-493c-a888-0d5a578a79dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:59.836928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7342a12b-2986-4c79-8f83-f551d735e014 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:21:59.975179 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:00.138062 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 869/1710] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:21:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 429 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:00.150401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5ff1f-655b-4579-bdf0-7ad14523ebdb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:00.150721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5ff1f-655b-4579-bdf0-7ad14523ebdb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:00.151007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68a5ff1f-655b-4579-bdf0-7ad14523ebdb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:00.206672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342a12b-2986-4c79-8f83-f551d735e014 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:00.206872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-68a5ff1f-655b-4579-bdf0-7ad14523ebdb None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:00.208519 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-68a5ff1f-655b-4579-bdf0-7ad14523ebdb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:00.208638 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7342a12b-2986-4c79-8f83-f551d735e014 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:00.222992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 870/1711] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:00.227607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6309575-ecae-4135-a659-359a32329e16 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:00.227898 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6309575-ecae-4135-a659-359a32329e16 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:00.228196 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6309575-ecae-4135-a659-359a32329e16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:00.272417 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 842/1712] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:21:59 2022] GET /identity/v3/auth/tokens => generated 3339 bytes in 997 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:00.274095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da0f21-009a-42a3-933c-3f08d1b54abb None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:00.274402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da0f21-009a-42a3-933c-3f08d1b54abb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:00.274700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2da0f21-009a-42a3-933c-3f08d1b54abb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:00.319620 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c6309575-ecae-4135-a659-359a32329e16 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:00.323217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c6309575-ecae-4135-a659-359a32329e16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:00.370939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 871/1713] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:00.373470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be7a2f-7764-46ad-ab80-83f027f5f7d7 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:00.374830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be7a2f-7764-46ad-ab80-83f027f5f7d7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:00.375247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20be7a2f-7764-46ad-ab80-83f027f5f7d7 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:00.380651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 872/1714] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 26 18:22:00 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:22:00.382679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c2da0f21-009a-42a3-933c-3f08d1b54abb None None] MFA Rules not processed for user `301f5bb1404040d2b7e5c9b55312d515`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:00.386351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c2da0f21-009a-42a3-933c-3f08d1b54abb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:00.393269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b7fe5-f0d2-4bb6-a948-b50122466335 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:00.394575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b7fe5-f0d2-4bb6-a948-b50122466335 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:00.401310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b34b7fe5-f0d2-4bb6-a948-b50122466335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:00.440835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b34b7fe5-f0d2-4bb6-a948-b50122466335 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:00.442252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b34b7fe5-f0d2-4bb6-a948-b50122466335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:00.457106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 873/1715] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:00.458222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b7fe5-f0d2-4bb6-a948-b50122466335 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:00.487413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b34b7fe5-f0d2-4bb6-a948-b50122466335 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:00.519727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4e1c6d0-3391-431e-a804-60570d27006f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:00.520596 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1c6d0-3391-431e-a804-60570d27006f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:00.521246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1c6d0-3391-431e-a804-60570d27006f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:00.521636 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4e1c6d0-3391-431e-a804-60570d27006f admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:00.527783 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1c6d0-3391-431e-a804-60570d27006f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:00.528443 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1c6d0-3391-431e-a804-60570d27006f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:00.530650 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4e1c6d0-3391-431e-a804-60570d27006f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:00.620909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 874/1716] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:00.623782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814de32-e4e9-42ea-934d-ccee6e2c15ee None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:00.626406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814de32-e4e9-42ea-934d-ccee6e2c15ee None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:00.627981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a814de32-e4e9-42ea-934d-ccee6e2c15ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:00.730773 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 843/1717] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 458 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:00.731790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da0f21-009a-42a3-933c-3f08d1b54abb None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:00.752056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a814de32-e4e9-42ea-934d-ccee6e2c15ee None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:00.759156 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a814de32-e4e9-42ea-934d-ccee6e2c15ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:00.799640 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2da0f21-009a-42a3-933c-3f08d1b54abb None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:00.807081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 875/1718] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:00.827471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fa8bf-4939-4614-8c7a-700204782573 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:00.830934 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fa8bf-4939-4614-8c7a-700204782573 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:00.831651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0fa8bf-4939-4614-8c7a-700204782573 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:00.844854 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4362a-faaa-4f2d-b4ba-670452c51a2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:00.849867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4362a-faaa-4f2d-b4ba-670452c51a2c admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:00.850184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4362a-faaa-4f2d-b4ba-670452c51a2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:00.850476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8e4362a-faaa-4f2d-b4ba-670452c51a2c admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:00.851195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4362a-faaa-4f2d-b4ba-670452c51a2c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:00.851519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4362a-faaa-4f2d-b4ba-670452c51a2c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:00.868657 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8e4362a-faaa-4f2d-b4ba-670452c51a2c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:00.934569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9e0fa8bf-4939-4614-8c7a-700204782573 None None] MFA Rules not processed for user `97f259ac2eb4425f8b4dcffeccdcd439`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:00.936253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9e0fa8bf-4939-4614-8c7a-700204782573 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:00.956571 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 844/1719] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:00.960904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4362a-faaa-4f2d-b4ba-670452c51a2c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:00.975686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f8e4362a-faaa-4f2d-b4ba-670452c51a2c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:01.059756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8e4362a-faaa-4f2d-b4ba-670452c51a2c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:01.089414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563eb71-2408-48aa-b278-fcc3fe2aa6f8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:01.090332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563eb71-2408-48aa-b278-fcc3fe2aa6f8 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:01.090625 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563eb71-2408-48aa-b278-fcc3fe2aa6f8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:01.100589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0563eb71-2408-48aa-b278-fcc3fe2aa6f8 admin admin] PATH_INFO: `/v3/users/c4af560007274853a45c9177b7530e06` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:01.105318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563eb71-2408-48aa-b278-fcc3fe2aa6f8 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c4af560007274853a45c9177b7530e06)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:01.111519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0563eb71-2408-48aa-b278-fcc3fe2aa6f8 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:01.254545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 876/1720] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 26 18:22:00 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 444 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:01.255727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fa8bf-4939-4614-8c7a-700204782573 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:01.282684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:01.287053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0563eb71-2408-48aa-b278-fcc3fe2aa6f8 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c4af560007274853a45c9177b7530e06'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:01.304691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0fa8bf-4939-4614-8c7a-700204782573 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:01.306475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0563eb71-2408-48aa-b278-fcc3fe2aa6f8 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c4af560007274853a45c9177b7530e06'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:01.307289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0563eb71-2408-48aa-b278-fcc3fe2aa6f8 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c4af560007274853a45c9177b7530e06'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:01.329811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f2d4d-adfc-4413-910e-65ad4020dbb9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:01.330783 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f2d4d-adfc-4413-910e-65ad4020dbb9 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:01.331463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f2d4d-adfc-4413-910e-65ad4020dbb9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:01.331963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-040f2d4d-adfc-4413-910e-65ad4020dbb9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:01.332977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f2d4d-adfc-4413-910e-65ad4020dbb9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:01.343471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-040f2d4d-adfc-4413-910e-65ad4020dbb9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:01.376442 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0563eb71-2408-48aa-b278-fcc3fe2aa6f8 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c4af560007274853a45c9177b7530e06'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:01.395792 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0563eb71-2408-48aa-b278-fcc3fe2aa6f8 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c4af560007274853a45c9177b7530e06'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:01.421176 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 845/1721] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:00 2022] DELETE /identity/v3/users/c4af560007274853a45c9177b7530e06 => generated 0 bytes in 464 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:01.424110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 877/1722] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:01 2022] POST /identity/v3/projects => generated 373 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:01.425437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f2d4d-adfc-4413-910e-65ad4020dbb9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:01.427914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-040f2d4d-adfc-4413-910e-65ad4020dbb9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:01.432933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563eb71-2408-48aa-b278-fcc3fe2aa6f8 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:01.442598 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0563eb71-2408-48aa-b278-fcc3fe2aa6f8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:01.557730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:01.664893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-040f2d4d-adfc-4413-910e-65ad4020dbb9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:01.671322 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1673c63a-7340-4bde-bc9a-d1526a3f8c7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:01.672126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673c63a-7340-4bde-bc9a-d1526a3f8c7d admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:01.672547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673c63a-7340-4bde-bc9a-d1526a3f8c7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:01.672936 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1673c63a-7340-4bde-bc9a-d1526a3f8c7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:01.673793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673c63a-7340-4bde-bc9a-d1526a3f8c7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:01.679100 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1673c63a-7340-4bde-bc9a-d1526a3f8c7d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:01.742241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0563eb71-2408-48aa-b278-fcc3fe2aa6f8 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:01.754811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 878/1723] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:01 2022] POST /identity/v3/projects => generated 369 bytes in 330 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:01.756470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b728e24-fb4d-43e7-afe0-68956253df80 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:01.756870 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b728e24-fb4d-43e7-afe0-68956253df80 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:01.757387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b728e24-fb4d-43e7-afe0-68956253df80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:01.794422 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad10c1-7a8d-40ae-a54e-4804c3ef6f23 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:01.795204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad10c1-7a8d-40ae-a54e-4804c3ef6f23 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:01.798388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad10c1-7a8d-40ae-a54e-4804c3ef6f23 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:01.798753 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cad10c1-7a8d-40ae-a54e-4804c3ef6f23 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:01.801648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad10c1-7a8d-40ae-a54e-4804c3ef6f23 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:01.803668 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad10c1-7a8d-40ae-a54e-4804c3ef6f23 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:01.809474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cad10c1-7a8d-40ae-a54e-4804c3ef6f23 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:01.824978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8b728e24-fb4d-43e7-afe0-68956253df80 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:01.834578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8b728e24-fb4d-43e7-afe0-68956253df80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:01.857291 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 846/1724] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 431 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:01.858345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad10c1-7a8d-40ae-a54e-4804c3ef6f23 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:01.867337 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1cad10c1-7a8d-40ae-a54e-4804c3ef6f23 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:01.918975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cad10c1-7a8d-40ae-a54e-4804c3ef6f23 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:02.055444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 879/1725] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:01 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 300 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:02.056455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b728e24-fb4d-43e7-afe0-68956253df80 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:02.076974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b60b9-ad93-4e16-af2b-a2a61872a501 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:02.078639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b60b9-ad93-4e16-af2b-a2a61872a501 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:02.079504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b60b9-ad93-4e16-af2b-a2a61872a501 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:02.079953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00b60b9-ad93-4e16-af2b-a2a61872a501 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:02.080913 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b60b9-ad93-4e16-af2b-a2a61872a501 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:02.083115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b00b60b9-ad93-4e16-af2b-a2a61872a501 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:02.093323 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b728e24-fb4d-43e7-afe0-68956253df80 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:02.115567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beaae4-90ba-43cb-a02e-9ce0ba7f729f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:02.116366 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beaae4-90ba-43cb-a02e-9ce0ba7f729f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:02.118906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beaae4-90ba-43cb-a02e-9ce0ba7f729f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:02.119452 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6beaae4-90ba-43cb-a02e-9ce0ba7f729f admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:02.120232 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 847/1726] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:01 2022] POST /identity/v3/users => generated 287 bytes in 262 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:02.121094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6beaae4-90ba-43cb-a02e-9ce0ba7f729f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:02.121512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b60b9-ad93-4e16-af2b-a2a61872a501 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:02.128925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6beaae4-90ba-43cb-a02e-9ce0ba7f729f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:02.136497 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00b60b9-ad93-4e16-af2b-a2a61872a501 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:02.168593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190d963-4d8f-44be-9c8c-44022bf1abfa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:02.169951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190d963-4d8f-44be-9c8c-44022bf1abfa admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:02.170196 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190d963-4d8f-44be-9c8c-44022bf1abfa admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:02.170478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b190d963-4d8f-44be-9c8c-44022bf1abfa admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:02.174954 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190d963-4d8f-44be-9c8c-44022bf1abfa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:02.189738 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b190d963-4d8f-44be-9c8c-44022bf1abfa admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:02.212005 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 880/1727] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:02 2022] POST /identity/v3/users => generated 285 bytes in 156 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:02.213417 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beaae4-90ba-43cb-a02e-9ce0ba7f729f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:02.224170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e6beaae4-90ba-43cb-a02e-9ce0ba7f729f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:02.261722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 848/1728] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:02 2022] POST /identity/v3/projects => generated 391 bytes in 140 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:02.262993 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190d963-4d8f-44be-9c8c-44022bf1abfa admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:02.446961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b190d963-4d8f-44be-9c8c-44022bf1abfa admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:02.464273 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a8628-a04b-4b3b-bc9d-7074192646df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:02.464976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a8628-a04b-4b3b-bc9d-7074192646df admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:02.465290 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a8628-a04b-4b3b-bc9d-7074192646df admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:02.465472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6beaae4-90ba-43cb-a02e-9ce0ba7f729f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:02.465584 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b12a8628-a04b-4b3b-bc9d-7074192646df admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:02.466378 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a8628-a04b-4b3b-bc9d-7074192646df admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:02.474717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b12a8628-a04b-4b3b-bc9d-7074192646df admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:02.477908 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:02.520748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 849/1729] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:02.521876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a8628-a04b-4b3b-bc9d-7074192646df admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:02.558129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b12a8628-a04b-4b3b-bc9d-7074192646df admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:02.577588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655bbbd-4fcf-4623-bc79-731a2e27fcf4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:02.578889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655bbbd-4fcf-4623-bc79-731a2e27fcf4 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:02.579392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655bbbd-4fcf-4623-bc79-731a2e27fcf4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:02.580613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0655bbbd-4fcf-4623-bc79-731a2e27fcf4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:02.582473 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655bbbd-4fcf-4623-bc79-731a2e27fcf4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:02.587512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0655bbbd-4fcf-4623-bc79-731a2e27fcf4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:02.635507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 850/1730] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 112 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:02.635507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655bbbd-4fcf-4623-bc79-731a2e27fcf4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:02.651210 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a1aca-7d5e-450e-890c-14f2bc31396d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:02.652090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1aca-7d5e-450e-890c-14f2bc31396d service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:02.652648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1aca-7d5e-450e-890c-14f2bc31396d service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:02.653057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-485a1aca-7d5e-450e-890c-14f2bc31396d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:02.668671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0655bbbd-4fcf-4623-bc79-731a2e27fcf4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:02.673964 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a1aca-7d5e-450e-890c-14f2bc31396d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:02.675474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-485a1aca-7d5e-450e-890c-14f2bc31396d service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:02.689065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f12ef-c65c-4c9f-95ed-621e185ef93a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:02.689896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f12ef-c65c-4c9f-95ed-621e185ef93a admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:02.689896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f12ef-c65c-4c9f-95ed-621e185ef93a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:02.690515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c2f12ef-c65c-4c9f-95ed-621e185ef93a admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:02.691283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f12ef-c65c-4c9f-95ed-621e185ef93a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:02.694990 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c2f12ef-c65c-4c9f-95ed-621e185ef93a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:02.708444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 881/1731] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:02.709507 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a1aca-7d5e-450e-890c-14f2bc31396d service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:02.731433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:02.740343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-485a1aca-7d5e-450e-890c-14f2bc31396d service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:02.758096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 851/1732] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:02 2022] POST /identity/v3/users => generated 296 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:02.759996 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f12ef-c65c-4c9f-95ed-621e185ef93a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:02.760700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e7a37-4173-4bb6-b71b-20d41a636ae4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:02.764006 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e7a37-4173-4bb6-b71b-20d41a636ae4 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:02.766483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e7a37-4173-4bb6-b71b-20d41a636ae4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:02.768757 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1c2f12ef-c65c-4c9f-95ed-621e185ef93a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:02.770928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49e7a37-4173-4bb6-b71b-20d41a636ae4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:02.771865 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e7a37-4173-4bb6-b71b-20d41a636ae4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:02.773612 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49e7a37-4173-4bb6-b71b-20d41a636ae4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:02.825026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 882/1733] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:02.835244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e7a37-4173-4bb6-b71b-20d41a636ae4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:02.870108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49e7a37-4173-4bb6-b71b-20d41a636ae4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:02.923130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c2f12ef-c65c-4c9f-95ed-621e185ef93a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:02.925699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49075668-8238-44fa-aafa-d78020f21e20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:02.926411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075668-8238-44fa-aafa-d78020f21e20 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:02.926793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075668-8238-44fa-aafa-d78020f21e20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:02.927147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49075668-8238-44fa-aafa-d78020f21e20 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:02.928647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49075668-8238-44fa-aafa-d78020f21e20 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:02.931013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49075668-8238-44fa-aafa-d78020f21e20 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:02.931171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9fd3c-b8ec-4098-b4b5-7a83e355e80b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:02.931772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9fd3c-b8ec-4098-b4b5-7a83e355e80b service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:02.932073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9fd3c-b8ec-4098-b4b5-7a83e355e80b service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:02.932378 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe9fd3c-b8ec-4098-b4b5-7a83e355e80b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:02.934339 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cfe9fd3c-b8ec-4098-b4b5-7a83e355e80b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:02.954376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9fd3c-b8ec-4098-b4b5-7a83e355e80b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:02.956188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe9fd3c-b8ec-4098-b4b5-7a83e355e80b service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:02.976398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 852/1734] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 218 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:02.978120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9fd3c-b8ec-4098-b4b5-7a83e355e80b service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:02.984122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 883/1735] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 162 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:02.985238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49075668-8238-44fa-aafa-d78020f21e20 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:02.991459 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe9fd3c-b8ec-4098-b4b5-7a83e355e80b service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:02.996404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d48a06-b264-4fce-b6e5-b25f5e8c613b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:02.997767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d48a06-b264-4fce-b6e5-b25f5e8c613b admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:02.998435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d48a06-b264-4fce-b6e5-b25f5e8c613b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:02.999073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d48a06-b264-4fce-b6e5-b25f5e8c613b admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:02.999550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d48a06-b264-4fce-b6e5-b25f5e8c613b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:03.002038 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d48a06-b264-4fce-b6e5-b25f5e8c613b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:03.026258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 853/1736] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:02 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:03.027714 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d48a06-b264-4fce-b6e5-b25f5e8c613b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:03.033463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49075668-8238-44fa-aafa-d78020f21e20 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:03.043064 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d48a06-b264-4fce-b6e5-b25f5e8c613b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:03.051126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a6d2f-8e5d-447c-8f70-2e51be01bca1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:03.054364 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6d2f-8e5d-447c-8f70-2e51be01bca1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:03.054757 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6d2f-8e5d-447c-8f70-2e51be01bca1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:03.057487 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c55a6d2f-8e5d-447c-8f70-2e51be01bca1 admin admin] PATH_INFO: `/v3/projects/891959613a334dbab91893e04b7b1ad4/users/48414757f16040ef92828dc407b3d91f/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:03.058195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e12d7b6-17a5-4b95-82c8-4a9fc69eefec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:03.060205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12d7b6-17a5-4b95-82c8-4a9fc69eefec admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:03.060506 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12d7b6-17a5-4b95-82c8-4a9fc69eefec admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:03.060792 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e12d7b6-17a5-4b95-82c8-4a9fc69eefec admin admin] PATH_INFO: `/v3/projects/5bee7826218a474ea14ebf5be26266de/users/9140a4c19c134fe1aff03815d1b9f863/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:03.084278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12d7b6-17a5-4b95-82c8-4a9fc69eefec admin admin] RBAC: Authorizing `identity:create_grant(project_id=5bee7826218a474ea14ebf5be26266de, user_id=9140a4c19c134fe1aff03815d1b9f863, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:03.099033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a6d2f-8e5d-447c-8f70-2e51be01bca1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=891959613a334dbab91893e04b7b1ad4, user_id=48414757f16040ef92828dc407b3d91f, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:03.102670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e12d7b6-17a5-4b95-82c8-4a9fc69eefec admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:03.102851 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c55a6d2f-8e5d-447c-8f70-2e51be01bca1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:03.143775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 884/1737] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:02 2022] PUT /identity/v3/projects/891959613a334dbab91893e04b7b1ad4/users/48414757f16040ef92828dc407b3d91f/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:03.143775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a6d2f-8e5d-447c-8f70-2e51be01bca1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:03.161676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 854/1738] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:03 2022] PUT /identity/v3/projects/5bee7826218a474ea14ebf5be26266de/users/9140a4c19c134fe1aff03815d1b9f863/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:03.161676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f81d3-f72f-4cdc-8101-34fa9388cd87 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:03.161676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f81d3-f72f-4cdc-8101-34fa9388cd87 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:03.161676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d5f81d3-f72f-4cdc-8101-34fa9388cd87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:03.220115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4d5f81d3-f72f-4cdc-8101-34fa9388cd87 None None] MFA Rules not processed for user `48414757f16040ef92828dc407b3d91f`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:03.221670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4d5f81d3-f72f-4cdc-8101-34fa9388cd87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:03.339558 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c55a6d2f-8e5d-447c-8f70-2e51be01bca1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:03.355701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 855/1739] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:03 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:03.358830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdd7d8-3a86-451a-b1d7-f7ceadbf74f8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:03.359655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdd7d8-3a86-451a-b1d7-f7ceadbf74f8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:03.360095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cfdd7d8-3a86-451a-b1d7-f7ceadbf74f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:03.436068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6cfdd7d8-3a86-451a-b1d7-f7ceadbf74f8 None None] MFA Rules not processed for user `9140a4c19c134fe1aff03815d1b9f863`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:03.443614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6cfdd7d8-3a86-451a-b1d7-f7ceadbf74f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:03.493036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:03.550100 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79dfef-2b75-46ad-89a2-26cdb9191ac6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:03.550802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79dfef-2b75-46ad-89a2-26cdb9191ac6 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:03.551092 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79dfef-2b75-46ad-89a2-26cdb9191ac6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:03.551380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e79dfef-2b75-46ad-89a2-26cdb9191ac6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:03.552251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79dfef-2b75-46ad-89a2-26cdb9191ac6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:03.553904 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e79dfef-2b75-46ad-89a2-26cdb9191ac6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:03.592425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 856/1740] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:03 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:03.593077 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 885/1741] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:03 2022] GET /identity/v3/roles => generated 1420 bytes in 458 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:03.593882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdd7d8-3a86-451a-b1d7-f7ceadbf74f8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:03.594109 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79dfef-2b75-46ad-89a2-26cdb9191ac6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:03.609500 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cfdd7d8-3a86-451a-b1d7-f7ceadbf74f8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:03.615422 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9671b25-5878-4c25-a1df-391d55f59c85 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:03.616301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9671b25-5878-4c25-a1df-391d55f59c85 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:03.616659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9671b25-5878-4c25-a1df-391d55f59c85 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:03.617088 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9671b25-5878-4c25-a1df-391d55f59c85 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:03.617870 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e79dfef-2b75-46ad-89a2-26cdb9191ac6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:03.617986 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9671b25-5878-4c25-a1df-391d55f59c85 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:03.621061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9671b25-5878-4c25-a1df-391d55f59c85 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:03.634286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe8f99-b279-4ef2-8748-110358af13d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:03.637815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe8f99-b279-4ef2-8748-110358af13d0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:03.640306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe8f99-b279-4ef2-8748-110358af13d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:03.640616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65fe8f99-b279-4ef2-8748-110358af13d0 admin admin] PATH_INFO: `/v3/projects/51eb9f23c8e54bd2814f28ec7fa5aff9/users/3bdaa84672114a45a55ff7b9a5c3fe89/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:03.656663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:03.691565 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 857/1742] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:03 2022] POST /identity/v3/projects => generated 373 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:03.693100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9671b25-5878-4c25-a1df-391d55f59c85 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:03.702391 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe8f99-b279-4ef2-8748-110358af13d0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=51eb9f23c8e54bd2814f28ec7fa5aff9, user_id=3bdaa84672114a45a55ff7b9a5c3fe89, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:03.719233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65fe8f99-b279-4ef2-8748-110358af13d0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:03.759084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 886/1743] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:03 2022] PUT /identity/v3/projects/51eb9f23c8e54bd2814f28ec7fa5aff9/users/3bdaa84672114a45a55ff7b9a5c3fe89/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:03.766698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe8f99-b279-4ef2-8748-110358af13d0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:03.849324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9671b25-5878-4c25-a1df-391d55f59c85 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:04.004501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65fe8f99-b279-4ef2-8748-110358af13d0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:04.009372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155f52d-e622-4c90-b9de-b2c33b5701b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:04.011399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155f52d-e622-4c90-b9de-b2c33b5701b6 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:04.011801 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155f52d-e622-4c90-b9de-b2c33b5701b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:04.013583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d155f52d-e622-4c90-b9de-b2c33b5701b6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:04.015760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155f52d-e622-4c90-b9de-b2c33b5701b6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:04.022739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d155f52d-e622-4c90-b9de-b2c33b5701b6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:04.024401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe0c291c-e963-4c98-8e78-f6fdd33a2380 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:04.026699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c291c-e963-4c98-8e78-f6fdd33a2380 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:04.026699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c291c-e963-4c98-8e78-f6fdd33a2380 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:04.026699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe0c291c-e963-4c98-8e78-f6fdd33a2380 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:04.029546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c291c-e963-4c98-8e78-f6fdd33a2380 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:04.038914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe0c291c-e963-4c98-8e78-f6fdd33a2380 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:04.098492 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 887/1744] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:03 2022] POST /identity/v3/users => generated 293 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:04.098748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 858/1745] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:03 2022] POST /identity/v3/projects => generated 367 bytes in 402 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:04.098748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155f52d-e622-4c90-b9de-b2c33b5701b6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:04.099275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211638aa-069a-4504-87cc-e1ee2fd6f70a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:04.099275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211638aa-069a-4504-87cc-e1ee2fd6f70a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:04.099275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-211638aa-069a-4504-87cc-e1ee2fd6f70a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:04.186915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-211638aa-069a-4504-87cc-e1ee2fd6f70a None None] MFA Rules not processed for user `3bdaa84672114a45a55ff7b9a5c3fe89`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:04.188706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-211638aa-069a-4504-87cc-e1ee2fd6f70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:04.263814 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:04.300294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d155f52d-e622-4c90-b9de-b2c33b5701b6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:04.315766 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296add75-e2c1-4d39-a378-2254d21e0c7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:04.318233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296add75-e2c1-4d39-a378-2254d21e0c7a admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:04.319158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296add75-e2c1-4d39-a378-2254d21e0c7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:04.320913 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-296add75-e2c1-4d39-a378-2254d21e0c7a admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:04.325830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296add75-e2c1-4d39-a378-2254d21e0c7a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:04.329570 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-296add75-e2c1-4d39-a378-2254d21e0c7a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:04.357525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 859/1746] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:04.357525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296add75-e2c1-4d39-a378-2254d21e0c7a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:04.396349 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-296add75-e2c1-4d39-a378-2254d21e0c7a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:04.405300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d209fb-7873-43d2-8cb1-26d61bfbead3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:04.406070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d209fb-7873-43d2-8cb1-26d61bfbead3 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:04.406533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d209fb-7873-43d2-8cb1-26d61bfbead3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:04.406853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d209fb-7873-43d2-8cb1-26d61bfbead3 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:04.407659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d209fb-7873-43d2-8cb1-26d61bfbead3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:04.410693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 888/1747] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:04 2022] POST /identity/v3/auth/tokens => generated 3258 bytes in 316 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:04.412795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211638aa-069a-4504-87cc-e1ee2fd6f70a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:04.414693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-211638aa-069a-4504-87cc-e1ee2fd6f70a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:04.431089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d209fb-7873-43d2-8cb1-26d61bfbead3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:04.449428 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-211638aa-069a-4504-87cc-e1ee2fd6f70a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:04.464091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 860/1748] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:04 2022] POST /identity/v3/users => generated 290 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:04.466859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d209fb-7873-43d2-8cb1-26d61bfbead3 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:04.481863 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d209fb-7873-43d2-8cb1-26d61bfbead3 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:04.486460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:04.487365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:04.488776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:04.490763 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] PATH_INFO: `/v3/projects/707693ce2bbd4f2cb2703a2e5f612d1f` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:04.494614 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] RBAC: Authorizing `identity:delete_project(project_id=707693ce2bbd4f2cb2703a2e5f612d1f)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:04.502408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421bce1-3039-4ff6-bc00-0875f03ffe30 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:04.504364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421bce1-3039-4ff6-bc00-0875f03ffe30 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:04.504892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421bce1-3039-4ff6-bc00-0875f03ffe30 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:04.505412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d421bce1-3039-4ff6-bc00-0875f03ffe30 admin admin] PATH_INFO: `/v3/projects/95206fc3574c4f5da372fcfc3bebc22f/users/8f6169b45f7b49b1a74f88984db379ab/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:04.509107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:04.530712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421bce1-3039-4ff6-bc00-0875f03ffe30 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95206fc3574c4f5da372fcfc3bebc22f, user_id=8f6169b45f7b49b1a74f88984db379ab, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:04.535124 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d421bce1-3039-4ff6-bc00-0875f03ffe30 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:04.558034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 861/1749] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:04 2022] PUT /identity/v3/projects/95206fc3574c4f5da372fcfc3bebc22f/users/8f6169b45f7b49b1a74f88984db379ab/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:04.560200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421bce1-3039-4ff6-bc00-0875f03ffe30 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:04.656474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '707693ce2bbd4f2cb2703a2e5f612d1f', 'request_id': 'req-1a25523d-5e67-4896-bc09-42046cd4b8bf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:04.678817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '707693ce2bbd4f2cb2703a2e5f612d1f', 'request_id': 'req-1a25523d-5e67-4896-bc09-42046cd4b8bf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:04.680870 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:INSERT=5,keystone:DELETE=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:04.700169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '707693ce2bbd4f2cb2703a2e5f612d1f', 'request_id': 'req-1a25523d-5e67-4896-bc09-42046cd4b8bf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:04.727322 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] The token cache is being invalidate because project 707693ce2bbd4f2cb2703a2e5f612d1f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:04.727987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:04.730344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:04.732251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 889/1750] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:04 2022] DELETE /identity/v3/projects/707693ce2bbd4f2cb2703a2e5f612d1f => generated 0 bytes in 321 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:04.733068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:04.739004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:04.812030 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d421bce1-3039-4ff6-bc00-0875f03ffe30 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:04.826564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a25523d-5e67-4896-bc09-42046cd4b8bf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:04.831419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd512129-3327-42e0-a2d7-ef4614db6e08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:04.832100 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd512129-3327-42e0-a2d7-ef4614db6e08 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:04.832393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd512129-3327-42e0-a2d7-ef4614db6e08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:04.832659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd512129-3327-42e0-a2d7-ef4614db6e08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:04.833472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd512129-3327-42e0-a2d7-ef4614db6e08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:04.835599 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd512129-3327-42e0-a2d7-ef4614db6e08 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:04.837595 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924148f-deb6-4901-bf2d-5f0d77fc634d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:04.841581 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924148f-deb6-4901-bf2d-5f0d77fc634d admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:04.843661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924148f-deb6-4901-bf2d-5f0d77fc634d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:04.845465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6924148f-deb6-4901-bf2d-5f0d77fc634d admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:04.849631 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924148f-deb6-4901-bf2d-5f0d77fc634d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:04.849782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 890/1751] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:04.849782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd512129-3327-42e0-a2d7-ef4614db6e08 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:04.851252 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6924148f-deb6-4901-bf2d-5f0d77fc634d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:04.853211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dd512129-3327-42e0-a2d7-ef4614db6e08 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:04.898406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd512129-3327-42e0-a2d7-ef4614db6e08 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:04.912588 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9f7c2-70e9-4d7f-b6cb-08f3de2d7f78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:04.917777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9f7c2-70e9-4d7f-b6cb-08f3de2d7f78 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:04.918237 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9f7c2-70e9-4d7f-b6cb-08f3de2d7f78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:04.919300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eca9f7c2-70e9-4d7f-b6cb-08f3de2d7f78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:04.921118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9f7c2-70e9-4d7f-b6cb-08f3de2d7f78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:04.928050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 862/1752] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:04 2022] POST /identity/v3/projects => generated 393 bytes in 368 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:04.929047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924148f-deb6-4901-bf2d-5f0d77fc634d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:04.931304 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eca9f7c2-70e9-4d7f-b6cb-08f3de2d7f78 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:04.933149 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6924148f-deb6-4901-bf2d-5f0d77fc634d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:04.955389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 891/1753] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:04 2022] GET /identity/v3/roles => generated 1420 bytes in 105 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:04.955389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9f7c2-70e9-4d7f-b6cb-08f3de2d7f78 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:04.974607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eca9f7c2-70e9-4d7f-b6cb-08f3de2d7f78 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:05.077372 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28952289-c89d-4405-b148-166968987a2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:05.078367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952289-c89d-4405-b148-166968987a2e admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:05.078703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952289-c89d-4405-b148-166968987a2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:05.078983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28952289-c89d-4405-b148-166968987a2e admin admin] PATH_INFO: `/v3/projects/d0e43b90fab04695b6e27b1b55907f66/users/3a2acf7bd8fc4554aeaf1fba64656e63/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:05.097532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6924148f-deb6-4901-bf2d-5f0d77fc634d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:05.100038 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28952289-c89d-4405-b148-166968987a2e admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e43b90fab04695b6e27b1b55907f66, user_id=3a2acf7bd8fc4554aeaf1fba64656e63, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:05.104133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28952289-c89d-4405-b148-166968987a2e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:05.120027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c63e1-07a9-41e2-bf86-e0d9c8642bb5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:05.121009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c63e1-07a9-41e2-bf86-e0d9c8642bb5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:05.121312 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c63e1-07a9-41e2-bf86-e0d9c8642bb5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:05.121666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-609c63e1-07a9-41e2-bf86-e0d9c8642bb5 admin admin] PATH_INFO: `/v3/users/ea5aff8de336472c8aee89b01eecb070` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:05.131289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 892/1754] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:04 2022] PUT /identity/v3/projects/d0e43b90fab04695b6e27b1b55907f66/users/3a2acf7bd8fc4554aeaf1fba64656e63/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:05.131674 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28952289-c89d-4405-b148-166968987a2e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:05.132328 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c63e1-07a9-41e2-bf86-e0d9c8642bb5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ea5aff8de336472c8aee89b01eecb070)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:05.134049 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-28952289-c89d-4405-b148-166968987a2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:05.134341 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-609c63e1-07a9-41e2-bf86-e0d9c8642bb5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:05.187964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:05.228484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=2,keystone:SELECT=97,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:05.256375 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-609c63e1-07a9-41e2-bf86-e0d9c8642bb5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ea5aff8de336472c8aee89b01eecb070'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:05.269932 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28952289-c89d-4405-b148-166968987a2e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:05.274539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-609c63e1-07a9-41e2-bf86-e0d9c8642bb5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ea5aff8de336472c8aee89b01eecb070'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:05.275961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-609c63e1-07a9-41e2-bf86-e0d9c8642bb5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ea5aff8de336472c8aee89b01eecb070'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:05.280467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b9c98-8c9b-4136-ac2c-29d707738d37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:05.286876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b9c98-8c9b-4136-ac2c-29d707738d37 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:05.288703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b9c98-8c9b-4136-ac2c-29d707738d37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:05.289327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57b9c98-8c9b-4136-ac2c-29d707738d37 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:05.291764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b9c98-8c9b-4136-ac2c-29d707738d37 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:05.299791 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57b9c98-8c9b-4136-ac2c-29d707738d37 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:05.323867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-609c63e1-07a9-41e2-bf86-e0d9c8642bb5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ea5aff8de336472c8aee89b01eecb070'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:05.360975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-609c63e1-07a9-41e2-bf86-e0d9c8642bb5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ea5aff8de336472c8aee89b01eecb070'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:05.366670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 893/1755] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:05 2022] POST /identity/v3/users => generated 303 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:05.369653 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b9c98-8c9b-4136-ac2c-29d707738d37 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:05.373698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c57b9c98-8c9b-4136-ac2c-29d707738d37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:05.375699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 863/1756] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:04 2022] DELETE /identity/v3/users/ea5aff8de336472c8aee89b01eecb070 => generated 0 bytes in 447 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:05.376838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c63e1-07a9-41e2-bf86-e0d9c8642bb5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:05.382455 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-609c63e1-07a9-41e2-bf86-e0d9c8642bb5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:05.419224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57b9c98-8c9b-4136-ac2c-29d707738d37 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:05.533067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-609c63e1-07a9-41e2-bf86-e0d9c8642bb5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:05.544932 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d8ce9-110e-48bd-9916-a2e84f7c3e8d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:05.549433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d8ce9-110e-48bd-9916-a2e84f7c3e8d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:05.550371 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d8ce9-110e-48bd-9916-a2e84f7c3e8d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:05.552174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c4d8ce9-110e-48bd-9916-a2e84f7c3e8d admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:05.553655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d8ce9-110e-48bd-9916-a2e84f7c3e8d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:05.560185 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c4d8ce9-110e-48bd-9916-a2e84f7c3e8d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:05.578319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01561f4-9cb7-4605-890e-b563658632f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:05.580351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01561f4-9cb7-4605-890e-b563658632f7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:05.581751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01561f4-9cb7-4605-890e-b563658632f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:05.583456 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c01561f4-9cb7-4605-890e-b563658632f7 admin admin] PATH_INFO: `/v3/projects/95206fc3574c4f5da372fcfc3bebc22f/users/8f6169b45f7b49b1a74f88984db379ab/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:05.590616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01561f4-9cb7-4605-890e-b563658632f7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=95206fc3574c4f5da372fcfc3bebc22f, user_id=8f6169b45f7b49b1a74f88984db379ab, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:05.590858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 864/1757] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:05.592496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d8ce9-110e-48bd-9916-a2e84f7c3e8d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:05.596571 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3c4d8ce9-110e-48bd-9916-a2e84f7c3e8d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:05.599713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c01561f4-9cb7-4605-890e-b563658632f7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:05.648168 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 894/1758] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:05 2022] PUT /identity/v3/projects/95206fc3574c4f5da372fcfc3bebc22f/users/8f6169b45f7b49b1a74f88984db379ab/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:05.649959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c4d8ce9-110e-48bd-9916-a2e84f7c3e8d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:05.650900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01561f4-9cb7-4605-890e-b563658632f7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:05.802742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c01561f4-9cb7-4605-890e-b563658632f7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:05.804200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b874fd-a478-4815-9986-a3a81210b2bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:05.805232 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b874fd-a478-4815-9986-a3a81210b2bc admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:05.805411 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b874fd-a478-4815-9986-a3a81210b2bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:05.806849 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b874fd-a478-4815-9986-a3a81210b2bc admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:05.808403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b874fd-a478-4815-9986-a3a81210b2bc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:05.810463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06408873-8625-4093-b84e-97c8b08e6c2b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:05.811945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06408873-8625-4093-b84e-97c8b08e6c2b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:05.812595 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b874fd-a478-4815-9986-a3a81210b2bc admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:05.812706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06408873-8625-4093-b84e-97c8b08e6c2b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:05.813646 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06408873-8625-4093-b84e-97c8b08e6c2b admin admin] PATH_INFO: `/v3/projects/d0e43b90fab04695b6e27b1b55907f66/users/3a2acf7bd8fc4554aeaf1fba64656e63/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:05.819318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06408873-8625-4093-b84e-97c8b08e6c2b admin admin] RBAC: Authorizing `identity:create_grant(project_id=d0e43b90fab04695b6e27b1b55907f66, user_id=3a2acf7bd8fc4554aeaf1fba64656e63, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:05.823186 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06408873-8625-4093-b84e-97c8b08e6c2b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:05.840599 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 865/1759] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:05 2022] GET /identity/v3/roles => generated 1420 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:05.842618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56c7fe-f627-4964-887b-d005b015c6c7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:05.842724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56c7fe-f627-4964-887b-d005b015c6c7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:05.844970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d56c7fe-f627-4964-887b-d005b015c6c7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:05.846507 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 895/1760] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:05 2022] PUT /identity/v3/projects/d0e43b90fab04695b6e27b1b55907f66/users/3a2acf7bd8fc4554aeaf1fba64656e63/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 198 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:05.858458 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06408873-8625-4093-b84e-97c8b08e6c2b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:05.913041 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-5d56c7fe-f627-4964-887b-d005b015c6c7 None None] MFA Rules not processed for user `8f6169b45f7b49b1a74f88984db379ab`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:05.914091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5d56c7fe-f627-4964-887b-d005b015c6c7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:05.954085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=8,keystone:SELECT=91,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:06.039601 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06408873-8625-4093-b84e-97c8b08e6c2b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:06.056806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f1b32-a5c3-4a24-9b35-bab1d917382c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:06.057797 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f1b32-a5c3-4a24-9b35-bab1d917382c admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:06.058082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f1b32-a5c3-4a24-9b35-bab1d917382c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:06.058363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-581f1b32-a5c3-4a24-9b35-bab1d917382c admin admin] PATH_INFO: `/v3/projects/30c3f0dc52e44ef5b5aeb53b1244c3e8/users/6f39e47119cb4be2b50000572a30c5f3/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:06.092978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f1b32-a5c3-4a24-9b35-bab1d917382c admin admin] RBAC: Authorizing `identity:create_grant(project_id=30c3f0dc52e44ef5b5aeb53b1244c3e8, user_id=6f39e47119cb4be2b50000572a30c5f3, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:06.096378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-581f1b32-a5c3-4a24-9b35-bab1d917382c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:06.103269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 866/1761] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:05 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 258 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:06.103269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0639681-f567-44bc-b52b-72403df6e43a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:06.103269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0639681-f567-44bc-b52b-72403df6e43a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:06.103269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0639681-f567-44bc-b52b-72403df6e43a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:06.117925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:06.140639 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 896/1762] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:05 2022] PUT /identity/v3/projects/30c3f0dc52e44ef5b5aeb53b1244c3e8/users/6f39e47119cb4be2b50000572a30c5f3/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 282 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:06.146508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f1b32-a5c3-4a24-9b35-bab1d917382c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:06.153637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-581f1b32-a5c3-4a24-9b35-bab1d917382c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:06.171349 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e0639681-f567-44bc-b52b-72403df6e43a None None] MFA Rules not processed for user `3a2acf7bd8fc4554aeaf1fba64656e63`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:06.172809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e0639681-f567-44bc-b52b-72403df6e43a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:06.312046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-581f1b32-a5c3-4a24-9b35-bab1d917382c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:06.320211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484b00b-3eb7-4688-8614-425cd0eeed98 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:06.322584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484b00b-3eb7-4688-8614-425cd0eeed98 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:06.322942 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484b00b-3eb7-4688-8614-425cd0eeed98 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:06.323494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3484b00b-3eb7-4688-8614-425cd0eeed98 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:06.355510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 867/1763] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:06 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 255 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:06.356669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0639681-f567-44bc-b52b-72403df6e43a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:06.448732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484b00b-3eb7-4688-8614-425cd0eeed98 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:06.450494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3484b00b-3eb7-4688-8614-425cd0eeed98 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:06.474357 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 897/1764] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:06 2022] GET /identity/v3/auth/tokens => generated 3307 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:06.475314 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484b00b-3eb7-4688-8614-425cd0eeed98 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:06.476800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3484b00b-3eb7-4688-8614-425cd0eeed98 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:06.516623 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0639681-f567-44bc-b52b-72403df6e43a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:06.538594 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63113ce-ff4d-48f0-a046-f37873269dc6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:06.540614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63113ce-ff4d-48f0-a046-f37873269dc6 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:06.542336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63113ce-ff4d-48f0-a046-f37873269dc6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:06.542869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63113ce-ff4d-48f0-a046-f37873269dc6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:06.544051 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63113ce-ff4d-48f0-a046-f37873269dc6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:06.550290 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63113ce-ff4d-48f0-a046-f37873269dc6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:06.618284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 868/1765] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:06 2022] GET /identity/v3/roles => generated 1420 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:06.618284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63113ce-ff4d-48f0-a046-f37873269dc6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:06.618284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d63113ce-ff4d-48f0-a046-f37873269dc6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:06.673429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63113ce-ff4d-48f0-a046-f37873269dc6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:06.694847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4fb70-0fa9-4a1b-8252-36dee5b4faca service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:06.695873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4fb70-0fa9-4a1b-8252-36dee5b4faca service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:06.696771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3484b00b-3eb7-4688-8614-425cd0eeed98 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:06.697359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4fb70-0fa9-4a1b-8252-36dee5b4faca service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:06.709984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:06.710747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6f4fb70-0fa9-4a1b-8252-36dee5b4faca service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:06.710925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:06.711158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:06.711432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a admin admin] PATH_INFO: `/v3/projects/9aa35bfced3549219c432f8e2cc62cd6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:06.712651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a admin admin] RBAC: Authorizing `identity:delete_project(project_id=9aa35bfced3549219c432f8e2cc62cd6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:06.715260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:06.742761 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4fb70-0fa9-4a1b-8252-36dee5b4faca service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:06.745392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6f4fb70-0fa9-4a1b-8252-36dee5b4faca service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:06.781300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 869/1766] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:06 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:06.783130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4fb70-0fa9-4a1b-8252-36dee5b4faca service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:06.816867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6f4fb70-0fa9-4a1b-8252-36dee5b4faca service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:06.817645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=1,keystone:SELECT=96,keystone:DELETE=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:06.834015 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '9aa35bfced3549219c432f8e2cc62cd6', 'request_id': 'req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:06.861437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '9aa35bfced3549219c432f8e2cc62cd6', 'request_id': 'req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:06.869201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '9aa35bfced3549219c432f8e2cc62cd6', 'request_id': 'req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:06.881405 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:06.890184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a admin admin] The token cache is being invalidate because project 9aa35bfced3549219c432f8e2cc62cd6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:06.890624 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:06.891958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7e07c182-6876-4bf5-82d6-fab0bcb8ed1a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:06.894134 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 898/1767] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:06 2022] DELETE /identity/v3/projects/9aa35bfced3549219c432f8e2cc62cd6 => generated 0 bytes in 419 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:06.895603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bb54c-422a-41a0-ac95-569394b1e82a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:06.895989 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bb54c-422a-41a0-ac95-569394b1e82a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:06.896400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f8bb54c-422a-41a0-ac95-569394b1e82a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:06.932427 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3f8bb54c-422a-41a0-ac95-569394b1e82a None None] MFA Rules not processed for user `4f1948e8724647bd893015835a50d8db`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:06.934264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3f8bb54c-422a-41a0-ac95-569394b1e82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:06.947081 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45715c-9f0c-4413-9235-060638b90e9e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:06.948317 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45715c-9f0c-4413-9235-060638b90e9e admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:06.948936 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45715c-9f0c-4413-9235-060638b90e9e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:06.949370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c45715c-9f0c-4413-9235-060638b90e9e admin admin] PATH_INFO: `/v3/projects/30c3f0dc52e44ef5b5aeb53b1244c3e8/users/6f39e47119cb4be2b50000572a30c5f3/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:06.952078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45715c-9f0c-4413-9235-060638b90e9e admin admin] RBAC: Authorizing `identity:create_grant(project_id=30c3f0dc52e44ef5b5aeb53b1244c3e8, user_id=6f39e47119cb4be2b50000572a30c5f3, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:06.956302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c45715c-9f0c-4413-9235-060638b90e9e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:06.973711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 870/1768] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:06 2022] PUT /identity/v3/projects/30c3f0dc52e44ef5b5aeb53b1244c3e8/users/6f39e47119cb4be2b50000572a30c5f3/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 192 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:06.974849 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45715c-9f0c-4413-9235-060638b90e9e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:06.976468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7c45715c-9f0c-4413-9235-060638b90e9e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:07.030375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 899/1769] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:06 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 135 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:07.031071 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bb54c-422a-41a0-ac95-569394b1e82a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:07.033127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3f8bb54c-422a-41a0-ac95-569394b1e82a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:07.138924 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c45715c-9f0c-4413-9235-060638b90e9e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:07.148398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f8bb54c-422a-41a0-ac95-569394b1e82a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:07.150551 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-480e7682-0c84-4078-ab5b-84d31696702c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:07.151227 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7682-0c84-4078-ab5b-84d31696702c service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.151569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7682-0c84-4078-ab5b-84d31696702c service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.151790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-480e7682-0c84-4078-ab5b-84d31696702c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.153649 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-480e7682-0c84-4078-ab5b-84d31696702c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:07.153960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf6cf2e3-1d32-49a2-b626-282e47ee69c2 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:07.154748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cf2e3-1d32-49a2-b626-282e47ee69c2 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.155162 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cf2e3-1d32-49a2-b626-282e47ee69c2 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.155450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf6cf2e3-1d32-49a2-b626-282e47ee69c2 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.157547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bf6cf2e3-1d32-49a2-b626-282e47ee69c2 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:07.226393 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e7682-0c84-4078-ab5b-84d31696702c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:07.227935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-480e7682-0c84-4078-ab5b-84d31696702c service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:07.230142 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cf2e3-1d32-49a2-b626-282e47ee69c2 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:07.231711 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf6cf2e3-1d32-49a2-b626-282e47ee69c2 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:07.243749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 900/1770] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:07 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 213 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:07.245464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d856b06-0339-46e4-a0af-597ce7d54936 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.246058 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d856b06-0339-46e4-a0af-597ce7d54936 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.246530 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d856b06-0339-46e4-a0af-597ce7d54936 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.253204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 871/1771] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 279 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:07.255677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc11aa-e65b-4d14-ba31-6bb141b2953a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.256069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc11aa-e65b-4d14-ba31-6bb141b2953a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.256424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8bc11aa-e65b-4d14-ba31-6bb141b2953a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.269669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7d856b06-0339-46e4-a0af-597ce7d54936 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:07.271072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7d856b06-0339-46e4-a0af-597ce7d54936 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:07.310415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=4,keystone:SELECT=95,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:07.312136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c8bc11aa-e65b-4d14-ba31-6bb141b2953a None None] MFA Rules not processed for user `6f39e47119cb4be2b50000572a30c5f3`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:07.313600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c8bc11aa-e65b-4d14-ba31-6bb141b2953a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:07.380165 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 901/1772] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:07.381916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7daf6-6a96-43bf-aaa9-2c9ce6d114c8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.382308 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7daf6-6a96-43bf-aaa9-2c9ce6d114c8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.382658 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f7daf6-6a96-43bf-aaa9-2c9ce6d114c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.420161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-15f7daf6-6a96-43bf-aaa9-2c9ce6d114c8 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:07.422301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-15f7daf6-6a96-43bf-aaa9-2c9ce6d114c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:07.447682 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 902/1773] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 67 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:07.452159 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7daf6-6a96-43bf-aaa9-2c9ce6d114c8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:07.459732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:07.476968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 872/1774] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:07 2022] POST /identity/v3/auth/tokens => generated 3327 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:07.482633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f7daf6-6a96-43bf-aaa9-2c9ce6d114c8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:07.495381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1733d-7b7c-48ad-b8ae-08603edffe62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:07.497672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1733d-7b7c-48ad-b8ae-08603edffe62 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.498339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1733d-7b7c-48ad-b8ae-08603edffe62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.498830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bb1733d-7b7c-48ad-b8ae-08603edffe62 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.499933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1733d-7b7c-48ad-b8ae-08603edffe62 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:07.500894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1733d-7b7c-48ad-b8ae-08603edffe62 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:07.503359 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bb1733d-7b7c-48ad-b8ae-08603edffe62 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:07.511308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc11aa-e65b-4d14-ba31-6bb141b2953a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:07.523542 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8bc11aa-e65b-4d14-ba31-6bb141b2953a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:07.528139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95164296-86be-4c7c-9a70-6a5361ce1fc9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:07.528887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95164296-86be-4c7c-9a70-6a5361ce1fc9 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.529364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95164296-86be-4c7c-9a70-6a5361ce1fc9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.529922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95164296-86be-4c7c-9a70-6a5361ce1fc9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.533161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 903/1775] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:07 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 79 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:07.535923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1733d-7b7c-48ad-b8ae-08603edffe62 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:07.547964 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bb1733d-7b7c-48ad-b8ae-08603edffe62 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:07.551293 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95164296-86be-4c7c-9a70-6a5361ce1fc9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:07.553574 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95164296-86be-4c7c-9a70-6a5361ce1fc9 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:07.553895 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24241145-a3f6-4c6f-936b-51ad09dcc833 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:07.555016 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24241145-a3f6-4c6f-936b-51ad09dcc833 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.555400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24241145-a3f6-4c6f-936b-51ad09dcc833 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.556058 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24241145-a3f6-4c6f-936b-51ad09dcc833 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.557258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24241145-a3f6-4c6f-936b-51ad09dcc833 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:07.566050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24241145-a3f6-4c6f-936b-51ad09dcc833 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:07.577372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 873/1776] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:07 2022] GET /identity/v3/auth/tokens => generated 3327 bytes in 67 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:22:07.608876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 904/1777] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:07 2022] POST /identity/v3/projects => generated 381 bytes in 73 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:07.613359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95164296-86be-4c7c-9a70-6a5361ce1fc9 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:07.629655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95164296-86be-4c7c-9a70-6a5361ce1fc9 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:07.646266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24241145-a3f6-4c6f-936b-51ad09dcc833 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:07.713422 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24241145-a3f6-4c6f-936b-51ad09dcc833 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:07.718119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720261d-7c0d-4f27-b1ed-51f8c876f03c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:07.718939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720261d-7c0d-4f27-b1ed-51f8c876f03c service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.720115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720261d-7c0d-4f27-b1ed-51f8c876f03c service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.720855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3720261d-7c0d-4f27-b1ed-51f8c876f03c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.722632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3720261d-7c0d-4f27-b1ed-51f8c876f03c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:07.758236 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4e5e8-785e-4109-9c82-2e0234ebfe51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:07.759140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4e5e8-785e-4109-9c82-2e0234ebfe51 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.759431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4e5e8-785e-4109-9c82-2e0234ebfe51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.759714 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7e4e5e8-785e-4109-9c82-2e0234ebfe51 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.760418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4e5e8-785e-4109-9c82-2e0234ebfe51 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:07.768431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7e4e5e8-785e-4109-9c82-2e0234ebfe51 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:07.795609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720261d-7c0d-4f27-b1ed-51f8c876f03c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:07.797396 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3720261d-7c0d-4f27-b1ed-51f8c876f03c service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:07.802084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 874/1778] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:07 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:07.806040 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4e5e8-785e-4109-9c82-2e0234ebfe51 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:07.808818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 905/1779] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:07 2022] GET /identity/v3/auth/tokens => generated 3258 bytes in 163 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:22:07.822026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7e4e5e8-785e-4109-9c82-2e0234ebfe51 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:07.827408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa56914a-3b68-4f9c-9528-8d33209de724 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:07.828087 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56914a-3b68-4f9c-9528-8d33209de724 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.828371 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56914a-3b68-4f9c-9528-8d33209de724 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.829323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa56914a-3b68-4f9c-9528-8d33209de724 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.830059 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56914a-3b68-4f9c-9528-8d33209de724 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:07.831825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa56914a-3b68-4f9c-9528-8d33209de724 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:07.843549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 875/1780] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:07.848137 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720261d-7c0d-4f27-b1ed-51f8c876f03c service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:07.861757 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3720261d-7c0d-4f27-b1ed-51f8c876f03c service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:07.866511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413dcb4-34c0-427e-9d05-61f7ddfa4208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:07.867196 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413dcb4-34c0-427e-9d05-61f7ddfa4208 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.867483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413dcb4-34c0-427e-9d05-61f7ddfa4208 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.877672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a413dcb4-34c0-427e-9d05-61f7ddfa4208 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.877672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413dcb4-34c0-427e-9d05-61f7ddfa4208 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:07.877672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a413dcb4-34c0-427e-9d05-61f7ddfa4208 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:07.878691 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210a9b-5f95-4926-a2b9-60689fe7bbaa None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.878983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210a9b-5f95-4926-a2b9-60689fe7bbaa None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.879262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3210a9b-5f95-4926-a2b9-60689fe7bbaa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.892307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 906/1781] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:07 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:07.896675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413dcb4-34c0-427e-9d05-61f7ddfa4208 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:07.908852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c3210a9b-5f95-4926-a2b9-60689fe7bbaa None None] MFA Rules not processed for user `b2d13c401ad84870a8d76d49a8054056`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:07.910117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c3210a9b-5f95-4926-a2b9-60689fe7bbaa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:07.912803 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a413dcb4-34c0-427e-9d05-61f7ddfa4208 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:07.918966 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5bfa48cd-b0e6-47cc-85e5-a537980b9607 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:07.920543 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa48cd-b0e6-47cc-85e5-a537980b9607 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.920976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa48cd-b0e6-47cc-85e5-a537980b9607 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.921277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5bfa48cd-b0e6-47cc-85e5-a537980b9607 admin admin] PATH_INFO: `/v3/projects/64ab075b149642dea486df2c863f5bea/users/bc0389c5d9b54a2daead0bc774166676/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.944523 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa48cd-b0e6-47cc-85e5-a537980b9607 admin admin] RBAC: Authorizing `identity:create_grant(project_id=64ab075b149642dea486df2c863f5bea, user_id=bc0389c5d9b54a2daead0bc774166676, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:07.948324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5bfa48cd-b0e6-47cc-85e5-a537980b9607 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:07.967539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 907/1782] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:07 2022] PUT /identity/v3/projects/64ab075b149642dea486df2c863f5bea/users/bc0389c5d9b54a2daead0bc774166676/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:07.978884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd2196-ebb7-494f-bc2b-3a7058327d80 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:07.979452 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd2196-ebb7-494f-bc2b-3a7058327d80 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:07.980401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3dd2196-ebb7-494f-bc2b-3a7058327d80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:07.996338 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 876/1783] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:07 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:08.013153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:08.033824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c3dd2196-ebb7-494f-bc2b-3a7058327d80 None None] MFA Rules not processed for user `bc0389c5d9b54a2daead0bc774166676`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:08.035779 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c3dd2196-ebb7-494f-bc2b-3a7058327d80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:08.116555 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 908/1784] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:07 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:08.121165 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3210a9b-5f95-4926-a2b9-60689fe7bbaa None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:08.134273 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3210a9b-5f95-4926-a2b9-60689fe7bbaa None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:08.249758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39467d8a-3505-451e-8580-fde5f9df13df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:08.251048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39467d8a-3505-451e-8580-fde5f9df13df admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:08.251291 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39467d8a-3505-451e-8580-fde5f9df13df admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:08.251571 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39467d8a-3505-451e-8580-fde5f9df13df admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:08.252272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39467d8a-3505-451e-8580-fde5f9df13df admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:08.254214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39467d8a-3505-451e-8580-fde5f9df13df admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:08.283588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:08.310846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 877/1785] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:08 2022] POST /identity/v3/projects => generated 379 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:08.312427 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd2196-ebb7-494f-bc2b-3a7058327d80 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:08.325841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3dd2196-ebb7-494f-bc2b-3a7058327d80 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:08.424056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ba661-f2a7-4500-b26d-7f91905cd849 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:08.425110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ba661-f2a7-4500-b26d-7f91905cd849 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:08.425458 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ba661-f2a7-4500-b26d-7f91905cd849 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:08.425811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7ba661-f2a7-4500-b26d-7f91905cd849 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:08.426587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ba661-f2a7-4500-b26d-7f91905cd849 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:08.430381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b7ba661-f2a7-4500-b26d-7f91905cd849 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:08.470483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 909/1786] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:08 2022] POST /identity/v3/users => generated 296 bytes in 158 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:08.474551 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39467d8a-3505-451e-8580-fde5f9df13df admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:08.487300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39467d8a-3505-451e-8580-fde5f9df13df admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:08.493424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5a1a4-578c-471a-86cb-7f44f66e9f22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:08.494151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a1a4-578c-471a-86cb-7f44f66e9f22 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:08.494859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a1a4-578c-471a-86cb-7f44f66e9f22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:08.494859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21b5a1a4-578c-471a-86cb-7f44f66e9f22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:08.495652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5a1a4-578c-471a-86cb-7f44f66e9f22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:08.497433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21b5a1a4-578c-471a-86cb-7f44f66e9f22 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:08.516427 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 878/1787] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:08.520438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ba661-f2a7-4500-b26d-7f91905cd849 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:08.534043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7ba661-f2a7-4500-b26d-7f91905cd849 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:08.541225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49628204-fcad-4798-b96a-93dcc794af56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:08.542473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49628204-fcad-4798-b96a-93dcc794af56 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:08.542895 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49628204-fcad-4798-b96a-93dcc794af56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:08.543289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49628204-fcad-4798-b96a-93dcc794af56 admin admin] PATH_INFO: `/v3/projects/b3cc6b41fb8349458980359f97d21993/users/194eddc5fafb459f9e16f0bb0a934d55/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:08.588460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49628204-fcad-4798-b96a-93dcc794af56 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cc6b41fb8349458980359f97d21993, user_id=194eddc5fafb459f9e16f0bb0a934d55, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:08.592684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49628204-fcad-4798-b96a-93dcc794af56 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:08.614028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 910/1788] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:08 2022] PUT /identity/v3/projects/b3cc6b41fb8349458980359f97d21993/users/194eddc5fafb459f9e16f0bb0a934d55/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:08.617861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5a1a4-578c-471a-86cb-7f44f66e9f22 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:08.636710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21b5a1a4-578c-471a-86cb-7f44f66e9f22 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:08.701911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9581f94-55ee-4df9-a83b-50dca09ca809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:08.702677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9581f94-55ee-4df9-a83b-50dca09ca809 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:08.703144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9581f94-55ee-4df9-a83b-50dca09ca809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:08.703583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9581f94-55ee-4df9-a83b-50dca09ca809 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:08.704447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9581f94-55ee-4df9-a83b-50dca09ca809 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:08.706272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9581f94-55ee-4df9-a83b-50dca09ca809 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:08.717976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 879/1789] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:08 2022] GET /identity/v3/roles => generated 1420 bytes in 100 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:08.723439 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49628204-fcad-4798-b96a-93dcc794af56 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:08.737924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49628204-fcad-4798-b96a-93dcc794af56 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:08.744872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833a703-45b1-4c91-95b1-627f6d3a6c74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:08.746770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833a703-45b1-4c91-95b1-627f6d3a6c74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:08.747196 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833a703-45b1-4c91-95b1-627f6d3a6c74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:08.747472 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5833a703-45b1-4c91-95b1-627f6d3a6c74 admin admin] PATH_INFO: `/v3/projects/b3cc6b41fb8349458980359f97d21993/users/194eddc5fafb459f9e16f0bb0a934d55/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:08.750205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833a703-45b1-4c91-95b1-627f6d3a6c74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cc6b41fb8349458980359f97d21993, user_id=194eddc5fafb459f9e16f0bb0a934d55, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:08.754666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5833a703-45b1-4c91-95b1-627f6d3a6c74 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:08.783232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 911/1790] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:08 2022] PUT /identity/v3/projects/b3cc6b41fb8349458980359f97d21993/users/194eddc5fafb459f9e16f0bb0a934d55/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:08.784580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9632e-e202-44bc-bab8-f2cc3b6ceae7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:08.785343 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9632e-e202-44bc-bab8-f2cc3b6ceae7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:08.785617 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d9632e-e202-44bc-bab8-f2cc3b6ceae7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:08.824628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a9d9632e-e202-44bc-bab8-f2cc3b6ceae7 None None] MFA Rules not processed for user `194eddc5fafb459f9e16f0bb0a934d55`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:08.828065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a9d9632e-e202-44bc-bab8-f2cc3b6ceae7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:08.912271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 880/1791] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:08 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:08.957507 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833a703-45b1-4c91-95b1-627f6d3a6c74 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:09.082041 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5833a703-45b1-4c91-95b1-627f6d3a6c74 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:09.100721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bf68d-b737-4728-a806-a1b2b703d29a service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:09.101915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf68d-b737-4728-a806-a1b2b703d29a service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:09.102214 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf68d-b737-4728-a806-a1b2b703d29a service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:09.102499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22bf68d-b737-4728-a806-a1b2b703d29a service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:09.125778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:09.131350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bf68d-b737-4728-a806-a1b2b703d29a service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:09.133983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d22bf68d-b737-4728-a806-a1b2b703d29a service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:09.166111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 912/1792] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:08 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:09.456131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9632e-e202-44bc-bab8-f2cc3b6ceae7 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:09.493824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d9632e-e202-44bc-bab8-f2cc3b6ceae7 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:09.503735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6ebde17-2f93-4d9e-b693-102e292352d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:09.505869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebde17-2f93-4d9e-b693-102e292352d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:09.509601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebde17-2f93-4d9e-b693-102e292352d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:09.510079 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6ebde17-2f93-4d9e-b693-102e292352d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:09.685367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebde17-2f93-4d9e-b693-102e292352d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:09.687019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6ebde17-2f93-4d9e-b693-102e292352d1 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:09.693932 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:09.700345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 881/1793] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:09 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 245 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:11.571946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bf68d-b737-4728-a806-a1b2b703d29a service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:11.574921 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d22bf68d-b737-4728-a806-a1b2b703d29a service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:11.814761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d22bf68d-b737-4728-a806-a1b2b703d29a service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:11.827085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885928f9-dd78-4756-811d-9fa6e272689a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:11.827999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885928f9-dd78-4756-811d-9fa6e272689a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:11.828285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885928f9-dd78-4756-811d-9fa6e272689a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:11.828624 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-885928f9-dd78-4756-811d-9fa6e272689a admin admin] PATH_INFO: `/v3/users/9140a4c19c134fe1aff03815d1b9f863` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:11.841981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885928f9-dd78-4756-811d-9fa6e272689a admin admin] RBAC: Authorizing `identity:delete_user(user_id=9140a4c19c134fe1aff03815d1b9f863)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:11.844535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-885928f9-dd78-4756-811d-9fa6e272689a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:11.995630 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-885928f9-dd78-4756-811d-9fa6e272689a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9140a4c19c134fe1aff03815d1b9f863'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:11.997497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-885928f9-dd78-4756-811d-9fa6e272689a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9140a4c19c134fe1aff03815d1b9f863'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:12.021899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-885928f9-dd78-4756-811d-9fa6e272689a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9140a4c19c134fe1aff03815d1b9f863'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:12.024339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-885928f9-dd78-4756-811d-9fa6e272689a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9140a4c19c134fe1aff03815d1b9f863'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:12.071568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-885928f9-dd78-4756-811d-9fa6e272689a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9140a4c19c134fe1aff03815d1b9f863'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:12.109179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 913/1794] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:11 2022] DELETE /identity/v3/users/9140a4c19c134fe1aff03815d1b9f863 => generated 0 bytes in 538 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:12.113940 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c364dd-fb16-4e24-a353-5301f33df247 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:12.114845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c364dd-fb16-4e24-a353-5301f33df247 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:12.115502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08c364dd-fb16-4e24-a353-5301f33df247 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:12.147358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-08c364dd-fb16-4e24-a353-5301f33df247 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:12.158197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-08c364dd-fb16-4e24-a353-5301f33df247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:12.315878 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 882/1795] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:12.358601 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885928f9-dd78-4756-811d-9fa6e272689a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:12.362001 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-885928f9-dd78-4756-811d-9fa6e272689a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:12.517821 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-885928f9-dd78-4756-811d-9fa6e272689a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:12.522802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-038e0465-73d4-4096-b957-bec8f95e3649 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:12.524010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e0465-73d4-4096-b957-bec8f95e3649 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:12.524382 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e0465-73d4-4096-b957-bec8f95e3649 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:12.524764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-038e0465-73d4-4096-b957-bec8f95e3649 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:12.544560 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e0465-73d4-4096-b957-bec8f95e3649 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:12.546597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-038e0465-73d4-4096-b957-bec8f95e3649 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:12.562043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 914/1796] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:12 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 204 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:12.876329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c364dd-fb16-4e24-a353-5301f33df247 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:12.880589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-08c364dd-fb16-4e24-a353-5301f33df247 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:12.912866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08c364dd-fb16-4e24-a353-5301f33df247 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:12.921137 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52805de4-de87-4e98-aef3-5ce850e67e89 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:12.922963 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52805de4-de87-4e98-aef3-5ce850e67e89 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:12.923478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52805de4-de87-4e98-aef3-5ce850e67e89 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:12.924069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52805de4-de87-4e98-aef3-5ce850e67e89 admin admin] PATH_INFO: `/v3/users/3bdaa84672114a45a55ff7b9a5c3fe89` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:12.925673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52805de4-de87-4e98-aef3-5ce850e67e89 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3bdaa84672114a45a55ff7b9a5c3fe89)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:12.931287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52805de4-de87-4e98-aef3-5ce850e67e89 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:13.090615 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-52805de4-de87-4e98-aef3-5ce850e67e89 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3bdaa84672114a45a55ff7b9a5c3fe89'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:13.116717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-52805de4-de87-4e98-aef3-5ce850e67e89 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3bdaa84672114a45a55ff7b9a5c3fe89'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:13.120859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-52805de4-de87-4e98-aef3-5ce850e67e89 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3bdaa84672114a45a55ff7b9a5c3fe89'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:13.148766 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-52805de4-de87-4e98-aef3-5ce850e67e89 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3bdaa84672114a45a55ff7b9a5c3fe89'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:13.173264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-52805de4-de87-4e98-aef3-5ce850e67e89 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3bdaa84672114a45a55ff7b9a5c3fe89'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:13.182735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 883/1797] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:12 2022] DELETE /identity/v3/users/3bdaa84672114a45a55ff7b9a5c3fe89 => generated 0 bytes in 307 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:13.187189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65975262-6ed9-49f6-bd16-89542ad69b36 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:13.188153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65975262-6ed9-49f6-bd16-89542ad69b36 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:13.188293 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65975262-6ed9-49f6-bd16-89542ad69b36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:13.228761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-65975262-6ed9-49f6-bd16-89542ad69b36 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:13.231986 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-65975262-6ed9-49f6-bd16-89542ad69b36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:13.264824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:13.361462 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 915/1798] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:13.402927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52805de4-de87-4e98-aef3-5ce850e67e89 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:13.405393 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-52805de4-de87-4e98-aef3-5ce850e67e89 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:13.520525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52805de4-de87-4e98-aef3-5ce850e67e89 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:13.527541 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9205c8-6739-46c5-94c4-23de29746917 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:13.528628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9205c8-6739-46c5-94c4-23de29746917 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:13.529077 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9205c8-6739-46c5-94c4-23de29746917 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:13.529525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca9205c8-6739-46c5-94c4-23de29746917 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:13.572142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9205c8-6739-46c5-94c4-23de29746917 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:13.573996 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca9205c8-6739-46c5-94c4-23de29746917 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:13.575325 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2960c-e51a-467b-91ad-9e8ee6f124a8 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:13.576570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2960c-e51a-467b-91ad-9e8ee6f124a8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:13.576960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73f2960c-e51a-467b-91ad-9e8ee6f124a8 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:13.579263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 916/1799] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 26 18:22:13 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:22:13.592751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 884/1800] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 191 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:13.600133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08589daa-eef7-4f7a-9bef-839df42dbdb2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:13.604727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08589daa-eef7-4f7a-9bef-839df42dbdb2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:13.605115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08589daa-eef7-4f7a-9bef-839df42dbdb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:13.652289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-08589daa-eef7-4f7a-9bef-839df42dbdb2 None None] MFA Rules not processed for user `97f259ac2eb4425f8b4dcffeccdcd439`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:13.653772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-08589daa-eef7-4f7a-9bef-839df42dbdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:13.770628 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 917/1801] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 26 18:22:13 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:14.072079 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9205c8-6739-46c5-94c4-23de29746917 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:14.076156 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ca9205c8-6739-46c5-94c4-23de29746917 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:14.123528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca9205c8-6739-46c5-94c4-23de29746917 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:14.137499 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809569ca-70aa-4b28-a0d4-0d74568f915e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:14.138653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809569ca-70aa-4b28-a0d4-0d74568f915e service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:14.139200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809569ca-70aa-4b28-a0d4-0d74568f915e service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:14.139707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-809569ca-70aa-4b28-a0d4-0d74568f915e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:14.158181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809569ca-70aa-4b28-a0d4-0d74568f915e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:14.160216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-809569ca-70aa-4b28-a0d4-0d74568f915e service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:14.174968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 885/1802] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:14.212201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08589daa-eef7-4f7a-9bef-839df42dbdb2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:14.214211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-08589daa-eef7-4f7a-9bef-839df42dbdb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:14.232978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08589daa-eef7-4f7a-9bef-839df42dbdb2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:14.238782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:14.239948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:14.240436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:14.241160 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] PATH_INFO: `/v3/projects/5bee7826218a474ea14ebf5be26266de` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:14.242912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5bee7826218a474ea14ebf5be26266de)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:14.245110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:14.329930 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5bee7826218a474ea14ebf5be26266de', 'request_id': 'req-2c3420c3-e204-47ed-b767-1118216aec1e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.351959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5bee7826218a474ea14ebf5be26266de', 'request_id': 'req-2c3420c3-e204-47ed-b767-1118216aec1e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.361084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5bee7826218a474ea14ebf5be26266de', 'request_id': 'req-2c3420c3-e204-47ed-b767-1118216aec1e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.376817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] The token cache is being invalidate because project 5bee7826218a474ea14ebf5be26266de was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:14.377150 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.377848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.379423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 918/1803] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:14 2022] DELETE /identity/v3/projects/5bee7826218a474ea14ebf5be26266de => generated 0 bytes in 168 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:14.383539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809569ca-70aa-4b28-a0d4-0d74568f915e service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:14.388906 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:14.395400 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-809569ca-70aa-4b28-a0d4-0d74568f915e service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:14.460048 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:14.461534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:14.477719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8a787b9-536d-47b4-9e36-92fd7ecb84af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:14.479111 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a787b9-536d-47b4-9e36-92fd7ecb84af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:14.479888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a787b9-536d-47b4-9e36-92fd7ecb84af admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:14.480268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8a787b9-536d-47b4-9e36-92fd7ecb84af admin admin] PATH_INFO: `/v3/users/3a2acf7bd8fc4554aeaf1fba64656e63` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:14.481640 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a787b9-536d-47b4-9e36-92fd7ecb84af admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a2acf7bd8fc4554aeaf1fba64656e63)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:14.484311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8a787b9-536d-47b4-9e36-92fd7ecb84af admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:14.526908 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:14.546444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c8a787b9-536d-47b4-9e36-92fd7ecb84af admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a2acf7bd8fc4554aeaf1fba64656e63'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.570867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c8a787b9-536d-47b4-9e36-92fd7ecb84af admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a2acf7bd8fc4554aeaf1fba64656e63'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.572878 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c8a787b9-536d-47b4-9e36-92fd7ecb84af admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a2acf7bd8fc4554aeaf1fba64656e63'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.580098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c3420c3-e204-47ed-b767-1118216aec1e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:14.588567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:14.591204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:14.591204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:14.591204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] PATH_INFO: `/v3/projects/51eb9f23c8e54bd2814f28ec7fa5aff9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:14.591908 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] RBAC: Authorizing `identity:delete_project(project_id=51eb9f23c8e54bd2814f28ec7fa5aff9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:14.592234 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c8a787b9-536d-47b4-9e36-92fd7ecb84af admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a2acf7bd8fc4554aeaf1fba64656e63'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.595554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:14.607865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c8a787b9-536d-47b4-9e36-92fd7ecb84af admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a2acf7bd8fc4554aeaf1fba64656e63'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.618517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 886/1804] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:14 2022] DELETE /identity/v3/users/3a2acf7bd8fc4554aeaf1fba64656e63 => generated 0 bytes in 232 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:14.717650 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '51eb9f23c8e54bd2814f28ec7fa5aff9', 'request_id': 'req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.732138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03af0c-b9d1-4b26-b073-0ed16682dab3 None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:14.732354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03af0c-b9d1-4b26-b073-0ed16682dab3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:14.732704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa03af0c-b9d1-4b26-b073-0ed16682dab3 None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:14.735229 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 887/1805] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 26 18:22:14 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:22:14.742329 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '51eb9f23c8e54bd2814f28ec7fa5aff9', 'request_id': 'req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.745103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ff2d2-4026-4183-ab01-4bc37f3a6e1f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:14.745503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ff2d2-4026-4183-ab01-4bc37f3a6e1f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:14.745900 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42ff2d2-4026-4183-ab01-4bc37f3a6e1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:14.760286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '51eb9f23c8e54bd2814f28ec7fa5aff9', 'request_id': 'req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.792521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] The token cache is being invalidate because project 51eb9f23c8e54bd2814f28ec7fa5aff9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:14.792823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.800857 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:14.805074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 919/1806] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:14 2022] DELETE /identity/v3/projects/51eb9f23c8e54bd2814f28ec7fa5aff9 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:14.809492 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:14.812783 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:14.815024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c42ff2d2-4026-4183-ab01-4bc37f3a6e1f None None] MFA Rules not processed for user `97f259ac2eb4425f8b4dcffeccdcd439`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:14.816232 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c42ff2d2-4026-4183-ab01-4bc37f3a6e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:14.972745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 888/1807] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 26 18:22:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:14.986977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ff2d2-4026-4183-ab01-4bc37f3a6e1f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:14.990289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c42ff2d2-4026-4183-ab01-4bc37f3a6e1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:14.992357 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ed3dfd-9ae4-4c2f-a776-033130fb3baf admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:15.011075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d6b5359-aa0a-40ae-bcfa-c3206598869e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:15.012044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b5359-aa0a-40ae-bcfa-c3206598869e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:15.013020 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b5359-aa0a-40ae-bcfa-c3206598869e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:15.013020 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d6b5359-aa0a-40ae-bcfa-c3206598869e admin admin] PATH_INFO: `/v3/users/6f39e47119cb4be2b50000572a30c5f3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:15.014597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b5359-aa0a-40ae-bcfa-c3206598869e admin admin] RBAC: Authorizing `identity:delete_user(user_id=6f39e47119cb4be2b50000572a30c5f3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:15.017640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d6b5359-aa0a-40ae-bcfa-c3206598869e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:15.051190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42ff2d2-4026-4183-ab01-4bc37f3a6e1f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:15.061128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac429b7-2d01-4141-a0d4-e3f035141eeb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:15.061851 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac429b7-2d01-4141-a0d4-e3f035141eeb service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:15.062335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac429b7-2d01-4141-a0d4-e3f035141eeb service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:15.062637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ac429b7-2d01-4141-a0d4-e3f035141eeb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:15.106067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac429b7-2d01-4141-a0d4-e3f035141eeb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:15.108589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ac429b7-2d01-4141-a0d4-e3f035141eeb service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:15.130515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:15.142419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 889/1808] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:15.143503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac429b7-2d01-4141-a0d4-e3f035141eeb service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:15.145209 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4ac429b7-2d01-4141-a0d4-e3f035141eeb service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:15.149279 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7d6b5359-aa0a-40ae-bcfa-c3206598869e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6f39e47119cb4be2b50000572a30c5f3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:15.150158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7d6b5359-aa0a-40ae-bcfa-c3206598869e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6f39e47119cb4be2b50000572a30c5f3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:15.163039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7d6b5359-aa0a-40ae-bcfa-c3206598869e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6f39e47119cb4be2b50000572a30c5f3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:15.163888 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7d6b5359-aa0a-40ae-bcfa-c3206598869e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6f39e47119cb4be2b50000572a30c5f3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:15.174226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=84,keystone:DELETE=15,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:15.176942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ac429b7-2d01-4141-a0d4-e3f035141eeb service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:15.185089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-7d6b5359-aa0a-40ae-bcfa-c3206598869e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6f39e47119cb4be2b50000572a30c5f3'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:15.187753 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620be0f-5b3f-4c36-a003-10f996b2c261 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:15.189144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620be0f-5b3f-4c36-a003-10f996b2c261 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:15.189579 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620be0f-5b3f-4c36-a003-10f996b2c261 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:15.190160 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620be0f-5b3f-4c36-a003-10f996b2c261 admin admin] PATH_INFO: `/v3/projects/d0e43b90fab04695b6e27b1b55907f66` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:15.192752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620be0f-5b3f-4c36-a003-10f996b2c261 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d0e43b90fab04695b6e27b1b55907f66)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:15.195527 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620be0f-5b3f-4c36-a003-10f996b2c261 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:15.229050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 920/1809] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:14 2022] DELETE /identity/v3/users/6f39e47119cb4be2b50000572a30c5f3 => generated 0 bytes in 418 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:15.264390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e620be0f-5b3f-4c36-a003-10f996b2c261 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd0e43b90fab04695b6e27b1b55907f66', 'request_id': 'req-e620be0f-5b3f-4c36-a003-10f996b2c261'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:15.279764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e620be0f-5b3f-4c36-a003-10f996b2c261 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd0e43b90fab04695b6e27b1b55907f66', 'request_id': 'req-e620be0f-5b3f-4c36-a003-10f996b2c261'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:15.289955 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e620be0f-5b3f-4c36-a003-10f996b2c261 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd0e43b90fab04695b6e27b1b55907f66', 'request_id': 'req-e620be0f-5b3f-4c36-a003-10f996b2c261'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:15.305365 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e620be0f-5b3f-4c36-a003-10f996b2c261 admin admin] The token cache is being invalidate because project d0e43b90fab04695b6e27b1b55907f66 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:15.305819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e620be0f-5b3f-4c36-a003-10f996b2c261 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:15.306950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e620be0f-5b3f-4c36-a003-10f996b2c261 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:15.315558 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 890/1810] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:15 2022] DELETE /identity/v3/projects/d0e43b90fab04695b6e27b1b55907f66 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:15.317289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd484b-78f9-4ccd-8ea5-7d2f58be8f9c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:15.317793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd484b-78f9-4ccd-8ea5-7d2f58be8f9c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:15.318254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bcd484b-78f9-4ccd-8ea5-7d2f58be8f9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:15.352018 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2bcd484b-78f9-4ccd-8ea5-7d2f58be8f9c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:15.353824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2bcd484b-78f9-4ccd-8ea5-7d2f58be8f9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:15.458696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 921/1811] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:15.466523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f9e37-014a-4306-938a-4b6b4010f423 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:15.466811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f9e37-014a-4306-938a-4b6b4010f423 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:15.467085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9f9e37-014a-4306-938a-4b6b4010f423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:15.498197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ec9f9e37-014a-4306-938a-4b6b4010f423 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:15.499616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ec9f9e37-014a-4306-938a-4b6b4010f423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:15.529197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 891/1812] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:15 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 64 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:15.540040 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd484b-78f9-4ccd-8ea5-7d2f58be8f9c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:15.565682 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bcd484b-78f9-4ccd-8ea5-7d2f58be8f9c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:15.572264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334f0e4-e224-4f22-b456-3de527e07cc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:15.574104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334f0e4-e224-4f22-b456-3de527e07cc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:15.574567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334f0e4-e224-4f22-b456-3de527e07cc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:15.574921 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e334f0e4-e224-4f22-b456-3de527e07cc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:15.575843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334f0e4-e224-4f22-b456-3de527e07cc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:15.576258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334f0e4-e224-4f22-b456-3de527e07cc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:15.578111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e334f0e4-e224-4f22-b456-3de527e07cc2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:15.591800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 922/1813] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:15 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 52 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:15.596769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f9e37-014a-4306-938a-4b6b4010f423 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:15.609115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9f9e37-014a-4306-938a-4b6b4010f423 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:15.621018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294f6dc-69fc-4d9d-8df8-8e73b280f4d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:15.621795 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294f6dc-69fc-4d9d-8df8-8e73b280f4d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:15.622152 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294f6dc-69fc-4d9d-8df8-8e73b280f4d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:15.622503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6294f6dc-69fc-4d9d-8df8-8e73b280f4d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:15.624009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294f6dc-69fc-4d9d-8df8-8e73b280f4d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:15.627856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6294f6dc-69fc-4d9d-8df8-8e73b280f4d5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:15.679596 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 892/1814] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:15 2022] POST /identity/v3/projects => generated 377 bytes in 83 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:15.683913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334f0e4-e224-4f22-b456-3de527e07cc2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:15.696696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e334f0e4-e224-4f22-b456-3de527e07cc2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:15.771286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7aca73-c2ef-4c63-80fe-48bccee07c21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:15.772399 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aca73-c2ef-4c63-80fe-48bccee07c21 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:15.772814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aca73-c2ef-4c63-80fe-48bccee07c21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:15.773148 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7aca73-c2ef-4c63-80fe-48bccee07c21 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:15.774155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7aca73-c2ef-4c63-80fe-48bccee07c21 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:15.776139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7aca73-c2ef-4c63-80fe-48bccee07c21 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:15.807118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 923/1815] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:15 2022] POST /identity/v3/users => generated 289 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:15.811058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294f6dc-69fc-4d9d-8df8-8e73b280f4d5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:15.823069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6294f6dc-69fc-4d9d-8df8-8e73b280f4d5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:15.829336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203d805-94bb-4298-973e-f37bc48ca2ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:15.830587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203d805-94bb-4298-973e-f37bc48ca2ec admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:15.830917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203d805-94bb-4298-973e-f37bc48ca2ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:15.831351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6203d805-94bb-4298-973e-f37bc48ca2ec admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:15.832738 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203d805-94bb-4298-973e-f37bc48ca2ec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:15.834622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6203d805-94bb-4298-973e-f37bc48ca2ec admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:15.846590 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 893/1816] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:15.850845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7aca73-c2ef-4c63-80fe-48bccee07c21 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:15.861811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7aca73-c2ef-4c63-80fe-48bccee07c21 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:15.867271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88ff2eb6-6f40-40de-a278-66e1ced820fa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:15.867966 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff2eb6-6f40-40de-a278-66e1ced820fa admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:15.868259 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff2eb6-6f40-40de-a278-66e1ced820fa admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:15.868532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88ff2eb6-6f40-40de-a278-66e1ced820fa admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:15.869316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff2eb6-6f40-40de-a278-66e1ced820fa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:15.870949 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88ff2eb6-6f40-40de-a278-66e1ced820fa admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:15.887957 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203d805-94bb-4298-973e-f37bc48ca2ec admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:15.888441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 924/1817] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:15 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:15.899780 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6203d805-94bb-4298-973e-f37bc48ca2ec admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:15.904616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954f2af-225c-4a79-9672-c27dd622a1de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:15.905554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954f2af-225c-4a79-9672-c27dd622a1de admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:15.905842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954f2af-225c-4a79-9672-c27dd622a1de admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:15.906126 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8954f2af-225c-4a79-9672-c27dd622a1de admin admin] PATH_INFO: `/v3/projects/07a71f7dabdd4d3a8cd626d83128b44e/users/620a01e1a272447ca7cdb01558eda9ad/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:15.925679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954f2af-225c-4a79-9672-c27dd622a1de admin admin] RBAC: Authorizing `identity:create_grant(project_id=07a71f7dabdd4d3a8cd626d83128b44e, user_id=620a01e1a272447ca7cdb01558eda9ad, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:15.928789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8954f2af-225c-4a79-9672-c27dd622a1de admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:15.944606 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 894/1818] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:15 2022] PUT /identity/v3/projects/07a71f7dabdd4d3a8cd626d83128b44e/users/620a01e1a272447ca7cdb01558eda9ad/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:15.957776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daafd9a-3f6f-49b0-8830-c1d8d670433a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:15.958213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daafd9a-3f6f-49b0-8830-c1d8d670433a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:15.958510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9daafd9a-3f6f-49b0-8830-c1d8d670433a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:16.010630 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9daafd9a-3f6f-49b0-8830-c1d8d670433a None None] MFA Rules not processed for user `620a01e1a272447ca7cdb01558eda9ad`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:16.013081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9daafd9a-3f6f-49b0-8830-c1d8d670433a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:16.074019 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:DELETE=2,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:16.119900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 925/1819] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:15 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 165 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:16.125035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954f2af-225c-4a79-9672-c27dd622a1de admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:16.158711 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daafd9a-3f6f-49b0-8830-c1d8d670433a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:16.162326 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9daafd9a-3f6f-49b0-8830-c1d8d670433a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:16.230047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8954f2af-225c-4a79-9672-c27dd622a1de admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:16.238758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbec00-ff49-45cf-9f3b-13cd1ba1708e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:16.240576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbec00-ff49-45cf-9f3b-13cd1ba1708e admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:16.241111 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbec00-ff49-45cf-9f3b-13cd1ba1708e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:16.241593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8abbec00-ff49-45cf-9f3b-13cd1ba1708e admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:16.242493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbec00-ff49-45cf-9f3b-13cd1ba1708e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:16.246647 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8abbec00-ff49-45cf-9f3b-13cd1ba1708e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:16.299748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9daafd9a-3f6f-49b0-8830-c1d8d670433a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:16.306057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a990024-dd78-4edd-950b-283c03c9234d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:16.306939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a990024-dd78-4edd-950b-283c03c9234d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:16.307291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a990024-dd78-4edd-950b-283c03c9234d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:16.307503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a990024-dd78-4edd-950b-283c03c9234d admin admin] PATH_INFO: `/v3/projects/30c3f0dc52e44ef5b5aeb53b1244c3e8` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:16.308899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a990024-dd78-4edd-950b-283c03c9234d admin admin] RBAC: Authorizing `identity:delete_project(project_id=30c3f0dc52e44ef5b5aeb53b1244c3e8)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:16.312923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a990024-dd78-4edd-950b-283c03c9234d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:16.334453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 895/1820] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:16 2022] POST /identity/v3/projects => generated 379 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:16.338706 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbec00-ff49-45cf-9f3b-13cd1ba1708e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:16.347208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:16.386787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a990024-dd78-4edd-950b-283c03c9234d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '30c3f0dc52e44ef5b5aeb53b1244c3e8', 'request_id': 'req-1a990024-dd78-4edd-950b-283c03c9234d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:16.400170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a990024-dd78-4edd-950b-283c03c9234d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '30c3f0dc52e44ef5b5aeb53b1244c3e8', 'request_id': 'req-1a990024-dd78-4edd-950b-283c03c9234d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:16.409573 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a990024-dd78-4edd-950b-283c03c9234d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '30c3f0dc52e44ef5b5aeb53b1244c3e8', 'request_id': 'req-1a990024-dd78-4edd-950b-283c03c9234d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:16.429017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a990024-dd78-4edd-950b-283c03c9234d admin admin] The token cache is being invalidate because project 30c3f0dc52e44ef5b5aeb53b1244c3e8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:16.429488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a990024-dd78-4edd-950b-283c03c9234d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:16.430265 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a990024-dd78-4edd-950b-283c03c9234d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:16.432841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 926/1821] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:16 2022] DELETE /identity/v3/projects/30c3f0dc52e44ef5b5aeb53b1244c3e8 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:16.438915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81922f6c-2b83-426b-9a2b-5903688047f0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:16.439311 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81922f6c-2b83-426b-9a2b-5903688047f0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:16.439693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81922f6c-2b83-426b-9a2b-5903688047f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:16.462660 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-81922f6c-2b83-426b-9a2b-5903688047f0 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:16.463241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8abbec00-ff49-45cf-9f3b-13cd1ba1708e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:16.464240 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-81922f6c-2b83-426b-9a2b-5903688047f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:16.567270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 927/1822] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:16.569051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453676df-17cc-4d5e-9ad3-6fb3bb21eaf9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:16.569447 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453676df-17cc-4d5e-9ad3-6fb3bb21eaf9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:16.569845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-453676df-17cc-4d5e-9ad3-6fb3bb21eaf9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:16.596340 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-453676df-17cc-4d5e-9ad3-6fb3bb21eaf9 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:16.597863 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-453676df-17cc-4d5e-9ad3-6fb3bb21eaf9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:16.607300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6770e0-7361-4aa4-988e-d5065f4ecb15 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:16.608320 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6770e0-7361-4aa4-988e-d5065f4ecb15 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:16.608617 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6770e0-7361-4aa4-988e-d5065f4ecb15 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:16.608973 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca6770e0-7361-4aa4-988e-d5065f4ecb15 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:16.610362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 928/1823] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:16.610487 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6770e0-7361-4aa4-988e-d5065f4ecb15 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:16.612266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca6770e0-7361-4aa4-988e-d5065f4ecb15 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:16.614824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453676df-17cc-4d5e-9ad3-6fb3bb21eaf9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:16.619544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:16.626224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-453676df-17cc-4d5e-9ad3-6fb3bb21eaf9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:16.634402 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0d0b8-f0f1-4e45-940e-3bb523affe06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:16.635609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d0b8-f0f1-4e45-940e-3bb523affe06 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:16.635887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d0b8-f0f1-4e45-940e-3bb523affe06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:16.636497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11d0d0b8-f0f1-4e45-940e-3bb523affe06 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:16.637567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0d0b8-f0f1-4e45-940e-3bb523affe06 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:16.638770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0d0b8-f0f1-4e45-940e-3bb523affe06 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:16.642177 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11d0d0b8-f0f1-4e45-940e-3bb523affe06 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:16.652927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 896/1824] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:16 2022] POST /identity/v3/users => generated 290 bytes in 314 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:16.653875 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6770e0-7361-4aa4-988e-d5065f4ecb15 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:16.662106 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ca6770e0-7361-4aa4-988e-d5065f4ecb15 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:16.664456 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 929/1825] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:16 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:22:16.665485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0d0b8-f0f1-4e45-940e-3bb523affe06 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:16.680251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11d0d0b8-f0f1-4e45-940e-3bb523affe06 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:16.686434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdf0e5-b5d3-4e12-8a95-0f442a74a8aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:16.687432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdf0e5-b5d3-4e12-8a95-0f442a74a8aa admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:16.688479 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdf0e5-b5d3-4e12-8a95-0f442a74a8aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:16.688857 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69cdf0e5-b5d3-4e12-8a95-0f442a74a8aa admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:16.689418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca6770e0-7361-4aa4-988e-d5065f4ecb15 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:16.690287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdf0e5-b5d3-4e12-8a95-0f442a74a8aa admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:16.692557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69cdf0e5-b5d3-4e12-8a95-0f442a74a8aa admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:16.701750 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1bcf4-dea2-46df-baee-6e76a3988352 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:16.702451 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1bcf4-dea2-46df-baee-6e76a3988352 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:16.702735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1bcf4-dea2-46df-baee-6e76a3988352 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:16.703944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1bcf4-dea2-46df-baee-6e76a3988352 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:16.704291 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1bcf4-dea2-46df-baee-6e76a3988352 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:16.706012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0c1bcf4-dea2-46df-baee-6e76a3988352 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:16.737010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 897/1826] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 83 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:16.737941 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1bcf4-dea2-46df-baee-6e76a3988352 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:16.755855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 930/1827] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:16 2022] POST /identity/v3/projects => generated 389 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:16.758915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdf0e5-b5d3-4e12-8a95-0f442a74a8aa admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:16.771450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1bcf4-dea2-46df-baee-6e76a3988352 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:16.898441 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef7e56-5836-4f34-8e30-38cefca5c354 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:16.899837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef7e56-5836-4f34-8e30-38cefca5c354 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:16.899837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef7e56-5836-4f34-8e30-38cefca5c354 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:16.899837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72ef7e56-5836-4f34-8e30-38cefca5c354 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:16.903897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef7e56-5836-4f34-8e30-38cefca5c354 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:16.907609 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-72ef7e56-5836-4f34-8e30-38cefca5c354 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:16.915545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69cdf0e5-b5d3-4e12-8a95-0f442a74a8aa admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:16.937068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 898/1828] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:16.937068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef7e56-5836-4f34-8e30-38cefca5c354 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:16.949775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36e549-704f-4105-91c1-53f27931dfd5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:16.950591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36e549-704f-4105-91c1-53f27931dfd5 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:16.950742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36e549-704f-4105-91c1-53f27931dfd5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:16.951019 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e36e549-704f-4105-91c1-53f27931dfd5 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:16.951717 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36e549-704f-4105-91c1-53f27931dfd5 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:16.954753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e36e549-704f-4105-91c1-53f27931dfd5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:16.958190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72ef7e56-5836-4f34-8e30-38cefca5c354 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:16.966961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50a3a2d0-d5c9-41c1-84f9-725ac0cbf73c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:16.967881 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3a2d0-d5c9-41c1-84f9-725ac0cbf73c admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:16.968198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3a2d0-d5c9-41c1-84f9-725ac0cbf73c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:16.968481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50a3a2d0-d5c9-41c1-84f9-725ac0cbf73c admin admin] PATH_INFO: `/v3/projects/56dc57a381f64071b8e1d3a0e6fdb313/users/19a266ad3944413ebf08fd55ec064bcd/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:16.991999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3a2d0-d5c9-41c1-84f9-725ac0cbf73c admin admin] RBAC: Authorizing `identity:create_grant(project_id=56dc57a381f64071b8e1d3a0e6fdb313, user_id=19a266ad3944413ebf08fd55ec064bcd, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:16.996184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 931/1829] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:16 2022] POST /identity/v3/users => generated 295 bytes in 237 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:16.996319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50a3a2d0-d5c9-41c1-84f9-725ac0cbf73c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:16.997539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36e549-704f-4105-91c1-53f27931dfd5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:17.018544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e36e549-704f-4105-91c1-53f27931dfd5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:17.049668 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 899/1830] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:16 2022] PUT /identity/v3/projects/56dc57a381f64071b8e1d3a0e6fdb313/users/19a266ad3944413ebf08fd55ec064bcd/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:17.064528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec28fa6-07e1-43e6-a11a-c8eda148d0a3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:17.069402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec28fa6-07e1-43e6-a11a-c8eda148d0a3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:17.070130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ec28fa6-07e1-43e6-a11a-c8eda148d0a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:17.105106 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:17.149839 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf41a2-5e1a-4856-b4af-1b74a6223af0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:17.150596 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf41a2-5e1a-4856-b4af-1b74a6223af0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:17.150948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf41a2-5e1a-4856-b4af-1b74a6223af0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:17.153078 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3adf41a2-5e1a-4856-b4af-1b74a6223af0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:17.153849 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf41a2-5e1a-4856-b4af-1b74a6223af0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:17.157025 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3adf41a2-5e1a-4856-b4af-1b74a6223af0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:17.169353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7ec28fa6-07e1-43e6-a11a-c8eda148d0a3 None None] MFA Rules not processed for user `19a266ad3944413ebf08fd55ec064bcd`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:17.172295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7ec28fa6-07e1-43e6-a11a-c8eda148d0a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:17.189194 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 932/1831] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:16 2022] GET /identity/v3/roles => generated 1420 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:17.190133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf41a2-5e1a-4856-b4af-1b74a6223af0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:17.202712 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3adf41a2-5e1a-4856-b4af-1b74a6223af0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:17.216254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4714b-55c7-462e-9654-e6a933aa1249 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:17.219395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4714b-55c7-462e-9654-e6a933aa1249 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:17.219395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4714b-55c7-462e-9654-e6a933aa1249 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:17.219395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f4714b-55c7-462e-9654-e6a933aa1249 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:17.219395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4714b-55c7-462e-9654-e6a933aa1249 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:17.220404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f4714b-55c7-462e-9654-e6a933aa1249 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:17.238200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 933/1832] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:17.243087 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4714b-55c7-462e-9654-e6a933aa1249 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:17.285295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f4714b-55c7-462e-9654-e6a933aa1249 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:17.301756 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db6046eb-a4b6-4216-9dfc-aac4820b5b96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:17.303432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6046eb-a4b6-4216-9dfc-aac4820b5b96 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:17.303860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6046eb-a4b6-4216-9dfc-aac4820b5b96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:17.304200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db6046eb-a4b6-4216-9dfc-aac4820b5b96 admin admin] PATH_INFO: `/v3/projects/13e45bcd07044e0dad4355e768b11d6a/users/bb53743d0d844225a8a8e34e6a1c5a8a/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:17.320200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 900/1833] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:17 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 257 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:17.324838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec28fa6-07e1-43e6-a11a-c8eda148d0a3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:17.347592 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6046eb-a4b6-4216-9dfc-aac4820b5b96 admin admin] RBAC: Authorizing `identity:create_grant(project_id=13e45bcd07044e0dad4355e768b11d6a, user_id=bb53743d0d844225a8a8e34e6a1c5a8a, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:17.356295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db6046eb-a4b6-4216-9dfc-aac4820b5b96 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:17.357748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ec28fa6-07e1-43e6-a11a-c8eda148d0a3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:17.385143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509571b6-3984-4149-8cd3-5e049a557122 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:17.386015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509571b6-3984-4149-8cd3-5e049a557122 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:17.386687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509571b6-3984-4149-8cd3-5e049a557122 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:17.387114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-509571b6-3984-4149-8cd3-5e049a557122 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:17.388385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509571b6-3984-4149-8cd3-5e049a557122 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:17.391333 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-509571b6-3984-4149-8cd3-5e049a557122 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:17.402098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 934/1834] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:17 2022] PUT /identity/v3/projects/13e45bcd07044e0dad4355e768b11d6a/users/bb53743d0d844225a8a8e34e6a1c5a8a/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:17.417385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30065675-5d70-462a-9149-78ae5ff8dc38 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:17.417675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30065675-5d70-462a-9149-78ae5ff8dc38 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:17.417965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30065675-5d70-462a-9149-78ae5ff8dc38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:17.431611 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 901/1835] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:17 2022] POST /identity/v3/projects => generated 379 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:17.437320 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509571b6-3984-4149-8cd3-5e049a557122 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:17.489958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-30065675-5d70-462a-9149-78ae5ff8dc38 None None] MFA Rules not processed for user `bb53743d0d844225a8a8e34e6a1c5a8a`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:17.492622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-30065675-5d70-462a-9149-78ae5ff8dc38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:17.510604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:17.530684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-509571b6-3984-4149-8cd3-5e049a557122 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:17.538275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec708-cc7c-44f1-978b-b0f14e2b7aed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:17.540026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec708-cc7c-44f1-978b-b0f14e2b7aed admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:17.540321 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec708-cc7c-44f1-978b-b0f14e2b7aed admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:17.540812 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33eec708-cc7c-44f1-978b-b0f14e2b7aed admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:17.542177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eec708-cc7c-44f1-978b-b0f14e2b7aed admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:17.544603 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33eec708-cc7c-44f1-978b-b0f14e2b7aed admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:17.580536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 902/1836] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:17 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:17.584352 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec708-cc7c-44f1-978b-b0f14e2b7aed admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:17.603122 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33eec708-cc7c-44f1-978b-b0f14e2b7aed admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:17.611436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b0f5-1561-4d6c-ac9a-feea884c8af5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:17.612504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b0f5-1561-4d6c-ac9a-feea884c8af5 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:17.612925 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b0f5-1561-4d6c-ac9a-feea884c8af5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:17.613291 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91b0f5-1561-4d6c-ac9a-feea884c8af5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:17.614620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91b0f5-1561-4d6c-ac9a-feea884c8af5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:17.615762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 935/1837] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:17 2022] POST /identity/v3/auth/tokens => generated 3256 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:17.616616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91b0f5-1561-4d6c-ac9a-feea884c8af5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:17.620138 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30065675-5d70-462a-9149-78ae5ff8dc38 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:17.630156 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 903/1838] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:17.632672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30065675-5d70-462a-9149-78ae5ff8dc38 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:17.634596 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b0f5-1561-4d6c-ac9a-feea884c8af5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:17.638451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cad41-7bc8-4371-a12f-32d850ea18d9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:17.639130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cad41-7bc8-4371-a12f-32d850ea18d9 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:17.639420 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cad41-7bc8-4371-a12f-32d850ea18d9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:17.639737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-807cad41-7bc8-4371-a12f-32d850ea18d9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:17.640416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cad41-7bc8-4371-a12f-32d850ea18d9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:17.642401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-807cad41-7bc8-4371-a12f-32d850ea18d9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:17.645349 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91b0f5-1561-4d6c-ac9a-feea884c8af5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:17.650331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1917a-a78c-43ff-ab2a-0176ebc53bd9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:17.651338 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1917a-a78c-43ff-ab2a-0176ebc53bd9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:17.651654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1917a-a78c-43ff-ab2a-0176ebc53bd9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:17.651943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12b1917a-a78c-43ff-ab2a-0176ebc53bd9 admin admin] PATH_INFO: `/v3/projects/06ad8a003629428388dbb55f81e2dc9d/users/d05061829546445c86c7bcf0b83e29c2/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:17.680840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1917a-a78c-43ff-ab2a-0176ebc53bd9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ad8a003629428388dbb55f81e2dc9d, user_id=d05061829546445c86c7bcf0b83e29c2, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:17.683741 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12b1917a-a78c-43ff-ab2a-0176ebc53bd9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:17.700328 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 936/1839] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:17 2022] POST /identity/v3/projects => generated 389 bytes in 78 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:17.701273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cad41-7bc8-4371-a12f-32d850ea18d9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:17.728701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 904/1840] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:17 2022] PUT /identity/v3/projects/06ad8a003629428388dbb55f81e2dc9d/users/d05061829546445c86c7bcf0b83e29c2/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 95 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:17.732725 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1917a-a78c-43ff-ab2a-0176ebc53bd9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:17.774861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:17.834626 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-807cad41-7bc8-4371-a12f-32d850ea18d9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:17.862528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12b1917a-a78c-43ff-ab2a-0176ebc53bd9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:17.867574 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762a9bc-d305-415d-aa70-262728bc2549 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:17.868556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762a9bc-d305-415d-aa70-262728bc2549 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:17.868680 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762a9bc-d305-415d-aa70-262728bc2549 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:17.869044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8762a9bc-d305-415d-aa70-262728bc2549 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:17.869868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762a9bc-d305-415d-aa70-262728bc2549 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:17.871745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8762a9bc-d305-415d-aa70-262728bc2549 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:17.910284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 905/1841] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:17 2022] GET /identity/v3/roles => generated 1420 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:17.911715 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762a9bc-d305-415d-aa70-262728bc2549 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:17.923540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8762a9bc-d305-415d-aa70-262728bc2549 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:17.935558 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-752098df-824b-4490-b685-b41ee6c806d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:17.936519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752098df-824b-4490-b685-b41ee6c806d5 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:17.937217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752098df-824b-4490-b685-b41ee6c806d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:17.937560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-752098df-824b-4490-b685-b41ee6c806d5 admin admin] PATH_INFO: `/v3/projects/06ad8a003629428388dbb55f81e2dc9d/users/d05061829546445c86c7bcf0b83e29c2/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:17.941459 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752098df-824b-4490-b685-b41ee6c806d5 admin admin] RBAC: Authorizing `identity:create_grant(project_id=06ad8a003629428388dbb55f81e2dc9d, user_id=d05061829546445c86c7bcf0b83e29c2, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:17.946830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-752098df-824b-4490-b685-b41ee6c806d5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:17.982991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa11f5f-9b1e-42af-a6cd-87745749e09c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:17.983895 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa11f5f-9b1e-42af-a6cd-87745749e09c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:17.984337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa11f5f-9b1e-42af-a6cd-87745749e09c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:17.984719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-caa11f5f-9b1e-42af-a6cd-87745749e09c admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:17.985678 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa11f5f-9b1e-42af-a6cd-87745749e09c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:17.989975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-caa11f5f-9b1e-42af-a6cd-87745749e09c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:18.000738 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 906/1842] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:17 2022] PUT /identity/v3/projects/06ad8a003629428388dbb55f81e2dc9d/users/d05061829546445c86c7bcf0b83e29c2/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:18.003753 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8c9b5-1b41-42e7-9446-ec1652e36956 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:18.004056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8c9b5-1b41-42e7-9446-ec1652e36956 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:18.004345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba8c9b5-1b41-42e7-9446-ec1652e36956 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:18.041038 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 937/1843] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:17 2022] POST /identity/v3/users => generated 301 bytes in 338 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:18.044060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa11f5f-9b1e-42af-a6cd-87745749e09c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:18.058675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-caa11f5f-9b1e-42af-a6cd-87745749e09c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:18.059789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4ba8c9b5-1b41-42e7-9446-ec1652e36956 None None] MFA Rules not processed for user `d05061829546445c86c7bcf0b83e29c2`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:18.061907 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4ba8c9b5-1b41-42e7-9446-ec1652e36956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:18.126352 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:18.243751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af93379-9d8f-4502-856a-f922500d011b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:18.244456 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af93379-9d8f-4502-856a-f922500d011b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:18.244753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af93379-9d8f-4502-856a-f922500d011b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:18.245055 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7af93379-9d8f-4502-856a-f922500d011b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:18.247222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af93379-9d8f-4502-856a-f922500d011b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:18.248875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7af93379-9d8f-4502-856a-f922500d011b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:18.281257 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 938/1844] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:18.285689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 907/1845] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 284 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:18.293072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af93379-9d8f-4502-856a-f922500d011b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:18.301959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8c9b5-1b41-42e7-9446-ec1652e36956 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:18.303714 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4ba8c9b5-1b41-42e7-9446-ec1652e36956 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:18.325722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7af93379-9d8f-4502-856a-f922500d011b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:18.338376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e85e88-f308-46d7-b650-b7986c149045 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:18.339287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e85e88-f308-46d7-b650-b7986c149045 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:18.339575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e85e88-f308-46d7-b650-b7986c149045 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:18.339860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12e85e88-f308-46d7-b650-b7986c149045 admin admin] PATH_INFO: `/v3/projects/e37c273d15ee47209610c2563b977eba/users/e5992cba7a7d45b3ab88a39e4c603870/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:18.368096 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e85e88-f308-46d7-b650-b7986c149045 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37c273d15ee47209610c2563b977eba, user_id=e5992cba7a7d45b3ab88a39e4c603870, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:18.371675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12e85e88-f308-46d7-b650-b7986c149045 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:18.409651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 939/1846] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:18 2022] PUT /identity/v3/projects/e37c273d15ee47209610c2563b977eba/users/e5992cba7a7d45b3ab88a39e4c603870/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:18.415784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e85e88-f308-46d7-b650-b7986c149045 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:18.480867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba8c9b5-1b41-42e7-9446-ec1652e36956 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:18.522272 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12e85e88-f308-46d7-b650-b7986c149045 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:18.538049 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbe8e6-42e9-46d4-8f63-54b3a7678e3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:18.542601 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe8e6-42e9-46d4-8f63-54b3a7678e3d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:18.543223 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe8e6-42e9-46d4-8f63-54b3a7678e3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:18.544151 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84fbe8e6-42e9-46d4-8f63-54b3a7678e3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:18.547210 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbe8e6-42e9-46d4-8f63-54b3a7678e3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:18.550759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84fbe8e6-42e9-46d4-8f63-54b3a7678e3d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:18.585251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 940/1847] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:18 2022] GET /identity/v3/roles => generated 1420 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:18.587821 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbe8e6-42e9-46d4-8f63-54b3a7678e3d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:18.591869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:18.605500 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009fcb5-2988-43e7-b693-eba9d72822c8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:18.606556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009fcb5-2988-43e7-b693-eba9d72822c8 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:18.606556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009fcb5-2988-43e7-b693-eba9d72822c8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:18.606813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f009fcb5-2988-43e7-b693-eba9d72822c8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:18.615651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84fbe8e6-42e9-46d4-8f63-54b3a7678e3d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:18.628300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b027f28-bb82-4980-b9e0-54fc35b0f777 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:18.629294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b027f28-bb82-4980-b9e0-54fc35b0f777 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:18.631394 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b027f28-bb82-4980-b9e0-54fc35b0f777 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:18.632632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b027f28-bb82-4980-b9e0-54fc35b0f777 admin admin] PATH_INFO: `/v3/projects/e37c273d15ee47209610c2563b977eba/users/e5992cba7a7d45b3ab88a39e4c603870/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:18.637240 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b027f28-bb82-4980-b9e0-54fc35b0f777 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e37c273d15ee47209610c2563b977eba, user_id=e5992cba7a7d45b3ab88a39e4c603870, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:18.646615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b027f28-bb82-4980-b9e0-54fc35b0f777 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:18.694262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 941/1848] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:18 2022] PUT /identity/v3/projects/e37c273d15ee47209610c2563b977eba/users/e5992cba7a7d45b3ab88a39e4c603870/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:18.699714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7e520-a66d-4e9e-830f-1eb12e1ef999 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:18.700027 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7e520-a66d-4e9e-830f-1eb12e1ef999 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:18.700315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a7e520-a66d-4e9e-830f-1eb12e1ef999 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:18.774952 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-47a7e520-a66d-4e9e-830f-1eb12e1ef999 None None] MFA Rules not processed for user `e5992cba7a7d45b3ab88a39e4c603870`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:18.780940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-47a7e520-a66d-4e9e-830f-1eb12e1ef999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:18.801023 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009fcb5-2988-43e7-b693-eba9d72822c8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:18.806217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f009fcb5-2988-43e7-b693-eba9d72822c8 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:18.853324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 908/1849] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:18 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:18.859731 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009fcb5-2988-43e7-b693-eba9d72822c8 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:18.861899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f009fcb5-2988-43e7-b693-eba9d72822c8 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:18.911350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f009fcb5-2988-43e7-b693-eba9d72822c8 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:19.033081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 942/1850] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:18 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 338 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:19.037354 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7e520-a66d-4e9e-830f-1eb12e1ef999 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:19.038909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-47a7e520-a66d-4e9e-830f-1eb12e1ef999 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:19.060810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:19.092224 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872bd90-9471-46cf-a75d-128f2a49853d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:19.092969 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872bd90-9471-46cf-a75d-128f2a49853d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:19.093284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872bd90-9471-46cf-a75d-128f2a49853d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:19.093564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0872bd90-9471-46cf-a75d-128f2a49853d admin admin] PATH_INFO: `/v3/users/bc0389c5d9b54a2daead0bc774166676` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:19.099912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872bd90-9471-46cf-a75d-128f2a49853d admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc0389c5d9b54a2daead0bc774166676)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:19.101993 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0872bd90-9471-46cf-a75d-128f2a49853d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:19.175899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47a7e520-a66d-4e9e-830f-1eb12e1ef999 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:19.185353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdd8553-a66b-4cfa-a322-4747ec7853af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:19.186046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd8553-a66b-4cfa-a322-4747ec7853af service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:19.186335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd8553-a66b-4cfa-a322-4747ec7853af service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:19.186621 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdd8553-a66b-4cfa-a322-4747ec7853af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:19.189197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cfdd8553-a66b-4cfa-a322-4747ec7853af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:19.197705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0872bd90-9471-46cf-a75d-128f2a49853d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc0389c5d9b54a2daead0bc774166676'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:19.205859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0872bd90-9471-46cf-a75d-128f2a49853d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc0389c5d9b54a2daead0bc774166676'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:19.206840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0872bd90-9471-46cf-a75d-128f2a49853d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc0389c5d9b54a2daead0bc774166676'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:19.219892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0872bd90-9471-46cf-a75d-128f2a49853d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc0389c5d9b54a2daead0bc774166676'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:19.228892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0872bd90-9471-46cf-a75d-128f2a49853d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc0389c5d9b54a2daead0bc774166676'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:19.237839 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 909/1851] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:18 2022] DELETE /identity/v3/users/bc0389c5d9b54a2daead0bc774166676 => generated 0 bytes in 379 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:19.239165 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872bd90-9471-46cf-a75d-128f2a49853d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:19.241324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0872bd90-9471-46cf-a75d-128f2a49853d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:19.260484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd8553-a66b-4cfa-a322-4747ec7853af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:19.262274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdd8553-a66b-4cfa-a322-4747ec7853af service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:19.272450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:19.272732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 943/1852] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:19 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 239 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:19.274162 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254e51-1984-45fe-86fa-7f2c98b967ac None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:19.274453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254e51-1984-45fe-86fa-7f2c98b967ac None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:19.274731 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be254e51-1984-45fe-86fa-7f2c98b967ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:19.292489 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-be254e51-1984-45fe-86fa-7f2c98b967ac None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:19.293738 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-be254e51-1984-45fe-86fa-7f2c98b967ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:19.321222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0872bd90-9471-46cf-a75d-128f2a49853d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:19.325319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47eb22-7864-465a-bf6e-69612a8afdbf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:19.325954 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47eb22-7864-465a-bf6e-69612a8afdbf service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:19.326237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47eb22-7864-465a-bf6e-69612a8afdbf service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:19.326512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e47eb22-7864-465a-bf6e-69612a8afdbf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:19.329818 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7e47eb22-7864-465a-bf6e-69612a8afdbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:19.368920 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 944/1853] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:19.378963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be254e51-1984-45fe-86fa-7f2c98b967ac None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:19.380604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-be254e51-1984-45fe-86fa-7f2c98b967ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:19.405172 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47eb22-7864-465a-bf6e-69612a8afdbf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:19.406789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e47eb22-7864-465a-bf6e-69612a8afdbf service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:19.418940 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 910/1854] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 180 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:19.461980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be254e51-1984-45fe-86fa-7f2c98b967ac None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:19.466130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1ea2327-773f-4ff5-8697-35a408277b69 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:19.466782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea2327-773f-4ff5-8697-35a408277b69 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:19.467230 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea2327-773f-4ff5-8697-35a408277b69 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:19.467505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1ea2327-773f-4ff5-8697-35a408277b69 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:19.481730 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea2327-773f-4ff5-8697-35a408277b69 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:19.483194 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1ea2327-773f-4ff5-8697-35a408277b69 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:19.491604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:19.499363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 945/1855] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 120 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:22:19.790919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47eb22-7864-465a-bf6e-69612a8afdbf service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:19.800804 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7e47eb22-7864-465a-bf6e-69612a8afdbf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:19.833181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e47eb22-7864-465a-bf6e-69612a8afdbf service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:19.843862 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7e7a1-042b-4e2c-86dc-0c950722276e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:19.844756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e7a1-042b-4e2c-86dc-0c950722276e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:19.845076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e7a1-042b-4e2c-86dc-0c950722276e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:19.845623 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cb7e7a1-042b-4e2c-86dc-0c950722276e admin admin] PATH_INFO: `/v3/users/bb53743d0d844225a8a8e34e6a1c5a8a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:19.850798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7e7a1-042b-4e2c-86dc-0c950722276e admin admin] RBAC: Authorizing `identity:delete_user(user_id=bb53743d0d844225a8a8e34e6a1c5a8a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:19.858433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cb7e7a1-042b-4e2c-86dc-0c950722276e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:19.960929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8cb7e7a1-042b-4e2c-86dc-0c950722276e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bb53743d0d844225a8a8e34e6a1c5a8a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:19.972260 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8cb7e7a1-042b-4e2c-86dc-0c950722276e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bb53743d0d844225a8a8e34e6a1c5a8a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:19.973850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8cb7e7a1-042b-4e2c-86dc-0c950722276e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bb53743d0d844225a8a8e34e6a1c5a8a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:19.998454 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8cb7e7a1-042b-4e2c-86dc-0c950722276e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bb53743d0d844225a8a8e34e6a1c5a8a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.022899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8cb7e7a1-042b-4e2c-86dc-0c950722276e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bb53743d0d844225a8a8e34e6a1c5a8a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.037242 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 911/1856] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:19 2022] DELETE /identity/v3/users/bb53743d0d844225a8a8e34e6a1c5a8a => generated 0 bytes in 244 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:20.038941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d584-08cb-4abb-bdf3-ebed3498623b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:20.039238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d584-08cb-4abb-bdf3-ebed3498623b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:20.039521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6830d584-08cb-4abb-bdf3-ebed3498623b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:20.075553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6830d584-08cb-4abb-bdf3-ebed3498623b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:20.077850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6830d584-08cb-4abb-bdf3-ebed3498623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:20.123998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7e7a1-042b-4e2c-86dc-0c950722276e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:20.126219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8cb7e7a1-042b-4e2c-86dc-0c950722276e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:20.235686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 946/1857] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:20.248442 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830d584-08cb-4abb-bdf3-ebed3498623b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:20.250680 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:20.252096 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6830d584-08cb-4abb-bdf3-ebed3498623b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:20.282754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cb7e7a1-042b-4e2c-86dc-0c950722276e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:20.288295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:20.289184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:20.289467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:20.289743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] PATH_INFO: `/v3/projects/64ab075b149642dea486df2c863f5bea` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:20.291191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] RBAC: Authorizing `identity:delete_project(project_id=64ab075b149642dea486df2c863f5bea)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:20.293734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:20.322362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6830d584-08cb-4abb-bdf3-ebed3498623b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:20.330510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e859b9-eb9b-42bf-85e8-805d8052af9d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:20.331605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e859b9-eb9b-42bf-85e8-805d8052af9d service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:20.332176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e859b9-eb9b-42bf-85e8-805d8052af9d service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:20.332528 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5e859b9-eb9b-42bf-85e8-805d8052af9d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:20.342953 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e859b9-eb9b-42bf-85e8-805d8052af9d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:20.344519 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5e859b9-eb9b-42bf-85e8-805d8052af9d service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:20.355483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 947/1858] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:20 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:22:20.357530 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '64ab075b149642dea486df2c863f5bea', 'request_id': 'req-d60c926a-5e2a-4042-8062-368dc04aaf70'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.366057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '64ab075b149642dea486df2c863f5bea', 'request_id': 'req-d60c926a-5e2a-4042-8062-368dc04aaf70'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.373898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '64ab075b149642dea486df2c863f5bea', 'request_id': 'req-d60c926a-5e2a-4042-8062-368dc04aaf70'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.386069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] The token cache is being invalidate because project 64ab075b149642dea486df2c863f5bea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:20.386437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.387047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.388841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 912/1859] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:20 2022] DELETE /identity/v3/projects/64ab075b149642dea486df2c863f5bea => generated 0 bytes in 266 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:20.392686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e859b9-eb9b-42bf-85e8-805d8052af9d service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:20.403097 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5e859b9-eb9b-42bf-85e8-805d8052af9d service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:20.473584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe47985-8adb-4404-bd2c-45b3831763a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:20.474500 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe47985-8adb-4404-bd2c-45b3831763a9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:20.474891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe47985-8adb-4404-bd2c-45b3831763a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:20.475129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fbe47985-8adb-4404-bd2c-45b3831763a9 admin admin] PATH_INFO: `/v3/users/194eddc5fafb459f9e16f0bb0a934d55` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:20.476324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe47985-8adb-4404-bd2c-45b3831763a9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=194eddc5fafb459f9e16f0bb0a934d55)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:20.478357 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fbe47985-8adb-4404-bd2c-45b3831763a9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:20.523338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:20.525379 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fbe47985-8adb-4404-bd2c-45b3831763a9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '194eddc5fafb459f9e16f0bb0a934d55'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.526246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fbe47985-8adb-4404-bd2c-45b3831763a9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '194eddc5fafb459f9e16f0bb0a934d55'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.535809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fbe47985-8adb-4404-bd2c-45b3831763a9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '194eddc5fafb459f9e16f0bb0a934d55'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.536480 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fbe47985-8adb-4404-bd2c-45b3831763a9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '194eddc5fafb459f9e16f0bb0a934d55'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.549546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-fbe47985-8adb-4404-bd2c-45b3831763a9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '194eddc5fafb459f9e16f0bb0a934d55'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.566342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 948/1860] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:20 2022] DELETE /identity/v3/users/194eddc5fafb459f9e16f0bb0a934d55 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:20.701208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:20.702766 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:20.715913 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60c926a-5e2a-4042-8062-368dc04aaf70 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:20.777971 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:20.778830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:20.779109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:20.779382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] PATH_INFO: `/v3/projects/13e45bcd07044e0dad4355e768b11d6a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:20.780544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] RBAC: Authorizing `identity:delete_project(project_id=13e45bcd07044e0dad4355e768b11d6a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:20.783013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:20.838715 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '13e45bcd07044e0dad4355e768b11d6a', 'request_id': 'req-18d139c6-ec82-4423-9f25-d000c1839d81'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.847307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe47985-8adb-4404-bd2c-45b3831763a9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:20.848943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fbe47985-8adb-4404-bd2c-45b3831763a9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:20.854267 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '13e45bcd07044e0dad4355e768b11d6a', 'request_id': 'req-18d139c6-ec82-4423-9f25-d000c1839d81'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.862762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '13e45bcd07044e0dad4355e768b11d6a', 'request_id': 'req-18d139c6-ec82-4423-9f25-d000c1839d81'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.870919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:20.875949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] The token cache is being invalidate because project 13e45bcd07044e0dad4355e768b11d6a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:20.876579 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.877681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:20.883155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 913/1861] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:20 2022] DELETE /identity/v3/projects/13e45bcd07044e0dad4355e768b11d6a => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:20.886493 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fbe47985-8adb-4404-bd2c-45b3831763a9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:20.887913 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:20.890863 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:20.963459 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b678c13c-5799-4e52-898f-44736968117d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:20.964434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678c13c-5799-4e52-898f-44736968117d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:20.964715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678c13c-5799-4e52-898f-44736968117d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:20.965880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b678c13c-5799-4e52-898f-44736968117d admin admin] PATH_INFO: `/v3/projects/b3cc6b41fb8349458980359f97d21993` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:20.966607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678c13c-5799-4e52-898f-44736968117d admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cc6b41fb8349458980359f97d21993)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:20.969542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b678c13c-5799-4e52-898f-44736968117d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:20.970824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18d139c6-ec82-4423-9f25-d000c1839d81 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:20.980788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-422eb3b6-44ff-46f9-8b07-b258a3a615d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:20.981664 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422eb3b6-44ff-46f9-8b07-b258a3a615d1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:20.982245 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422eb3b6-44ff-46f9-8b07-b258a3a615d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:20.982245 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-422eb3b6-44ff-46f9-8b07-b258a3a615d1 admin admin] PATH_INFO: `/v3/users/e5992cba7a7d45b3ab88a39e4c603870` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:20.983622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422eb3b6-44ff-46f9-8b07-b258a3a615d1 admin admin] RBAC: Authorizing `identity:delete_user(user_id=e5992cba7a7d45b3ab88a39e4c603870)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:20.985626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-422eb3b6-44ff-46f9-8b07-b258a3a615d1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:21.025663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b678c13c-5799-4e52-898f-44736968117d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cc6b41fb8349458980359f97d21993', 'request_id': 'req-b678c13c-5799-4e52-898f-44736968117d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.035740 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b678c13c-5799-4e52-898f-44736968117d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cc6b41fb8349458980359f97d21993', 'request_id': 'req-b678c13c-5799-4e52-898f-44736968117d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.044797 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b678c13c-5799-4e52-898f-44736968117d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cc6b41fb8349458980359f97d21993', 'request_id': 'req-b678c13c-5799-4e52-898f-44736968117d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.047849 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-422eb3b6-44ff-46f9-8b07-b258a3a615d1 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e5992cba7a7d45b3ab88a39e4c603870'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.057385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-422eb3b6-44ff-46f9-8b07-b258a3a615d1 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e5992cba7a7d45b3ab88a39e4c603870'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.057857 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b678c13c-5799-4e52-898f-44736968117d admin admin] The token cache is being invalidate because project b3cc6b41fb8349458980359f97d21993 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:21.058147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b678c13c-5799-4e52-898f-44736968117d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.058555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-422eb3b6-44ff-46f9-8b07-b258a3a615d1 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e5992cba7a7d45b3ab88a39e4c603870'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.058889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b678c13c-5799-4e52-898f-44736968117d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.061458 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 949/1862] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:20 2022] DELETE /identity/v3/projects/b3cc6b41fb8349458980359f97d21993 => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:21.066126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca4aa2-d1cd-4991-a95a-11bad71863fe None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:21.066415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca4aa2-d1cd-4991-a95a-11bad71863fe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:21.066700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66ca4aa2-d1cd-4991-a95a-11bad71863fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:21.089946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-66ca4aa2-d1cd-4991-a95a-11bad71863fe None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:21.091509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-66ca4aa2-d1cd-4991-a95a-11bad71863fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:21.097855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-422eb3b6-44ff-46f9-8b07-b258a3a615d1 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e5992cba7a7d45b3ab88a39e4c603870'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.112892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-422eb3b6-44ff-46f9-8b07-b258a3a615d1 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e5992cba7a7d45b3ab88a39e4c603870'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.126959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 914/1863] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:20 2022] DELETE /identity/v3/users/e5992cba7a7d45b3ab88a39e4c603870 => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:21.175434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:21.205005 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 950/1864] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:21.214682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8e593-e4c4-4a5f-972c-f07d8c258787 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:21.214682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8e593-e4c4-4a5f-972c-f07d8c258787 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:21.214682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa8e593-e4c4-4a5f-972c-f07d8c258787 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:21.254635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-eaa8e593-e4c4-4a5f-972c-f07d8c258787 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:21.255968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-eaa8e593-e4c4-4a5f-972c-f07d8c258787 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:21.356131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 915/1865] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:21.361322 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca4aa2-d1cd-4991-a95a-11bad71863fe None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:21.374423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66ca4aa2-d1cd-4991-a95a-11bad71863fe None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:21.387130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685ee15-badf-4439-ae01-ddffb3ef0ba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:21.389306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685ee15-badf-4439-ae01-ddffb3ef0ba8 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:21.391224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685ee15-badf-4439-ae01-ddffb3ef0ba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:21.392092 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f685ee15-badf-4439-ae01-ddffb3ef0ba8 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:21.393847 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685ee15-badf-4439-ae01-ddffb3ef0ba8 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:21.395542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685ee15-badf-4439-ae01-ddffb3ef0ba8 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:21.399356 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f685ee15-badf-4439-ae01-ddffb3ef0ba8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:21.422500 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 951/1866] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:21.426774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8e593-e4c4-4a5f-972c-f07d8c258787 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:21.454360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa8e593-e4c4-4a5f-972c-f07d8c258787 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:21.476410 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b77b5-e836-404a-b689-c5fdb4346f98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:21.477136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b77b5-e836-404a-b689-c5fdb4346f98 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:21.480010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b77b5-e836-404a-b689-c5fdb4346f98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:21.480319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-768b77b5-e836-404a-b689-c5fdb4346f98 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:21.481493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b77b5-e836-404a-b689-c5fdb4346f98 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:21.498065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-768b77b5-e836-404a-b689-c5fdb4346f98 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:21.572685 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=88,keystone:DELETE=10,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:21.586960 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 916/1867] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:21 2022] POST /identity/v3/projects => generated 385 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:21.592316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685ee15-badf-4439-ae01-ddffb3ef0ba8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:21.608003 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f685ee15-badf-4439-ae01-ddffb3ef0ba8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:21.711515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b77b5-e836-404a-b689-c5fdb4346f98 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:21.714147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-768b77b5-e836-404a-b689-c5fdb4346f98 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:21.746123 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45394ee7-c6cd-4cc2-aeda-6a65b46b092c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:21.747568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45394ee7-c6cd-4cc2-aeda-6a65b46b092c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:21.747960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45394ee7-c6cd-4cc2-aeda-6a65b46b092c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:21.748336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45394ee7-c6cd-4cc2-aeda-6a65b46b092c admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:21.749627 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45394ee7-c6cd-4cc2-aeda-6a65b46b092c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:21.752953 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45394ee7-c6cd-4cc2-aeda-6a65b46b092c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:21.789167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 952/1868] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:21 2022] POST /identity/v3/users => generated 293 bytes in 196 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:21.791361 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45394ee7-c6cd-4cc2-aeda-6a65b46b092c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:21.802906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45394ee7-c6cd-4cc2-aeda-6a65b46b092c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:21.808627 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2d678-f6af-4b5d-93da-029aeddf9fe1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:21.809554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2d678-f6af-4b5d-93da-029aeddf9fe1 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:21.809953 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2d678-f6af-4b5d-93da-029aeddf9fe1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:21.810334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fb2d678-f6af-4b5d-93da-029aeddf9fe1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:21.813699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2d678-f6af-4b5d-93da-029aeddf9fe1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:21.815450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fb2d678-f6af-4b5d-93da-029aeddf9fe1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:21.830960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 953/1869] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 40 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:21.835013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2d678-f6af-4b5d-93da-029aeddf9fe1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:21.841270 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-768b77b5-e836-404a-b689-c5fdb4346f98 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:21.847727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b93cb1c-28d0-4e8e-9098-651751d172f5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:21.847918 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fb2d678-f6af-4b5d-93da-029aeddf9fe1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:21.848879 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93cb1c-28d0-4e8e-9098-651751d172f5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:21.848879 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93cb1c-28d0-4e8e-9098-651751d172f5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:21.849279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b93cb1c-28d0-4e8e-9098-651751d172f5 admin admin] PATH_INFO: `/v3/projects/e37c273d15ee47209610c2563b977eba` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:21.850451 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93cb1c-28d0-4e8e-9098-651751d172f5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e37c273d15ee47209610c2563b977eba)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:21.852382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b93cb1c-28d0-4e8e-9098-651751d172f5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:21.852819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102d0d2-2b5b-44fc-bf73-c7ea5880366c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:21.853548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102d0d2-2b5b-44fc-bf73-c7ea5880366c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:21.854142 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102d0d2-2b5b-44fc-bf73-c7ea5880366c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:21.854142 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8102d0d2-2b5b-44fc-bf73-c7ea5880366c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:21.855090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102d0d2-2b5b-44fc-bf73-c7ea5880366c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:21.856707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8102d0d2-2b5b-44fc-bf73-c7ea5880366c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:21.873117 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 954/1870] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:21 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:21.875960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102d0d2-2b5b-44fc-bf73-c7ea5880366c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:21.887337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8102d0d2-2b5b-44fc-bf73-c7ea5880366c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:21.894137 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0f450e-1a64-431e-ab1e-e13ff9ac6f7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:21.895552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f450e-1a64-431e-ab1e-e13ff9ac6f7c admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:21.896211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f450e-1a64-431e-ab1e-e13ff9ac6f7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:21.896492 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0f450e-1a64-431e-ab1e-e13ff9ac6f7c admin admin] PATH_INFO: `/v3/projects/fad38cdd541a49f89c51df1497de85a4/users/4e64beec480f4684b46afb1982e829e0/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:21.908597 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8b93cb1c-28d0-4e8e-9098-651751d172f5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e37c273d15ee47209610c2563b977eba', 'request_id': 'req-8b93cb1c-28d0-4e8e-9098-651751d172f5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.913283 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f450e-1a64-431e-ab1e-e13ff9ac6f7c admin admin] RBAC: Authorizing `identity:create_grant(project_id=fad38cdd541a49f89c51df1497de85a4, user_id=4e64beec480f4684b46afb1982e829e0, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:21.915886 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0f450e-1a64-431e-ab1e-e13ff9ac6f7c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:21.917647 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8b93cb1c-28d0-4e8e-9098-651751d172f5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e37c273d15ee47209610c2563b977eba', 'request_id': 'req-8b93cb1c-28d0-4e8e-9098-651751d172f5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.924824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8b93cb1c-28d0-4e8e-9098-651751d172f5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e37c273d15ee47209610c2563b977eba', 'request_id': 'req-8b93cb1c-28d0-4e8e-9098-651751d172f5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.935580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 955/1871] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:21 2022] PUT /identity/v3/projects/fad38cdd541a49f89c51df1497de85a4/users/4e64beec480f4684b46afb1982e829e0/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:21.946511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950090d6-13bb-4cb9-b10c-c774afbde7ad None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:21.946824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950090d6-13bb-4cb9-b10c-c774afbde7ad None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:21.947074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-950090d6-13bb-4cb9-b10c-c774afbde7ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:21.950823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8b93cb1c-28d0-4e8e-9098-651751d172f5 admin admin] The token cache is being invalidate because project e37c273d15ee47209610c2563b977eba was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:21.951123 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8b93cb1c-28d0-4e8e-9098-651751d172f5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.951775 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8b93cb1c-28d0-4e8e-9098-651751d172f5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:21.956882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 917/1872] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:21 2022] DELETE /identity/v3/projects/e37c273d15ee47209610c2563b977eba => generated 0 bytes in 243 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:21.959279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe045d0-ce96-46fb-9203-fd1508324bdf None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:21.959477 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe045d0-ce96-46fb-9203-fd1508324bdf None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:21.960030 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebe045d0-ce96-46fb-9203-fd1508324bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:21.981377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-950090d6-13bb-4cb9-b10c-c774afbde7ad None None] MFA Rules not processed for user `4e64beec480f4684b46afb1982e829e0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:21.981550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ebe045d0-ce96-46fb-9203-fd1508324bdf None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:21.982543 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-950090d6-13bb-4cb9-b10c-c774afbde7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:21.983097 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ebe045d0-ce96-46fb-9203-fd1508324bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:22.054452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 918/1873] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:21 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:22.062072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7997e-083b-4626-a58a-342c876e1bfa None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.062397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7997e-083b-4626-a58a-342c876e1bfa None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.062683 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eef7997e-083b-4626-a58a-342c876e1bfa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.077785 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 956/1874] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:21 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:22.081708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-eef7997e-083b-4626-a58a-342c876e1bfa None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:22.082339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950090d6-13bb-4cb9-b10c-c774afbde7ad None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.082908 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-eef7997e-083b-4626-a58a-342c876e1bfa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:22.083897 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-950090d6-13bb-4cb9-b10c-c774afbde7ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:22.091083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 919/1875] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:22 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:22.095975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7997e-083b-4626-a58a-342c876e1bfa None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.098299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-950090d6-13bb-4cb9-b10c-c774afbde7ad None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.102906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d68fc-bd3d-4321-922b-ca12d696abad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.103599 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d68fc-bd3d-4321-922b-ca12d696abad admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.103892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d68fc-bd3d-4321-922b-ca12d696abad admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.104176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-500d68fc-bd3d-4321-922b-ca12d696abad admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.105152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d68fc-bd3d-4321-922b-ca12d696abad admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.105578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eef7997e-083b-4626-a58a-342c876e1bfa None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.107074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-500d68fc-bd3d-4321-922b-ca12d696abad admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.111827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c7565-605c-4cf5-8d61-c7be6d5042c0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.112099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c7565-605c-4cf5-8d61-c7be6d5042c0 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.112453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c7565-605c-4cf5-8d61-c7be6d5042c0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.112817 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54c7565-605c-4cf5-8d61-c7be6d5042c0 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.113718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c7565-605c-4cf5-8d61-c7be6d5042c0 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:22.114099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c7565-605c-4cf5-8d61-c7be6d5042c0 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.115923 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54c7565-605c-4cf5-8d61-c7be6d5042c0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.118127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:22.128450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 920/1876] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:22.132962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c7565-605c-4cf5-8d61-c7be6d5042c0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.137108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 957/1877] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:22 2022] POST /identity/v3/projects => generated 383 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:22.137972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d68fc-bd3d-4321-922b-ca12d696abad admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.146564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54c7565-605c-4cf5-8d61-c7be6d5042c0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.152241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:22.202357 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-500d68fc-bd3d-4321-922b-ca12d696abad admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.205832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8f154-26a0-45b9-8812-533a2a85e2e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.206736 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8f154-26a0-45b9-8812-533a2a85e2e9 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.207219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8f154-26a0-45b9-8812-533a2a85e2e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.207603 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdd8f154-26a0-45b9-8812-533a2a85e2e9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.207765 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7198c71-ea5f-47a4-b29a-d666b95acee6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.208434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198c71-ea5f-47a4-b29a-d666b95acee6 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.208632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8f154-26a0-45b9-8812-533a2a85e2e9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.208742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198c71-ea5f-47a4-b29a-d666b95acee6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.209005 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7198c71-ea5f-47a4-b29a-d666b95acee6 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.209810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7198c71-ea5f-47a4-b29a-d666b95acee6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.211730 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7198c71-ea5f-47a4-b29a-d666b95acee6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.211943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdd8f154-26a0-45b9-8812-533a2a85e2e9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.234895 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 958/1878] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:22 2022] POST /identity/v3/users => generated 298 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:22.238908 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7198c71-ea5f-47a4-b29a-d666b95acee6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.242027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 921/1879] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:22 2022] POST /identity/v3/projects => generated 381 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:22.244700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8f154-26a0-45b9-8812-533a2a85e2e9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.249065 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7198c71-ea5f-47a4-b29a-d666b95acee6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.305523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdd8f154-26a0-45b9-8812-533a2a85e2e9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.310086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac8d7f-04e2-4994-b0c9-98241c995867 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.310483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e5eee-f9b4-42b0-88c7-0cd3bc9322d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.310750 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac8d7f-04e2-4994-b0c9-98241c995867 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.311032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac8d7f-04e2-4994-b0c9-98241c995867 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.311153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e5eee-f9b4-42b0-88c7-0cd3bc9322d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.311305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25ac8d7f-04e2-4994-b0c9-98241c995867 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.311436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e5eee-f9b4-42b0-88c7-0cd3bc9322d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.311713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-005e5eee-f9b4-42b0-88c7-0cd3bc9322d2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.311983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac8d7f-04e2-4994-b0c9-98241c995867 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.312461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e5eee-f9b4-42b0-88c7-0cd3bc9322d2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.313977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25ac8d7f-04e2-4994-b0c9-98241c995867 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.314082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-005e5eee-f9b4-42b0-88c7-0cd3bc9322d2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.325018 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 959/1880] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:22.328535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e5eee-f9b4-42b0-88c7-0cd3bc9322d2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.335850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 922/1881] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:22 2022] POST /identity/v3/users => generated 291 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:22.336807 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac8d7f-04e2-4994-b0c9-98241c995867 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.338983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-005e5eee-f9b4-42b0-88c7-0cd3bc9322d2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.345357 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2727a6c-0e9d-4909-9911-2c449ec53b80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.346250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2727a6c-0e9d-4909-9911-2c449ec53b80 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.346531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2727a6c-0e9d-4909-9911-2c449ec53b80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.346815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2727a6c-0e9d-4909-9911-2c449ec53b80 admin admin] PATH_INFO: `/v3/projects/2350023cbafd4852b92f5e720644d32f/users/8be756aab1374861a24e4de05d1e9c9d/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.347285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25ac8d7f-04e2-4994-b0c9-98241c995867 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.352024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99481050-559e-4c72-a91d-f91c454e1be5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.352771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481050-559e-4c72-a91d-f91c454e1be5 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.353084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481050-559e-4c72-a91d-f91c454e1be5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.353365 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99481050-559e-4c72-a91d-f91c454e1be5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.354079 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99481050-559e-4c72-a91d-f91c454e1be5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.355940 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99481050-559e-4c72-a91d-f91c454e1be5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.363182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2727a6c-0e9d-4909-9911-2c449ec53b80 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2350023cbafd4852b92f5e720644d32f, user_id=8be756aab1374861a24e4de05d1e9c9d, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.365868 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2727a6c-0e9d-4909-9911-2c449ec53b80 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.366955 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 923/1882] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:22.370668 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99481050-559e-4c72-a91d-f91c454e1be5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.383569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 960/1883] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:22 2022] PUT /identity/v3/projects/2350023cbafd4852b92f5e720644d32f/users/8be756aab1374861a24e4de05d1e9c9d/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:22.384959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2727a6c-0e9d-4909-9911-2c449ec53b80 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.388433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99481050-559e-4c72-a91d-f91c454e1be5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.451965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:22.465189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2727a6c-0e9d-4909-9911-2c449ec53b80 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.465362 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4e25c-7e3c-44f3-b73d-a69d2077c869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.465879 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4e25c-7e3c-44f3-b73d-a69d2077c869 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.466168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4e25c-7e3c-44f3-b73d-a69d2077c869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.466575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c4e25c-7e3c-44f3-b73d-a69d2077c869 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.467450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4e25c-7e3c-44f3-b73d-a69d2077c869 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.469736 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c4e25c-7e3c-44f3-b73d-a69d2077c869 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.470999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506a9ed-e01c-4eaa-88e0-1fd07aba9e9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.471688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506a9ed-e01c-4eaa-88e0-1fd07aba9e9d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.471970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506a9ed-e01c-4eaa-88e0-1fd07aba9e9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.472713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6506a9ed-e01c-4eaa-88e0-1fd07aba9e9d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.472961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506a9ed-e01c-4eaa-88e0-1fd07aba9e9d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.474593 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6506a9ed-e01c-4eaa-88e0-1fd07aba9e9d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.483513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 924/1884] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 113 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:22.487716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4e25c-7e3c-44f3-b73d-a69d2077c869 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.488607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 961/1885] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:22 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:22.492774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506a9ed-e01c-4eaa-88e0-1fd07aba9e9d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.500681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c4e25c-7e3c-44f3-b73d-a69d2077c869 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.505341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6506a9ed-e01c-4eaa-88e0-1fd07aba9e9d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.505972 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44226518-50a3-4815-8151-5a63d7384093 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.507522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44226518-50a3-4815-8151-5a63d7384093 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.508193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44226518-50a3-4815-8151-5a63d7384093 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.508762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44226518-50a3-4815-8151-5a63d7384093 admin admin] PATH_INFO: `/v3/projects/189ba483fa83401fbedc713797236cbc/users/fe59c4940b164f63938af7d3ab13579c/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.511254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d21acb8-9551-4139-8a11-29074c108dba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.512161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21acb8-9551-4139-8a11-29074c108dba admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.512447 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21acb8-9551-4139-8a11-29074c108dba admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.512730 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d21acb8-9551-4139-8a11-29074c108dba admin admin] PATH_INFO: `/v3/projects/2350023cbafd4852b92f5e720644d32f/users/8be756aab1374861a24e4de05d1e9c9d/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.514755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:22.527557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21acb8-9551-4139-8a11-29074c108dba admin admin] RBAC: Authorizing `identity:create_grant(project_id=2350023cbafd4852b92f5e720644d32f, user_id=8be756aab1374861a24e4de05d1e9c9d, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.530746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d21acb8-9551-4139-8a11-29074c108dba admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.542902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 962/1886] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:22 2022] PUT /identity/v3/projects/2350023cbafd4852b92f5e720644d32f/users/8be756aab1374861a24e4de05d1e9c9d/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:22.546437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44226518-50a3-4815-8151-5a63d7384093 admin admin] RBAC: Authorizing `identity:create_grant(project_id=189ba483fa83401fbedc713797236cbc, user_id=fe59c4940b164f63938af7d3ab13579c, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.554109 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40076a07-e0e1-40b1-a292-8ea67084336e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.554403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40076a07-e0e1-40b1-a292-8ea67084336e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.554689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40076a07-e0e1-40b1-a292-8ea67084336e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.559654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44226518-50a3-4815-8151-5a63d7384093 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.583923 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 925/1887] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:22 2022] PUT /identity/v3/projects/189ba483fa83401fbedc713797236cbc/users/fe59c4940b164f63938af7d3ab13579c/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 97 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:22.596103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91267e0d-3f59-4660-b329-4f1348853da2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.596450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91267e0d-3f59-4660-b329-4f1348853da2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.596738 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91267e0d-3f59-4660-b329-4f1348853da2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.606349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-40076a07-e0e1-40b1-a292-8ea67084336e None None] MFA Rules not processed for user `8be756aab1374861a24e4de05d1e9c9d`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:22.609301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-40076a07-e0e1-40b1-a292-8ea67084336e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:22.659022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-91267e0d-3f59-4660-b329-4f1348853da2 None None] MFA Rules not processed for user `fe59c4940b164f63938af7d3ab13579c`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:22.660266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-91267e0d-3f59-4660-b329-4f1348853da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:22.734091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 963/1888] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:22 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:22.735604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40076a07-e0e1-40b1-a292-8ea67084336e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.737115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-40076a07-e0e1-40b1-a292-8ea67084336e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:22.821486 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 926/1889] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:22 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:22.822294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91267e0d-3f59-4660-b329-4f1348853da2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:22.823792 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-91267e0d-3f59-4660-b329-4f1348853da2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:22.858612 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40076a07-e0e1-40b1-a292-8ea67084336e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.870013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee34ae62-3a7e-4306-8353-be6087fdbc62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.871076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34ae62-3a7e-4306-8353-be6087fdbc62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.871362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34ae62-3a7e-4306-8353-be6087fdbc62 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.871636 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee34ae62-3a7e-4306-8353-be6087fdbc62 admin admin] PATH_INFO: `/v3/users/620a01e1a272447ca7cdb01558eda9ad` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.873566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34ae62-3a7e-4306-8353-be6087fdbc62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=620a01e1a272447ca7cdb01558eda9ad)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.878943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee34ae62-3a7e-4306-8353-be6087fdbc62 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.933217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91267e0d-3f59-4660-b329-4f1348853da2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:22.942950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b0c25-57e1-49be-9315-f9459e33c1ef service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:22.943614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b0c25-57e1-49be-9315-f9459e33c1ef service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:22.943897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b0c25-57e1-49be-9315-f9459e33c1ef service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:22.944167 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-183b0c25-57e1-49be-9315-f9459e33c1ef service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:22.964156 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ee34ae62-3a7e-4306-8353-be6087fdbc62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '620a01e1a272447ca7cdb01558eda9ad'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:22.964902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ee34ae62-3a7e-4306-8353-be6087fdbc62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '620a01e1a272447ca7cdb01558eda9ad'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:22.966743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b0c25-57e1-49be-9315-f9459e33c1ef service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:22.969430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-183b0c25-57e1-49be-9315-f9459e33c1ef service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:22.980823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ee34ae62-3a7e-4306-8353-be6087fdbc62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '620a01e1a272447ca7cdb01558eda9ad'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:22.981583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ee34ae62-3a7e-4306-8353-be6087fdbc62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '620a01e1a272447ca7cdb01558eda9ad'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:22.991559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:INSERT=1,keystone:DELETE=8 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:22.993971 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 927/1890] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:22 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 172 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:22.994974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b0c25-57e1-49be-9315-f9459e33c1ef service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.005701 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ee34ae62-3a7e-4306-8353-be6087fdbc62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '620a01e1a272447ca7cdb01558eda9ad'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:23.023360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-183b0c25-57e1-49be-9315-f9459e33c1ef service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.038134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b70379-a50f-4e86-9437-9de3ccee2645 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.038776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70379-a50f-4e86-9437-9de3ccee2645 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.039234 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70379-a50f-4e86-9437-9de3ccee2645 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.039520 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14b70379-a50f-4e86-9437-9de3ccee2645 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.042735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 964/1891] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:22 2022] DELETE /identity/v3/users/620a01e1a272447ca7cdb01558eda9ad => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:23.042887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b70379-a50f-4e86-9437-9de3ccee2645 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.045107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9b25a-242d-4b60-9f7f-6e72a1da7574 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.045288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9b25a-242d-4b60-9f7f-6e72a1da7574 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.045626 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7e9b25a-242d-4b60-9f7f-6e72a1da7574 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.045855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14b70379-a50f-4e86-9437-9de3ccee2645 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.070870 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c7e9b25a-242d-4b60-9f7f-6e72a1da7574 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:23.072553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c7e9b25a-242d-4b60-9f7f-6e72a1da7574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:23.104707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 928/1892] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:22 2022] POST /identity/v3/projects => generated 379 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:23.109512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b70379-a50f-4e86-9437-9de3ccee2645 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.114123 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-14b70379-a50f-4e86-9437-9de3ccee2645 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:23.184935 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 965/1893] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:23.201515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:23.210184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9b25a-242d-4b60-9f7f-6e72a1da7574 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.212367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c7e9b25a-242d-4b60-9f7f-6e72a1da7574 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:23.231672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14b70379-a50f-4e86-9437-9de3ccee2645 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.246441 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebeac7-b6d5-4fab-a4f3-aed959bd043f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.247166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebeac7-b6d5-4fab-a4f3-aed959bd043f admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.247453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebeac7-b6d5-4fab-a4f3-aed959bd043f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.247734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ebeac7-b6d5-4fab-a4f3-aed959bd043f admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.252208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebeac7-b6d5-4fab-a4f3-aed959bd043f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.254402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ebeac7-b6d5-4fab-a4f3-aed959bd043f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.295417 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 929/1894] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:23 2022] POST /identity/v3/users => generated 296 bytes in 187 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:23.297163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebeac7-b6d5-4fab-a4f3-aed959bd043f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.300075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-44ebeac7-b6d5-4fab-a4f3-aed959bd043f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:23.310188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7e9b25a-242d-4b60-9f7f-6e72a1da7574 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.319075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ebeac7-b6d5-4fab-a4f3-aed959bd043f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.327400 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27c28e68-6436-4488-b110-bf56ec1ca40b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.328644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28e68-6436-4488-b110-bf56ec1ca40b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.329140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28e68-6436-4488-b110-bf56ec1ca40b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.329590 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27c28e68-6436-4488-b110-bf56ec1ca40b admin admin] PATH_INFO: `/v3/users/4e64beec480f4684b46afb1982e829e0` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.331775 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c28e68-6436-4488-b110-bf56ec1ca40b admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e64beec480f4684b46afb1982e829e0)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.334150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27c28e68-6436-4488-b110-bf56ec1ca40b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.371663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089435b-4bd7-4dc6-a6a6-14a7df36e5b8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.372452 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089435b-4bd7-4dc6-a6a6-14a7df36e5b8 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.372833 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089435b-4bd7-4dc6-a6a6-14a7df36e5b8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.373321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c089435b-4bd7-4dc6-a6a6-14a7df36e5b8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.398540 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089435b-4bd7-4dc6-a6a6-14a7df36e5b8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.402810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c089435b-4bd7-4dc6-a6a6-14a7df36e5b8 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.430703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 966/1895] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 221 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:23.431364 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089435b-4bd7-4dc6-a6a6-14a7df36e5b8 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.435878 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-27c28e68-6436-4488-b110-bf56ec1ca40b admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e64beec480f4684b46afb1982e829e0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:23.451934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-27c28e68-6436-4488-b110-bf56ec1ca40b admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e64beec480f4684b46afb1982e829e0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:23.452696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-27c28e68-6436-4488-b110-bf56ec1ca40b admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e64beec480f4684b46afb1982e829e0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:23.454492 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c089435b-4bd7-4dc6-a6a6-14a7df36e5b8 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.460611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385886c-8203-47db-9b8b-897963944dac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.461379 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385886c-8203-47db-9b8b-897963944dac admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.461853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385886c-8203-47db-9b8b-897963944dac admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.462172 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a385886c-8203-47db-9b8b-897963944dac admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.463191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385886c-8203-47db-9b8b-897963944dac admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.466093 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a385886c-8203-47db-9b8b-897963944dac admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.478712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-27c28e68-6436-4488-b110-bf56ec1ca40b admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e64beec480f4684b46afb1982e829e0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:23.481305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 967/1896] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:23.485970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385886c-8203-47db-9b8b-897963944dac admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.499404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a385886c-8203-47db-9b8b-897963944dac admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.503037 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-27c28e68-6436-4488-b110-bf56ec1ca40b admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e64beec480f4684b46afb1982e829e0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:23.506259 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a93e28-b95f-48bc-8e0d-0fad0fa909e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.507221 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a93e28-b95f-48bc-8e0d-0fad0fa909e7 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.507548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a93e28-b95f-48bc-8e0d-0fad0fa909e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.508090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a93e28-b95f-48bc-8e0d-0fad0fa909e7 admin admin] PATH_INFO: `/v3/projects/0982a8c1300a43f7991f00d3d008e959/users/d910b55e13f4477e966f0fc7c69e8d88/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.514264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 930/1897] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:23 2022] DELETE /identity/v3/users/4e64beec480f4684b46afb1982e829e0 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:23.518485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad6900-1378-4aab-a5a9-0108ce7bda51 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.519317 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad6900-1378-4aab-a5a9-0108ce7bda51 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.519317 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fad6900-1378-4aab-a5a9-0108ce7bda51 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.528835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a93e28-b95f-48bc-8e0d-0fad0fa909e7 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0982a8c1300a43f7991f00d3d008e959, user_id=d910b55e13f4477e966f0fc7c69e8d88, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.532253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a93e28-b95f-48bc-8e0d-0fad0fa909e7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.543929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2fad6900-1378-4aab-a5a9-0108ce7bda51 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:23.546121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2fad6900-1378-4aab-a5a9-0108ce7bda51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:23.554452 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 968/1898] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:23 2022] PUT /identity/v3/projects/0982a8c1300a43f7991f00d3d008e959/users/d910b55e13f4477e966f0fc7c69e8d88/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 69 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:23.558797 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a93e28-b95f-48bc-8e0d-0fad0fa909e7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.560558 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d8a93e28-b95f-48bc-8e0d-0fad0fa909e7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:23.568930 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:23.624629 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 931/1899] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:23 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:23.634705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad6900-1378-4aab-a5a9-0108ce7bda51 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.636077 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2fad6900-1378-4aab-a5a9-0108ce7bda51 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:23.641029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a93e28-b95f-48bc-8e0d-0fad0fa909e7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.648263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063c010-cbcf-404d-b93a-ed67df576b2f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.648964 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063c010-cbcf-404d-b93a-ed67df576b2f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.649282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063c010-cbcf-404d-b93a-ed67df576b2f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.649561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f063c010-cbcf-404d-b93a-ed67df576b2f admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.650343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063c010-cbcf-404d-b93a-ed67df576b2f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.651936 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f063c010-cbcf-404d-b93a-ed67df576b2f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.667228 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 969/1900] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:23 2022] GET /identity/v3/roles => generated 1420 bytes in 109 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:23.668135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063c010-cbcf-404d-b93a-ed67df576b2f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.681084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f063c010-cbcf-404d-b93a-ed67df576b2f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.685738 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799dc68f-4007-4219-820a-a9f1c6f76e51 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.686762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dc68f-4007-4219-820a-a9f1c6f76e51 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.687051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dc68f-4007-4219-820a-a9f1c6f76e51 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.688073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799dc68f-4007-4219-820a-a9f1c6f76e51 admin admin] PATH_INFO: `/v3/projects/0982a8c1300a43f7991f00d3d008e959/users/d910b55e13f4477e966f0fc7c69e8d88/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.690080 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799dc68f-4007-4219-820a-a9f1c6f76e51 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0982a8c1300a43f7991f00d3d008e959, user_id=d910b55e13f4477e966f0fc7c69e8d88, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.692862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799dc68f-4007-4219-820a-a9f1c6f76e51 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.704691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 970/1901] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:23 2022] PUT /identity/v3/projects/0982a8c1300a43f7991f00d3d008e959/users/d910b55e13f4477e966f0fc7c69e8d88/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:23.714898 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d22bad-e941-48ad-b1e9-285635ab51de None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.714898 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d22bad-e941-48ad-b1e9-285635ab51de None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.715131 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60d22bad-e941-48ad-b1e9-285635ab51de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.717872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fad6900-1378-4aab-a5a9-0108ce7bda51 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.742291 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=86,keystone:INSERT=4,keystone:DELETE=10 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:23.750901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-60d22bad-e941-48ad-b1e9-285635ab51de None None] MFA Rules not processed for user `d910b55e13f4477e966f0fc7c69e8d88`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:23.752228 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-60d22bad-e941-48ad-b1e9-285635ab51de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:23.813237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678d6dd-44ce-4b27-b0a8-b5bdcbfdf0f3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.813944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678d6dd-44ce-4b27-b0a8-b5bdcbfdf0f3 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.814238 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678d6dd-44ce-4b27-b0a8-b5bdcbfdf0f3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.814528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5678d6dd-44ce-4b27-b0a8-b5bdcbfdf0f3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.852527 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 971/1902] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:23 2022] POST /identity/v3/auth/tokens => generated 3313 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:23.853653 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d22bad-e941-48ad-b1e9-285635ab51de None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.863929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-60d22bad-e941-48ad-b1e9-285635ab51de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:23.894923 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678d6dd-44ce-4b27-b0a8-b5bdcbfdf0f3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.896390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5678d6dd-44ce-4b27-b0a8-b5bdcbfdf0f3 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.910155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 932/1903] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:23 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:22:23.911478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678d6dd-44ce-4b27-b0a8-b5bdcbfdf0f3 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:23.912855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5678d6dd-44ce-4b27-b0a8-b5bdcbfdf0f3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:23.945251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60d22bad-e941-48ad-b1e9-285635ab51de None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.951747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.952863 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.953677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.953677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] PATH_INFO: `/v3/projects/07a71f7dabdd4d3a8cd626d83128b44e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:23.954675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=07a71f7dabdd4d3a8cd626d83128b44e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:23.956948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:23.975028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:23.987057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5678d6dd-44ce-4b27-b0a8-b5bdcbfdf0f3 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:23.993364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf726648-4e6e-4c0c-b84e-15c77370403d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:23.994509 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf726648-4e6e-4c0c-b84e-15c77370403d service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:23.994509 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf726648-4e6e-4c0c-b84e-15c77370403d service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:23.994884 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf726648-4e6e-4c0c-b84e-15c77370403d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:24.015799 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '07a71f7dabdd4d3a8cd626d83128b44e', 'request_id': 'req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.017535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf726648-4e6e-4c0c-b84e-15c77370403d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:24.019080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf726648-4e6e-4c0c-b84e-15c77370403d service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:24.025509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '07a71f7dabdd4d3a8cd626d83128b44e', 'request_id': 'req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.032326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 933/1904] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:23 2022] GET /identity/v3/auth/tokens => generated 3313 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:24.032502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '07a71f7dabdd4d3a8cd626d83128b44e', 'request_id': 'req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.047143 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] The token cache is being invalidate because project 07a71f7dabdd4d3a8cd626d83128b44e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:24.047316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.047908 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.049713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 972/1905] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:23 2022] DELETE /identity/v3/projects/07a71f7dabdd4d3a8cd626d83128b44e => generated 0 bytes in 196 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:24.053806 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf726648-4e6e-4c0c-b84e-15c77370403d service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:24.066366 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf726648-4e6e-4c0c-b84e-15c77370403d service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:24.154781 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13acb11-3164-4d0c-ac97-f4ca26845ef5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:24.155737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13acb11-3164-4d0c-ac97-f4ca26845ef5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:24.156177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13acb11-3164-4d0c-ac97-f4ca26845ef5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:24.156443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13acb11-3164-4d0c-ac97-f4ca26845ef5 admin admin] PATH_INFO: `/v3/users/19a266ad3944413ebf08fd55ec064bcd` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:24.158998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13acb11-3164-4d0c-ac97-f4ca26845ef5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19a266ad3944413ebf08fd55ec064bcd)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:24.161058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13acb11-3164-4d0c-ac97-f4ca26845ef5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:24.167161 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:24.216287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e13acb11-3164-4d0c-ac97-f4ca26845ef5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19a266ad3944413ebf08fd55ec064bcd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.223494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e13acb11-3164-4d0c-ac97-f4ca26845ef5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19a266ad3944413ebf08fd55ec064bcd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.224288 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e13acb11-3164-4d0c-ac97-f4ca26845ef5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19a266ad3944413ebf08fd55ec064bcd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.239730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e13acb11-3164-4d0c-ac97-f4ca26845ef5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19a266ad3944413ebf08fd55ec064bcd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.248165 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e13acb11-3164-4d0c-ac97-f4ca26845ef5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19a266ad3944413ebf08fd55ec064bcd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.257463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 934/1906] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:24 2022] DELETE /identity/v3/users/19a266ad3944413ebf08fd55ec064bcd => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:24.268804 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:24.270384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:24.288443 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24743cdf-fb47-4532-bd8a-0e9af36bb6fb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:24.378279 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:24.379808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:24.380332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:24.380850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] PATH_INFO: `/v3/projects/fad38cdd541a49f89c51df1497de85a4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:24.384864 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] RBAC: Authorizing `identity:delete_project(project_id=fad38cdd541a49f89c51df1497de85a4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:24.388226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:24.459321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fad38cdd541a49f89c51df1497de85a4', 'request_id': 'req-df1a8bde-42ab-4c84-96ad-b04e90a15359'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.469876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fad38cdd541a49f89c51df1497de85a4', 'request_id': 'req-df1a8bde-42ab-4c84-96ad-b04e90a15359'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.487790 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fad38cdd541a49f89c51df1497de85a4', 'request_id': 'req-df1a8bde-42ab-4c84-96ad-b04e90a15359'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.512696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] The token cache is being invalidate because project fad38cdd541a49f89c51df1497de85a4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:24.512829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.513527 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.523100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13acb11-3164-4d0c-ac97-f4ca26845ef5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:24.526099 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 973/1907] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:24 2022] DELETE /identity/v3/projects/fad38cdd541a49f89c51df1497de85a4 => generated 0 bytes in 251 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:24.526401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e13acb11-3164-4d0c-ac97-f4ca26845ef5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:24.539020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13acb11-3164-4d0c-ac97-f4ca26845ef5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:24.587712 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:24.592975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:24.608360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c00a5c5b-f44b-46b6-9253-beef701ea4e7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:24.610076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5c5b-f44b-46b6-9253-beef701ea4e7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:24.610557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5c5b-f44b-46b6-9253-beef701ea4e7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:24.611031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c00a5c5b-f44b-46b6-9253-beef701ea4e7 admin admin] PATH_INFO: `/v3/users/8be756aab1374861a24e4de05d1e9c9d` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:24.612667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a5c5b-f44b-46b6-9253-beef701ea4e7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8be756aab1374861a24e4de05d1e9c9d)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:24.614568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c00a5c5b-f44b-46b6-9253-beef701ea4e7 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:24.648888 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:24.694456 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df1a8bde-42ab-4c84-96ad-b04e90a15359 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:24.700607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2110329-54e8-40e0-8cd5-ef6353469973 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:24.701769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2110329-54e8-40e0-8cd5-ef6353469973 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:24.702140 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2110329-54e8-40e0-8cd5-ef6353469973 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:24.702522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2110329-54e8-40e0-8cd5-ef6353469973 admin admin] PATH_INFO: `/v3/users/fe59c4940b164f63938af7d3ab13579c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:24.704661 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2110329-54e8-40e0-8cd5-ef6353469973 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fe59c4940b164f63938af7d3ab13579c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:24.706831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2110329-54e8-40e0-8cd5-ef6353469973 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:24.713317 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c00a5c5b-f44b-46b6-9253-beef701ea4e7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8be756aab1374861a24e4de05d1e9c9d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.725342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c00a5c5b-f44b-46b6-9253-beef701ea4e7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8be756aab1374861a24e4de05d1e9c9d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.726105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c00a5c5b-f44b-46b6-9253-beef701ea4e7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8be756aab1374861a24e4de05d1e9c9d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.746118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c00a5c5b-f44b-46b6-9253-beef701ea4e7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8be756aab1374861a24e4de05d1e9c9d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.763534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c00a5c5b-f44b-46b6-9253-beef701ea4e7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8be756aab1374861a24e4de05d1e9c9d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.772261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 935/1908] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:24 2022] DELETE /identity/v3/users/8be756aab1374861a24e4de05d1e9c9d => generated 0 bytes in 249 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:24.798491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d2110329-54e8-40e0-8cd5-ef6353469973 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fe59c4940b164f63938af7d3ab13579c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.799459 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d2110329-54e8-40e0-8cd5-ef6353469973 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fe59c4940b164f63938af7d3ab13579c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.809297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d2110329-54e8-40e0-8cd5-ef6353469973 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fe59c4940b164f63938af7d3ab13579c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.810278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d2110329-54e8-40e0-8cd5-ef6353469973 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fe59c4940b164f63938af7d3ab13579c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.830026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d2110329-54e8-40e0-8cd5-ef6353469973 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fe59c4940b164f63938af7d3ab13579c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:24.853377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 974/1909] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:24 2022] DELETE /identity/v3/users/fe59c4940b164f63938af7d3ab13579c => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:24.856465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7ee1f-bf6f-4370-8798-4999244fffd6 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:24.856761 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7ee1f-bf6f-4370-8798-4999244fffd6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:24.857111 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77c7ee1f-bf6f-4370-8798-4999244fffd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:24.867090 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=78,keystone:DELETE=20,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:24.887951 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2110329-54e8-40e0-8cd5-ef6353469973 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:24.888307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-77c7ee1f-bf6f-4370-8798-4999244fffd6 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:24.889820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d2110329-54e8-40e0-8cd5-ef6353469973 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:24.891756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-77c7ee1f-bf6f-4370-8798-4999244fffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:25.007048 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2110329-54e8-40e0-8cd5-ef6353469973 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:25.013421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:25.018521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:25.018814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:25.019108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] PATH_INFO: `/v3/projects/56dc57a381f64071b8e1d3a0e6fdb313` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:25.021056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] RBAC: Authorizing `identity:delete_project(project_id=56dc57a381f64071b8e1d3a0e6fdb313)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:25.023592 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:25.039808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 936/1910] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:25.058264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7ee1f-bf6f-4370-8798-4999244fffd6 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:25.060023 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-77c7ee1f-bf6f-4370-8798-4999244fffd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:25.099216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '56dc57a381f64071b8e1d3a0e6fdb313', 'request_id': 'req-d9f4293d-924e-4971-9c71-b88def36acda'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.103569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=83,keystone:DELETE=15,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:25.109032 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '56dc57a381f64071b8e1d3a0e6fdb313', 'request_id': 'req-d9f4293d-924e-4971-9c71-b88def36acda'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.119237 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '56dc57a381f64071b8e1d3a0e6fdb313', 'request_id': 'req-d9f4293d-924e-4971-9c71-b88def36acda'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.136781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] The token cache is being invalidate because project 56dc57a381f64071b8e1d3a0e6fdb313 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:25.137186 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.137858 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.143386 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 975/1911] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:24 2022] DELETE /identity/v3/projects/56dc57a381f64071b8e1d3a0e6fdb313 => generated 0 bytes in 253 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:25.144508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:25.145543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77c7ee1f-bf6f-4370-8798-4999244fffd6 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:25.146035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:25.208065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568614d4-d926-49b6-85b4-1ed371d4c7db service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:25.208905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568614d4-d926-49b6-85b4-1ed371d4c7db service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:25.209319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568614d4-d926-49b6-85b4-1ed371d4c7db service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:25.210261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-568614d4-d926-49b6-85b4-1ed371d4c7db service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:25.213238 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-568614d4-d926-49b6-85b4-1ed371d4c7db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:25.220289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9f4293d-924e-4971-9c71-b88def36acda admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:25.225651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2890a864-be6d-44ca-9ad4-f738def55cc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:25.226534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890a864-be6d-44ca-9ad4-f738def55cc3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:25.226821 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890a864-be6d-44ca-9ad4-f738def55cc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:25.227098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2890a864-be6d-44ca-9ad4-f738def55cc3 admin admin] PATH_INFO: `/v3/users/d05061829546445c86c7bcf0b83e29c2` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:25.228777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890a864-be6d-44ca-9ad4-f738def55cc3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d05061829546445c86c7bcf0b83e29c2)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:25.229722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568614d4-d926-49b6-85b4-1ed371d4c7db service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:25.231010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2890a864-be6d-44ca-9ad4-f738def55cc3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:25.232207 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-568614d4-d926-49b6-85b4-1ed371d4c7db service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:25.243616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 937/1912] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 186 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:22:25.297580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2890a864-be6d-44ca-9ad4-f738def55cc3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd05061829546445c86c7bcf0b83e29c2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.298455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2890a864-be6d-44ca-9ad4-f738def55cc3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd05061829546445c86c7bcf0b83e29c2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.301290 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568614d4-d926-49b6-85b4-1ed371d4c7db service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:25.303076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-568614d4-d926-49b6-85b4-1ed371d4c7db service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:25.309136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2890a864-be6d-44ca-9ad4-f738def55cc3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd05061829546445c86c7bcf0b83e29c2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.309930 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2890a864-be6d-44ca-9ad4-f738def55cc3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd05061829546445c86c7bcf0b83e29c2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.317562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-568614d4-d926-49b6-85b4-1ed371d4c7db service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:25.323098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36bb2352-3a94-4f4b-b87a-906704e0d144 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:25.324013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb2352-3a94-4f4b-b87a-906704e0d144 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:25.324303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb2352-3a94-4f4b-b87a-906704e0d144 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:25.324898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36bb2352-3a94-4f4b-b87a-906704e0d144 admin admin] PATH_INFO: `/v3/projects/2350023cbafd4852b92f5e720644d32f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:25.326842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb2352-3a94-4f4b-b87a-906704e0d144 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2350023cbafd4852b92f5e720644d32f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:25.329579 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36bb2352-3a94-4f4b-b87a-906704e0d144 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:25.331030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2890a864-be6d-44ca-9ad4-f738def55cc3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd05061829546445c86c7bcf0b83e29c2'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.354763 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 976/1913] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:25 2022] DELETE /identity/v3/users/d05061829546445c86c7bcf0b83e29c2 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:25.388876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-36bb2352-3a94-4f4b-b87a-906704e0d144 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2350023cbafd4852b92f5e720644d32f', 'request_id': 'req-36bb2352-3a94-4f4b-b87a-906704e0d144'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.398691 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-36bb2352-3a94-4f4b-b87a-906704e0d144 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2350023cbafd4852b92f5e720644d32f', 'request_id': 'req-36bb2352-3a94-4f4b-b87a-906704e0d144'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.403988 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:25.407596 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-36bb2352-3a94-4f4b-b87a-906704e0d144 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2350023cbafd4852b92f5e720644d32f', 'request_id': 'req-36bb2352-3a94-4f4b-b87a-906704e0d144'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.425613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-36bb2352-3a94-4f4b-b87a-906704e0d144 admin admin] The token cache is being invalidate because project 2350023cbafd4852b92f5e720644d32f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:25.425613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-36bb2352-3a94-4f4b-b87a-906704e0d144 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.425613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-36bb2352-3a94-4f4b-b87a-906704e0d144 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.425945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 938/1914] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:25 2022] DELETE /identity/v3/projects/2350023cbafd4852b92f5e720644d32f => generated 0 bytes in 125 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:25.430790 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0d423-0b20-4321-a5e3-0bda21c38426 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:25.431089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0d423-0b20-4321-a5e3-0bda21c38426 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:25.431374 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1f0d423-0b20-4321-a5e3-0bda21c38426 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:25.455385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d1f0d423-0b20-4321-a5e3-0bda21c38426 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:25.456333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d1f0d423-0b20-4321-a5e3-0bda21c38426 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:25.525265 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 977/1915] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 95 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:25.528373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59d424-1d7d-4d60-b86e-c006d2c8afc1 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:25.528707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59d424-1d7d-4d60-b86e-c006d2c8afc1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:25.529007 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc59d424-1d7d-4d60-b86e-c006d2c8afc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:25.547475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-fc59d424-1d7d-4d60-b86e-c006d2c8afc1 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:25.548675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fc59d424-1d7d-4d60-b86e-c006d2c8afc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:25.556835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 939/1916] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:25.561266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0d423-0b20-4321-a5e3-0bda21c38426 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:25.566718 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:25.576671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1f0d423-0b20-4321-a5e3-0bda21c38426 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:25.582656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f216c-d5f9-4ff6-af56-5629ae66bec6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:25.584009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f216c-d5f9-4ff6-af56-5629ae66bec6 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:25.584480 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f216c-d5f9-4ff6-af56-5629ae66bec6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:25.585454 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c32f216c-d5f9-4ff6-af56-5629ae66bec6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:25.586406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f216c-d5f9-4ff6-af56-5629ae66bec6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:25.586899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f216c-d5f9-4ff6-af56-5629ae66bec6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:25.589189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c32f216c-d5f9-4ff6-af56-5629ae66bec6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:25.625927 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 978/1917] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:22:25.627134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59d424-1d7d-4d60-b86e-c006d2c8afc1 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:25.637606 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc59d424-1d7d-4d60-b86e-c006d2c8afc1 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:25.651874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f216c-d5f9-4ff6-af56-5629ae66bec6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:25.653741 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c32f216c-d5f9-4ff6-af56-5629ae66bec6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:25.656147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffacfc8-488a-4c8e-840c-bc1e35691f5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:25.656839 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacfc8-488a-4c8e-840c-bc1e35691f5d admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:25.657152 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacfc8-488a-4c8e-840c-bc1e35691f5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:25.657432 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bffacfc8-488a-4c8e-840c-bc1e35691f5d admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:25.658556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffacfc8-488a-4c8e-840c-bc1e35691f5d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:25.660664 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bffacfc8-488a-4c8e-840c-bc1e35691f5d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:25.689354 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c32f216c-d5f9-4ff6-af56-5629ae66bec6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:25.696119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:25.697088 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:25.697719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:25.698118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] PATH_INFO: `/v3/projects/189ba483fa83401fbedc713797236cbc` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:25.699548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] RBAC: Authorizing `identity:delete_project(project_id=189ba483fa83401fbedc713797236cbc)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:25.702555 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:25.718496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 940/1918] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:25 2022] POST /identity/v3/projects => generated 367 bytes in 89 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:25.719891 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffacfc8-488a-4c8e-840c-bc1e35691f5d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:25.791319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '189ba483fa83401fbedc713797236cbc', 'request_id': 'req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.803405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '189ba483fa83401fbedc713797236cbc', 'request_id': 'req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.812568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '189ba483fa83401fbedc713797236cbc', 'request_id': 'req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.827502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] The token cache is being invalidate because project 189ba483fa83401fbedc713797236cbc was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:25.827878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.829107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:25.832568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 979/1919] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:25 2022] DELETE /identity/v3/projects/189ba483fa83401fbedc713797236cbc => generated 0 bytes in 181 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:25.836572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:25.838923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:25.855266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bffacfc8-488a-4c8e-840c-bc1e35691f5d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:25.926819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3eb6e97-e79a-40a2-a378-b2afd5ee4b03 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:25.933672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bc230-05df-44d5-8722-a58fe896dde9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:25.934707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bc230-05df-44d5-8722-a58fe896dde9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:25.935065 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bc230-05df-44d5-8722-a58fe896dde9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:25.935415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5bc230-05df-44d5-8722-a58fe896dde9 admin admin] PATH_INFO: `/v3/users/d910b55e13f4477e966f0fc7c69e8d88` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:25.936705 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bc230-05df-44d5-8722-a58fe896dde9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d910b55e13f4477e966f0fc7c69e8d88)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:25.939134 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5bc230-05df-44d5-8722-a58fe896dde9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:25.964423 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4b31-ef67-4cf3-ae10-1ea018aa8068 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:25.965391 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4b31-ef67-4cf3-ae10-1ea018aa8068 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:25.965734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4b31-ef67-4cf3-ae10-1ea018aa8068 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:25.966099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab8a4b31-ef67-4cf3-ae10-1ea018aa8068 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:25.973065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a4b31-ef67-4cf3-ae10-1ea018aa8068 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:25.976653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab8a4b31-ef67-4cf3-ae10-1ea018aa8068 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.006890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 941/1920] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:25 2022] POST /identity/v3/users => generated 284 bytes in 287 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:26.007735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4b31-ef67-4cf3-ae10-1ea018aa8068 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.009418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ab8a4b31-ef67-4cf3-ae10-1ea018aa8068 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:26.012158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eb5bc230-05df-44d5-8722-a58fe896dde9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd910b55e13f4477e966f0fc7c69e8d88'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.013226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eb5bc230-05df-44d5-8722-a58fe896dde9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd910b55e13f4477e966f0fc7c69e8d88'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.023691 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab8a4b31-ef67-4cf3-ae10-1ea018aa8068 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.025933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eb5bc230-05df-44d5-8722-a58fe896dde9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd910b55e13f4477e966f0fc7c69e8d88'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.026768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eb5bc230-05df-44d5-8722-a58fe896dde9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd910b55e13f4477e966f0fc7c69e8d88'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.029138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91344580-0af2-42e2-8162-9b50dac5f01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.030065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91344580-0af2-42e2-8162-9b50dac5f01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.030250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91344580-0af2-42e2-8162-9b50dac5f01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.030613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91344580-0af2-42e2-8162-9b50dac5f01f admin admin] PATH_INFO: `/v3/projects/06ad8a003629428388dbb55f81e2dc9d` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.032250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91344580-0af2-42e2-8162-9b50dac5f01f admin admin] RBAC: Authorizing `identity:delete_project(project_id=06ad8a003629428388dbb55f81e2dc9d)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.034232 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91344580-0af2-42e2-8162-9b50dac5f01f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.040913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-eb5bc230-05df-44d5-8722-a58fe896dde9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd910b55e13f4477e966f0fc7c69e8d88'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.042890 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=83,keystone:DELETE=16,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:26.064556 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 980/1921] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:25 2022] DELETE /identity/v3/users/d910b55e13f4477e966f0fc7c69e8d88 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:26.066001 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bc230-05df-44d5-8722-a58fe896dde9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.069638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-eb5bc230-05df-44d5-8722-a58fe896dde9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:26.106551 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-91344580-0af2-42e2-8162-9b50dac5f01f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '06ad8a003629428388dbb55f81e2dc9d', 'request_id': 'req-91344580-0af2-42e2-8162-9b50dac5f01f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.112203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:DELETE=5,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:26.124268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-91344580-0af2-42e2-8162-9b50dac5f01f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '06ad8a003629428388dbb55f81e2dc9d', 'request_id': 'req-91344580-0af2-42e2-8162-9b50dac5f01f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.137967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-91344580-0af2-42e2-8162-9b50dac5f01f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '06ad8a003629428388dbb55f81e2dc9d', 'request_id': 'req-91344580-0af2-42e2-8162-9b50dac5f01f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.161257 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-91344580-0af2-42e2-8162-9b50dac5f01f admin admin] The token cache is being invalidate because project 06ad8a003629428388dbb55f81e2dc9d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:26.161550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-91344580-0af2-42e2-8162-9b50dac5f01f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.162400 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-91344580-0af2-42e2-8162-9b50dac5f01f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.164191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 942/1922] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:26 2022] DELETE /identity/v3/projects/06ad8a003629428388dbb55f81e2dc9d => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:26.170194 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc30750-f1ea-4f4d-9300-49d7d9c27dc9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.170560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc30750-f1ea-4f4d-9300-49d7d9c27dc9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.170914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cc30750-f1ea-4f4d-9300-49d7d9c27dc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.171349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5bc230-05df-44d5-8722-a58fe896dde9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.198032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9cc30750-f1ea-4f4d-9300-49d7d9c27dc9 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:26.199397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9cc30750-f1ea-4f4d-9300-49d7d9c27dc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:26.234411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6421ab-998a-48bb-b720-f9934bcd4ae9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.235095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6421ab-998a-48bb-b720-f9934bcd4ae9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.235378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6421ab-998a-48bb-b720-f9934bcd4ae9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.235657 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6421ab-998a-48bb-b720-f9934bcd4ae9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.236414 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6421ab-998a-48bb-b720-f9934bcd4ae9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.238010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e6421ab-998a-48bb-b720-f9934bcd4ae9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.253158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 981/1923] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:26.254958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6421ab-998a-48bb-b720-f9934bcd4ae9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.257068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2e6421ab-998a-48bb-b720-f9934bcd4ae9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:26.270842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6421ab-998a-48bb-b720-f9934bcd4ae9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.275893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcafa0-b21a-4094-a466-23144d987b38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.276978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcafa0-b21a-4094-a466-23144d987b38 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.277499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcafa0-b21a-4094-a466-23144d987b38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.277980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62fcafa0-b21a-4094-a466-23144d987b38 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.278903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fcafa0-b21a-4094-a466-23144d987b38 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.282188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62fcafa0-b21a-4094-a466-23144d987b38 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.285204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 943/1924] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:26.286852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09614-cee7-4802-b8e1-187e097ed76c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.288177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09614-cee7-4802-b8e1-187e097ed76c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.288454 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05e09614-cee7-4802-b8e1-187e097ed76c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.301645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 982/1925] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:26.305666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcafa0-b21a-4094-a466-23144d987b38 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.316476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62fcafa0-b21a-4094-a466-23144d987b38 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.321549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10b3d0e5-b1f4-449e-819f-76cea8d931f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.322443 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d0e5-b1f4-449e-819f-76cea8d931f0 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.322730 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d0e5-b1f4-449e-819f-76cea8d931f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.323011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10b3d0e5-b1f4-449e-819f-76cea8d931f0 admin admin] PATH_INFO: `/v3/projects/2639c089c5e64114a1b04de7087544bf/users/c1195d795eba41d2a938745498e7ea80/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.332918 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-05e09614-cee7-4802-b8e1-187e097ed76c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:26.334181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-05e09614-cee7-4802-b8e1-187e097ed76c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:26.341206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3d0e5-b1f4-449e-819f-76cea8d931f0 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2639c089c5e64114a1b04de7087544bf, user_id=c1195d795eba41d2a938745498e7ea80, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.345029 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 944/1926] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:26.345163 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10b3d0e5-b1f4-449e-819f-76cea8d931f0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.348810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e09614-cee7-4802-b8e1-187e097ed76c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.358961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05e09614-cee7-4802-b8e1-187e097ed76c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.367446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 983/1927] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:26 2022] PUT /identity/v3/projects/2639c089c5e64114a1b04de7087544bf/users/c1195d795eba41d2a938745498e7ea80/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:26.379826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6e9fc-2822-4743-b6ba-c9c1906cc88b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.380298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6e9fc-2822-4743-b6ba-c9c1906cc88b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.380677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fed6e9fc-2822-4743-b6ba-c9c1906cc88b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.427222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fed6e9fc-2822-4743-b6ba-c9c1906cc88b None None] MFA Rules not processed for user `c1195d795eba41d2a938745498e7ea80`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:26.428797 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fed6e9fc-2822-4743-b6ba-c9c1906cc88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:26.434623 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bc1b3-785d-4406-a5b8-19511af5999b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.435332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bc1b3-785d-4406-a5b8-19511af5999b admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.435620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bc1b3-785d-4406-a5b8-19511af5999b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.435899 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d43bc1b3-785d-4406-a5b8-19511af5999b admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.436630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bc1b3-785d-4406-a5b8-19511af5999b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:26.436965 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bc1b3-785d-4406-a5b8-19511af5999b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.438644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d43bc1b3-785d-4406-a5b8-19511af5999b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.453214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 945/1928] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:26.458820 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bc1b3-785d-4406-a5b8-19511af5999b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.473734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d43bc1b3-785d-4406-a5b8-19511af5999b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.492016 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=2,keystone:DELETE=1,keystone:SELECT=97 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:26.495499 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519c42f-6626-472d-8af2-65d8f1183977 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.496421 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519c42f-6626-472d-8af2-65d8f1183977 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.496871 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519c42f-6626-472d-8af2-65d8f1183977 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.497446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6519c42f-6626-472d-8af2-65d8f1183977 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.498326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519c42f-6626-472d-8af2-65d8f1183977 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.501047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6519c42f-6626-472d-8af2-65d8f1183977 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.526697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 984/1929] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:26 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:26.529963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6e9fc-2822-4743-b6ba-c9c1906cc88b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.531443 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fed6e9fc-2822-4743-b6ba-c9c1906cc88b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:26.540723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 946/1930] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:26 2022] POST /identity/v3/projects => generated 381 bytes in 82 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:26.541591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519c42f-6626-472d-8af2-65d8f1183977 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.546364 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fed6e9fc-2822-4743-b6ba-c9c1906cc88b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.591882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:INSERT=2,keystone:DELETE=3,keystone:SELECT=95 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:26.612080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6519c42f-6626-472d-8af2-65d8f1183977 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.616962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bd00b-48c0-432b-88f5-8d6d2ac6b524 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.617656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bd00b-48c0-432b-88f5-8d6d2ac6b524 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.617943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bd00b-48c0-432b-88f5-8d6d2ac6b524 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.618222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-832bd00b-48c0-432b-88f5-8d6d2ac6b524 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.618946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bd00b-48c0-432b-88f5-8d6d2ac6b524 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.620653 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.620863 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-832bd00b-48c0-432b-88f5-8d6d2ac6b524 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.622170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.622457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.623297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] PATH_INFO: `/v3/projects/0982a8c1300a43f7991f00d3d008e959` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.625459 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0982a8c1300a43f7991f00d3d008e959)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.628092 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.651706 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 947/1931] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:26 2022] POST /identity/v3/projects => generated 367 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:26.651706 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bd00b-48c0-432b-88f5-8d6d2ac6b524 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.695635 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0982a8c1300a43f7991f00d3d008e959', 'request_id': 'req-30fed614-d615-4bfc-9b10-69aa9304ca05'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.707581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0982a8c1300a43f7991f00d3d008e959', 'request_id': 'req-30fed614-d615-4bfc-9b10-69aa9304ca05'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.718684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0982a8c1300a43f7991f00d3d008e959', 'request_id': 'req-30fed614-d615-4bfc-9b10-69aa9304ca05'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.735211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] The token cache is being invalidate because project 0982a8c1300a43f7991f00d3d008e959 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:26.735521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.736207 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:26.738453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 985/1932] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:26 2022] DELETE /identity/v3/projects/0982a8c1300a43f7991f00d3d008e959 => generated 0 bytes in 209 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:26.739103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.739861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-832bd00b-48c0-432b-88f5-8d6d2ac6b524 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.740424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:26.808851 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05813a2e-7375-4831-8ff7-e562d4aef82a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.809718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05813a2e-7375-4831-8ff7-e562d4aef82a admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.810009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05813a2e-7375-4831-8ff7-e562d4aef82a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.810287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05813a2e-7375-4831-8ff7-e562d4aef82a admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.810379 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30fed614-d615-4bfc-9b10-69aa9304ca05 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.810981 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05813a2e-7375-4831-8ff7-e562d4aef82a admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.813458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05813a2e-7375-4831-8ff7-e562d4aef82a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.815815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b68fa-ad80-482b-9264-e3f519aa16a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.816491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b68fa-ad80-482b-9264-e3f519aa16a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.816781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b68fa-ad80-482b-9264-e3f519aa16a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.817093 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b68fa-ad80-482b-9264-e3f519aa16a1 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.817813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b68fa-ad80-482b-9264-e3f519aa16a1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.819772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c1b68fa-ad80-482b-9264-e3f519aa16a1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.841575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 948/1933] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:26 2022] POST /identity/v3/users => generated 291 bytes in 189 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:26.841575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bee6c0-638e-42cb-bab1-0f345e9c4509 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.841575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bee6c0-638e-42cb-bab1-0f345e9c4509 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.841575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07bee6c0-638e-42cb-bab1-0f345e9c4509 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.842065 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 986/1934] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:26 2022] POST /identity/v3/users => generated 290 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:26.842756 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b68fa-ad80-482b-9264-e3f519aa16a1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.844526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3c1b68fa-ad80-482b-9264-e3f519aa16a1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:26.857104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b68fa-ad80-482b-9264-e3f519aa16a1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.862506 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e63d9-dcae-48a7-90c6-868a2daf4db1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.863220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e63d9-dcae-48a7-90c6-868a2daf4db1 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.863498 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e63d9-dcae-48a7-90c6-868a2daf4db1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.864017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b6e63d9-dcae-48a7-90c6-868a2daf4db1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.864643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e63d9-dcae-48a7-90c6-868a2daf4db1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.866282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b6e63d9-dcae-48a7-90c6-868a2daf4db1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.868569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:26.869421 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-07bee6c0-638e-42cb-bab1-0f345e9c4509 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:26.871253 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-07bee6c0-638e-42cb-bab1-0f345e9c4509 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:26.878518 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 987/1935] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:26.879724 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e63d9-dcae-48a7-90c6-868a2daf4db1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.894737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 949/1936] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:26.894737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bee6c0-638e-42cb-bab1-0f345e9c4509 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.895112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b6e63d9-dcae-48a7-90c6-868a2daf4db1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.899476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82503461-b83c-4f03-8ff4-9f42e705fe9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.900903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82503461-b83c-4f03-8ff4-9f42e705fe9a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.902093 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82503461-b83c-4f03-8ff4-9f42e705fe9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.902390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82503461-b83c-4f03-8ff4-9f42e705fe9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.903111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82503461-b83c-4f03-8ff4-9f42e705fe9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.904199 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07bee6c0-638e-42cb-bab1-0f345e9c4509 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.904700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82503461-b83c-4f03-8ff4-9f42e705fe9a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.909257 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e547723-58f9-4812-b111-467d84302e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.909921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e547723-58f9-4812-b111-467d84302e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.910708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e547723-58f9-4812-b111-467d84302e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.910957 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e547723-58f9-4812-b111-467d84302e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.911686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e547723-58f9-4812-b111-467d84302e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.913442 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e547723-58f9-4812-b111-467d84302e81 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.919842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 988/1937] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:26.919842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14546eb-c467-4c2e-a4c8-18d270f3f2da None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.919842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14546eb-c467-4c2e-a4c8-18d270f3f2da None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.919842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14546eb-c467-4c2e-a4c8-18d270f3f2da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.929791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 950/1938] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:26 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:26.931401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e547723-58f9-4812-b111-467d84302e81 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.940450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a14546eb-c467-4c2e-a4c8-18d270f3f2da None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:26.941709 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a14546eb-c467-4c2e-a4c8-18d270f3f2da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:26.943529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e547723-58f9-4812-b111-467d84302e81 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.948661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02666a05-c4b0-4e4e-a0f2-a7ab3975561f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.949746 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02666a05-c4b0-4e4e-a0f2-a7ab3975561f admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.950100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02666a05-c4b0-4e4e-a0f2-a7ab3975561f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.950397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02666a05-c4b0-4e4e-a0f2-a7ab3975561f admin admin] PATH_INFO: `/v3/projects/8aa29effcb50415587aafba0ba2b8328/users/966cf65223a949529fbb81d37d22b3d6/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.953547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 989/1939] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:26.954387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14546eb-c467-4c2e-a4c8-18d270f3f2da None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.966638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14546eb-c467-4c2e-a4c8-18d270f3f2da None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:26.968141 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02666a05-c4b0-4e4e-a0f2-a7ab3975561f admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa29effcb50415587aafba0ba2b8328, user_id=966cf65223a949529fbb81d37d22b3d6, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.970936 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02666a05-c4b0-4e4e-a0f2-a7ab3975561f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:26.971867 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83363d2c-9f92-4150-9ed8-493761398862 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:26.972808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83363d2c-9f92-4150-9ed8-493761398862 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:26.973128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83363d2c-9f92-4150-9ed8-493761398862 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:26.973403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83363d2c-9f92-4150-9ed8-493761398862 admin admin] PATH_INFO: `/v3/projects/bd2f6df329e0443884604ce248c24796/users/d3c1a27dc08f457fbc786c28668ad1a5/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:26.986116 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 951/1940] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:26 2022] PUT /identity/v3/projects/8aa29effcb50415587aafba0ba2b8328/users/966cf65223a949529fbb81d37d22b3d6/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:26.987103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02666a05-c4b0-4e4e-a0f2-a7ab3975561f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:26.995234 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83363d2c-9f92-4150-9ed8-493761398862 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bd2f6df329e0443884604ce248c24796, user_id=d3c1a27dc08f457fbc786c28668ad1a5, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:26.998104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83363d2c-9f92-4150-9ed8-493761398862 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.015762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 990/1941] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:26 2022] PUT /identity/v3/projects/bd2f6df329e0443884604ce248c24796/users/d3c1a27dc08f457fbc786c28668ad1a5/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:27.025167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83363d2c-9f92-4150-9ed8-493761398862 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.027983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:27.068273 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02666a05-c4b0-4e4e-a0f2-a7ab3975561f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.080281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83363d2c-9f92-4150-9ed8-493761398862 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.085254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0eee5ca-5ed4-4fab-8aaa-a5c988b1c32f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.085623 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eee5ca-5ed4-4fab-8aaa-a5c988b1c32f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.085910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eee5ca-5ed4-4fab-8aaa-a5c988b1c32f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.086195 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0eee5ca-5ed4-4fab-8aaa-a5c988b1c32f admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.086916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eee5ca-5ed4-4fab-8aaa-a5c988b1c32f admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.088520 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0eee5ca-5ed4-4fab-8aaa-a5c988b1c32f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.102285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 991/1942] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:27.103811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ae3a4-7a25-4d4e-a623-e447aa809c3a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.104109 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ae3a4-7a25-4d4e-a623-e447aa809c3a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.104645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-712ae3a4-7a25-4d4e-a623-e447aa809c3a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.131712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca602a-b225-441b-8ad5-1bbbefb62dc2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.132472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca602a-b225-441b-8ad5-1bbbefb62dc2 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.132677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca602a-b225-441b-8ad5-1bbbefb62dc2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.132922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6ca602a-b225-441b-8ad5-1bbbefb62dc2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.133664 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca602a-b225-441b-8ad5-1bbbefb62dc2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:27.133835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-712ae3a4-7a25-4d4e-a623-e447aa809c3a None None] MFA Rules not processed for user `d3c1a27dc08f457fbc786c28668ad1a5`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:27.134011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca602a-b225-441b-8ad5-1bbbefb62dc2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.135038 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-712ae3a4-7a25-4d4e-a623-e447aa809c3a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:27.135674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6ca602a-b225-441b-8ad5-1bbbefb62dc2 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.150119 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 952/1943] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 163 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:27.151097 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca602a-b225-441b-8ad5-1bbbefb62dc2 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.163137 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6ca602a-b225-441b-8ad5-1bbbefb62dc2 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.167836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d3cfa-7573-41a3-81a6-ef5e8eccbf70 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.168720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d3cfa-7573-41a3-81a6-ef5e8eccbf70 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.169019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d3cfa-7573-41a3-81a6-ef5e8eccbf70 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.169305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-597d3cfa-7573-41a3-81a6-ef5e8eccbf70 admin admin] PATH_INFO: `/v3/projects/8aa29effcb50415587aafba0ba2b8328/users/966cf65223a949529fbb81d37d22b3d6/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.171303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d3cfa-7573-41a3-81a6-ef5e8eccbf70 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8aa29effcb50415587aafba0ba2b8328, user_id=966cf65223a949529fbb81d37d22b3d6, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.174661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-597d3cfa-7573-41a3-81a6-ef5e8eccbf70 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.186245 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 953/1944] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:27 2022] PUT /identity/v3/projects/8aa29effcb50415587aafba0ba2b8328/users/966cf65223a949529fbb81d37d22b3d6/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:27.187604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d3cfa-7573-41a3-81a6-ef5e8eccbf70 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.226749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 992/1945] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:27 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:27.228886 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d7a45-b137-4fe5-a73c-17dee2e416cc None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.229466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d7a45-b137-4fe5-a73c-17dee2e416cc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.229739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32d7a45-b137-4fe5-a73c-17dee2e416cc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.255558 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-597d3cfa-7573-41a3-81a6-ef5e8eccbf70 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.260621 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4870750-10df-4748-b0fc-73a72cab25a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.260762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e32d7a45-b137-4fe5-a73c-17dee2e416cc None None] MFA Rules not processed for user `966cf65223a949529fbb81d37d22b3d6`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:27.261437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4870750-10df-4748-b0fc-73a72cab25a9 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.261790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4870750-10df-4748-b0fc-73a72cab25a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.261919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e32d7a45-b137-4fe5-a73c-17dee2e416cc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:27.262151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4870750-10df-4748-b0fc-73a72cab25a9 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.262914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4870750-10df-4748-b0fc-73a72cab25a9 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.264952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4870750-10df-4748-b0fc-73a72cab25a9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.294977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 954/1946] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:27 2022] POST /identity/v3/projects => generated 383 bytes in 108 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:27.295783 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4870750-10df-4748-b0fc-73a72cab25a9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.296406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:27.358737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 993/1947] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:27 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:27.364205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d7a45-b137-4fe5-a73c-17dee2e416cc None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.375347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32d7a45-b137-4fe5-a73c-17dee2e416cc None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.377896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:27.420462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4870750-10df-4748-b0fc-73a72cab25a9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.426942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a27ef-56d7-4d9d-9d6d-0abad30db774 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.427880 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a27ef-56d7-4d9d-9d6d-0abad30db774 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.428222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a27ef-56d7-4d9d-9d6d-0abad30db774 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.428502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-201a27ef-56d7-4d9d-9d6d-0abad30db774 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.429814 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a27ef-56d7-4d9d-9d6d-0abad30db774 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.432014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-201a27ef-56d7-4d9d-9d6d-0abad30db774 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.473752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 955/1948] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:27 2022] POST /identity/v3/projects => generated 381 bytes in 178 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:27.474669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a27ef-56d7-4d9d-9d6d-0abad30db774 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.478745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-201a27ef-56d7-4d9d-9d6d-0abad30db774 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:27.519294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a6d4e-26a2-4f7c-9352-510519e92869 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.520823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a6d4e-26a2-4f7c-9352-510519e92869 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.521355 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a6d4e-26a2-4f7c-9352-510519e92869 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.521854 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f0a6d4e-26a2-4f7c-9352-510519e92869 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.523162 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a6d4e-26a2-4f7c-9352-510519e92869 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.526939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f0a6d4e-26a2-4f7c-9352-510519e92869 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.547512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-201a27ef-56d7-4d9d-9d6d-0abad30db774 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.553074 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab003642-a919-40d4-a082-97fb0f31baac service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.554259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab003642-a919-40d4-a082-97fb0f31baac service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.554378 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab003642-a919-40d4-a082-97fb0f31baac service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.554598 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab003642-a919-40d4-a082-97fb0f31baac service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.566258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 994/1949] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:27 2022] POST /identity/v3/users => generated 292 bytes in 207 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:27.567661 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a6d4e-26a2-4f7c-9352-510519e92869 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.584107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f0a6d4e-26a2-4f7c-9352-510519e92869 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.630106 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab003642-a919-40d4-a082-97fb0f31baac service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.631447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab003642-a919-40d4-a082-97fb0f31baac service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.644276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 956/1950] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:27 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 170 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:27.645130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab003642-a919-40d4-a082-97fb0f31baac service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.651391 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1410b-2510-4a1c-b581-a7a88c7e6049 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.652089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1410b-2510-4a1c-b581-a7a88c7e6049 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.652340 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1410b-2510-4a1c-b581-a7a88c7e6049 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.652618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94a1410b-2510-4a1c-b581-a7a88c7e6049 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.653454 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1410b-2510-4a1c-b581-a7a88c7e6049 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.655517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94a1410b-2510-4a1c-b581-a7a88c7e6049 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.685988 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 995/1951] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:27 2022] POST /identity/v3/users => generated 297 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:27.686622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1410b-2510-4a1c-b581-a7a88c7e6049 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.697904 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94a1410b-2510-4a1c-b581-a7a88c7e6049 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.710182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd602-3c40-459b-99b8-2f1f745c818d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.711261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd602-3c40-459b-99b8-2f1f745c818d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.712498 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd602-3c40-459b-99b8-2f1f745c818d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.712791 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b14cd602-3c40-459b-99b8-2f1f745c818d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.713833 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cd602-3c40-459b-99b8-2f1f745c818d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.716660 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b14cd602-3c40-459b-99b8-2f1f745c818d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.729154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 996/1952] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:27.730370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab003642-a919-40d4-a082-97fb0f31baac service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.733865 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd602-3c40-459b-99b8-2f1f745c818d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.738446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb0f6b-ac18-43ec-916c-2b3070cb0a35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.739268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0f6b-ac18-43ec-916c-2b3070cb0a35 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.739638 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0f6b-ac18-43ec-916c-2b3070cb0a35 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.740008 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0fb0f6b-ac18-43ec-916c-2b3070cb0a35 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.741006 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb0f6b-ac18-43ec-916c-2b3070cb0a35 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.742707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0fb0f6b-ac18-43ec-916c-2b3070cb0a35 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.744323 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b14cd602-3c40-459b-99b8-2f1f745c818d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.749584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed246b-dd44-435b-8ac9-0938c07feb09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.751174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed246b-dd44-435b-8ac9-0938c07feb09 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.751463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed246b-dd44-435b-8ac9-0938c07feb09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.751741 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ed246b-dd44-435b-8ac9-0938c07feb09 admin admin] PATH_INFO: `/v3/projects/d225e24871fc44b2b5c417d7f08eb293/users/5455a608638644e29b54b1b8a623d61f/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.755657 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 957/1953] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 110 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:27.757804 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb0f6b-ac18-43ec-916c-2b3070cb0a35 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.768103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0fb0f6b-ac18-43ec-916c-2b3070cb0a35 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.770041 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed246b-dd44-435b-8ac9-0938c07feb09 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d225e24871fc44b2b5c417d7f08eb293, user_id=5455a608638644e29b54b1b8a623d61f, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.772704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db290c2b-670d-4bce-838e-1b7dc5c95a8c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.772829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0ed246b-dd44-435b-8ac9-0938c07feb09 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.773385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db290c2b-670d-4bce-838e-1b7dc5c95a8c service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.773669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db290c2b-670d-4bce-838e-1b7dc5c95a8c service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.773944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db290c2b-670d-4bce-838e-1b7dc5c95a8c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.775932 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-db290c2b-670d-4bce-838e-1b7dc5c95a8c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:27.783846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:27.787300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 997/1954] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:27 2022] PUT /identity/v3/projects/d225e24871fc44b2b5c417d7f08eb293/users/5455a608638644e29b54b1b8a623d61f/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:27.788068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed246b-dd44-435b-8ac9-0938c07feb09 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.801309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:27.838564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db290c2b-670d-4bce-838e-1b7dc5c95a8c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.840013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db290c2b-670d-4bce-838e-1b7dc5c95a8c service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.850040 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 958/1955] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:27 2022] GET /identity/v3/auth/tokens => generated 3234 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:22:27.852580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ed246b-dd44-435b-8ac9-0938c07feb09 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.852743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db290c2b-670d-4bce-838e-1b7dc5c95a8c service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.857753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3785e-683a-4879-aac4-ed437b45b4a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.858605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3785e-683a-4879-aac4-ed437b45b4a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.858921 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3785e-683a-4879-aac4-ed437b45b4a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.859751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7a3785e-683a-4879-aac4-ed437b45b4a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.860521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3785e-683a-4879-aac4-ed437b45b4a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.862158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7a3785e-683a-4879-aac4-ed437b45b4a9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.863331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db290c2b-670d-4bce-838e-1b7dc5c95a8c service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.868168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82974f-bb87-45cd-8111-f57ccb688715 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.868832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82974f-bb87-45cd-8111-f57ccb688715 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.869152 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82974f-bb87-45cd-8111-f57ccb688715 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.869536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c82974f-bb87-45cd-8111-f57ccb688715 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.870135 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82974f-bb87-45cd-8111-f57ccb688715 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.871720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c82974f-bb87-45cd-8111-f57ccb688715 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.877659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 998/1956] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:27.878805 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3785e-683a-4879-aac4-ed437b45b4a9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.882748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 959/1957] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:27 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:27.886449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82974f-bb87-45cd-8111-f57ccb688715 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:27.889970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7a3785e-683a-4879-aac4-ed437b45b4a9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.895287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5f7303f-2946-4fdc-b0d6-c2671ab4fa28 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.896332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7303f-2946-4fdc-b0d6-c2671ab4fa28 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.896631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7303f-2946-4fdc-b0d6-c2671ab4fa28 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.896885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5f7303f-2946-4fdc-b0d6-c2671ab4fa28 admin admin] PATH_INFO: `/v3/projects/e25f06fec2244e75b7558ef7c6727d3c/users/86f148cfd1704d3e8758ae83b64b3176/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.897421 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c82974f-bb87-45cd-8111-f57ccb688715 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:27.902459 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d10a3814-d4d5-4c2d-866a-199c74671172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:27.903369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a3814-d4d5-4c2d-866a-199c74671172 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.903655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a3814-d4d5-4c2d-866a-199c74671172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.903937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d10a3814-d4d5-4c2d-866a-199c74671172 admin admin] PATH_INFO: `/v3/projects/d225e24871fc44b2b5c417d7f08eb293/users/5455a608638644e29b54b1b8a623d61f/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.906654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a3814-d4d5-4c2d-866a-199c74671172 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d225e24871fc44b2b5c417d7f08eb293, user_id=5455a608638644e29b54b1b8a623d61f, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.909524 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d10a3814-d4d5-4c2d-866a-199c74671172 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.915801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7303f-2946-4fdc-b0d6-c2671ab4fa28 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e25f06fec2244e75b7558ef7c6727d3c, user_id=86f148cfd1704d3e8758ae83b64b3176, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:27.919222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5f7303f-2946-4fdc-b0d6-c2671ab4fa28 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:27.921455 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 960/1958] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:27 2022] PUT /identity/v3/projects/d225e24871fc44b2b5c417d7f08eb293/users/5455a608638644e29b54b1b8a623d61f/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:27.931638 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97dea7-fd22-43fe-b8a9-6aa8179d54f0 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.931985 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97dea7-fd22-43fe-b8a9-6aa8179d54f0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.932279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec97dea7-fd22-43fe-b8a9-6aa8179d54f0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.933293 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 999/1959] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:27 2022] PUT /identity/v3/projects/e25f06fec2244e75b7558ef7c6727d3c/users/86f148cfd1704d3e8758ae83b64b3176/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:27.944264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57312a-95d7-452f-ba72-06aa188b0f74 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:27.944549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57312a-95d7-452f-ba72-06aa188b0f74 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:27.944827 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c57312a-95d7-452f-ba72-06aa188b0f74 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:27.961810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ec97dea7-fd22-43fe-b8a9-6aa8179d54f0 None None] MFA Rules not processed for user `5455a608638644e29b54b1b8a623d61f`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:27.963225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ec97dea7-fd22-43fe-b8a9-6aa8179d54f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:27.978908 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3c57312a-95d7-452f-ba72-06aa188b0f74 None None] MFA Rules not processed for user `86f148cfd1704d3e8758ae83b64b3176`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:27.980525 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3c57312a-95d7-452f-ba72-06aa188b0f74 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:28.058683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1000/1960] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:27 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:28.060262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 961/1961] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:27 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:28.066285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57312a-95d7-452f-ba72-06aa188b0f74 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:28.119780 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97dea7-fd22-43fe-b8a9-6aa8179d54f0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:28.122476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ec97dea7-fd22-43fe-b8a9-6aa8179d54f0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:28.149775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c57312a-95d7-452f-ba72-06aa188b0f74 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:28.156152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872580d-f441-4e8d-9429-3e1546c788a1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:28.157231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872580d-f441-4e8d-9429-3e1546c788a1 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:28.157430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872580d-f441-4e8d-9429-3e1546c788a1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:28.157707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e872580d-f441-4e8d-9429-3e1546c788a1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:28.158403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872580d-f441-4e8d-9429-3e1546c788a1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:28.168298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e872580d-f441-4e8d-9429-3e1546c788a1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:28.194514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:28.208661 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1001/1962] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:28 2022] POST /identity/v3/projects => generated 383 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:28.208661 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872580d-f441-4e8d-9429-3e1546c788a1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:28.253264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec97dea7-fd22-43fe-b8a9-6aa8179d54f0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:28.286654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e872580d-f441-4e8d-9429-3e1546c788a1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:28.287189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:28.291845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57485fe0-9d8b-4096-ab6f-e6f56bc2a795 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:28.292663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57485fe0-9d8b-4096-ab6f-e6f56bc2a795 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:28.293292 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57485fe0-9d8b-4096-ab6f-e6f56bc2a795 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:28.293292 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57485fe0-9d8b-4096-ab6f-e6f56bc2a795 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:28.294446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57485fe0-9d8b-4096-ab6f-e6f56bc2a795 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:28.296235 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57485fe0-9d8b-4096-ab6f-e6f56bc2a795 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:28.322810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1002/1963] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:28 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:28.326755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57485fe0-9d8b-4096-ab6f-e6f56bc2a795 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:28.329379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce01f66-bbde-4157-9973-0874cb5178d9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:28.330324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce01f66-bbde-4157-9973-0874cb5178d9 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:28.330615 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce01f66-bbde-4157-9973-0874cb5178d9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:28.330891 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bce01f66-bbde-4157-9973-0874cb5178d9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:28.337395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57485fe0-9d8b-4096-ab6f-e6f56bc2a795 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:28.342134 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03647b-4d95-4ca0-b575-4daea5b644cd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:28.342676 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03647b-4d95-4ca0-b575-4daea5b644cd admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:28.342951 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03647b-4d95-4ca0-b575-4daea5b644cd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:28.343266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a03647b-4d95-4ca0-b575-4daea5b644cd admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:28.343985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03647b-4d95-4ca0-b575-4daea5b644cd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:28.345659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a03647b-4d95-4ca0-b575-4daea5b644cd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:28.361925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1003/1964] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:28.363671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03647b-4d95-4ca0-b575-4daea5b644cd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:28.374331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a03647b-4d95-4ca0-b575-4daea5b644cd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:28.379998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a257f6-a8c2-4987-8c36-3ea2f0cb3358 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:28.381095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a257f6-a8c2-4987-8c36-3ea2f0cb3358 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:28.381386 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a257f6-a8c2-4987-8c36-3ea2f0cb3358 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:28.381663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16a257f6-a8c2-4987-8c36-3ea2f0cb3358 admin admin] PATH_INFO: `/v3/projects/0a7d43de21024a8786413efb7d800116/users/01085cf98416461db010939043bec7c7/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:28.399014 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a257f6-a8c2-4987-8c36-3ea2f0cb3358 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7d43de21024a8786413efb7d800116, user_id=01085cf98416461db010939043bec7c7, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:28.401681 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16a257f6-a8c2-4987-8c36-3ea2f0cb3358 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:28.406318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce01f66-bbde-4157-9973-0874cb5178d9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:28.407916 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bce01f66-bbde-4157-9973-0874cb5178d9 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:28.418427 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 962/1965] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:28 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 301 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:22:28.420774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1004/1966] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:28 2022] PUT /identity/v3/projects/0a7d43de21024a8786413efb7d800116/users/01085cf98416461db010939043bec7c7/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:28.425087 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce01f66-bbde-4157-9973-0874cb5178d9 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:28.436216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bce01f66-bbde-4157-9973-0874cb5178d9 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:28.495101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfbd7e-d3c0-498f-8ad1-db3b9ca83fcf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:28.495802 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfbd7e-d3c0-498f-8ad1-db3b9ca83fcf admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:28.496200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfbd7e-d3c0-498f-8ad1-db3b9ca83fcf admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:28.496561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cdfbd7e-d3c0-498f-8ad1-db3b9ca83fcf admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:28.497580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfbd7e-d3c0-498f-8ad1-db3b9ca83fcf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:28.499177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cdfbd7e-d3c0-498f-8ad1-db3b9ca83fcf admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:28.512638 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 963/1967] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:28 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:28.513801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a257f6-a8c2-4987-8c36-3ea2f0cb3358 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:28.520320 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfbd7e-d3c0-498f-8ad1-db3b9ca83fcf admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:28.525406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16a257f6-a8c2-4987-8c36-3ea2f0cb3358 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:28.530392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14a96d60-4762-410f-9b89-152ef5713126 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:28.531969 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a96d60-4762-410f-9b89-152ef5713126 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:28.532435 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a96d60-4762-410f-9b89-152ef5713126 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:28.532836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14a96d60-4762-410f-9b89-152ef5713126 admin admin] PATH_INFO: `/v3/projects/0a7d43de21024a8786413efb7d800116/users/01085cf98416461db010939043bec7c7/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:28.535059 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a96d60-4762-410f-9b89-152ef5713126 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0a7d43de21024a8786413efb7d800116, user_id=01085cf98416461db010939043bec7c7, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:28.537916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14a96d60-4762-410f-9b89-152ef5713126 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:28.550434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1005/1968] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:28 2022] PUT /identity/v3/projects/0a7d43de21024a8786413efb7d800116/users/01085cf98416461db010939043bec7c7/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 37 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:28.562830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713015f-a23f-4ec1-b5f4-93d7d01b4e9f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:28.562830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713015f-a23f-4ec1-b5f4-93d7d01b4e9f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:28.562830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7713015f-a23f-4ec1-b5f4-93d7d01b4e9f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:28.595754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cdfbd7e-d3c0-498f-8ad1-db3b9ca83fcf admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:28.602612 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7713015f-a23f-4ec1-b5f4-93d7d01b4e9f None None] MFA Rules not processed for user `01085cf98416461db010939043bec7c7`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:28.604892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7713015f-a23f-4ec1-b5f4-93d7d01b4e9f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:28.634988 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:28.675048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de08cea-be46-4a09-9d63-577617a520bd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:28.675726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de08cea-be46-4a09-9d63-577617a520bd service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:28.676017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de08cea-be46-4a09-9d63-577617a520bd service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:28.676485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5de08cea-be46-4a09-9d63-577617a520bd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:28.776517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1006/1969] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:28 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:28.790626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de08cea-be46-4a09-9d63-577617a520bd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:28.792312 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5de08cea-be46-4a09-9d63-577617a520bd service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:28.794572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713015f-a23f-4ec1-b5f4-93d7d01b4e9f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:28.808085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7713015f-a23f-4ec1-b5f4-93d7d01b4e9f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:28.809059 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 964/1970] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:28 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 289 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:28.812327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d0131a1-25f6-4e60-b88b-107fbdb02f6d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:28.813099 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0131a1-25f6-4e60-b88b-107fbdb02f6d service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:28.813457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0131a1-25f6-4e60-b88b-107fbdb02f6d service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:28.813810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d0131a1-25f6-4e60-b88b-107fbdb02f6d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:28.838756 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:28.917615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0131a1-25f6-4e60-b88b-107fbdb02f6d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:28.919358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d0131a1-25f6-4e60-b88b-107fbdb02f6d service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:28.933108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1007/1971] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:28 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 139 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:29.783172 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de08cea-be46-4a09-9d63-577617a520bd service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:29.875394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5de08cea-be46-4a09-9d63-577617a520bd service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:29.880536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bd174-6666-4214-9177-aaff2c399a05 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:29.881573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bd174-6666-4214-9177-aaff2c399a05 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:29.881855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bd174-6666-4214-9177-aaff2c399a05 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:29.882129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3bd174-6666-4214-9177-aaff2c399a05 admin admin] PATH_INFO: `/v3/users/d3c1a27dc08f457fbc786c28668ad1a5` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:29.884133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bd174-6666-4214-9177-aaff2c399a05 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d3c1a27dc08f457fbc786c28668ad1a5)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:29.885493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3bd174-6666-4214-9177-aaff2c399a05 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:29.951799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8e3bd174-6666-4214-9177-aaff2c399a05 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd3c1a27dc08f457fbc786c28668ad1a5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:29.959309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8e3bd174-6666-4214-9177-aaff2c399a05 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd3c1a27dc08f457fbc786c28668ad1a5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:29.960087 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8e3bd174-6666-4214-9177-aaff2c399a05 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd3c1a27dc08f457fbc786c28668ad1a5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:29.975723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8e3bd174-6666-4214-9177-aaff2c399a05 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd3c1a27dc08f457fbc786c28668ad1a5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:29.986144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8e3bd174-6666-4214-9177-aaff2c399a05 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd3c1a27dc08f457fbc786c28668ad1a5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:29.990743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:29.998171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 965/1972] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:29 2022] DELETE /identity/v3/users/d3c1a27dc08f457fbc786c28668ad1a5 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:30.004393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb558b00-bd12-449b-b8ad-cf616856ea00 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:30.004901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb558b00-bd12-449b-b8ad-cf616856ea00 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:30.005218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb558b00-bd12-449b-b8ad-cf616856ea00 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:30.024158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-fb558b00-bd12-449b-b8ad-cf616856ea00 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:30.029159 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fb558b00-bd12-449b-b8ad-cf616856ea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:30.087143 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1008/1973] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:30 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:30.096728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bd174-6666-4214-9177-aaff2c399a05 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:30.098142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8e3bd174-6666-4214-9177-aaff2c399a05 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:30.154695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3bd174-6666-4214-9177-aaff2c399a05 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:30.158287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b840-0abe-4144-a324-9b04d1a8c327 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:30.158926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b840-0abe-4144-a324-9b04d1a8c327 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:30.159212 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b840-0abe-4144-a324-9b04d1a8c327 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:30.159487 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a591b840-0abe-4144-a324-9b04d1a8c327 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:30.168331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591b840-0abe-4144-a324-9b04d1a8c327 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:30.169795 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a591b840-0abe-4144-a324-9b04d1a8c327 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:30.179600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 966/1974] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:30 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:30.473966 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb558b00-bd12-449b-b8ad-cf616856ea00 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:30.475942 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-fb558b00-bd12-449b-b8ad-cf616856ea00 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:30.489700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb558b00-bd12-449b-b8ad-cf616856ea00 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:30.494706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:30.495573 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:30.495877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:30.496155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] PATH_INFO: `/v3/projects/bd2f6df329e0443884604ce248c24796` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:30.497350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=bd2f6df329e0443884604ce248c24796)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:30.499319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:30.550004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bd2f6df329e0443884604ce248c24796', 'request_id': 'req-799b0ae0-00b3-4e0a-8061-138d75601cc1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.557350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bd2f6df329e0443884604ce248c24796', 'request_id': 'req-799b0ae0-00b3-4e0a-8061-138d75601cc1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.562819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bd2f6df329e0443884604ce248c24796', 'request_id': 'req-799b0ae0-00b3-4e0a-8061-138d75601cc1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.573836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] The token cache is being invalidate because project bd2f6df329e0443884604ce248c24796 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:30.574124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.574744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.576330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1009/1975] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:30 2022] DELETE /identity/v3/projects/bd2f6df329e0443884604ce248c24796 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:30.580379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b840-0abe-4144-a324-9b04d1a8c327 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:30.600844 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a591b840-0abe-4144-a324-9b04d1a8c327 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:30.666591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90278e5-4b01-44d7-a9c9-4ee0844c7c40 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:30.667472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90278e5-4b01-44d7-a9c9-4ee0844c7c40 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:30.667749 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90278e5-4b01-44d7-a9c9-4ee0844c7c40 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:30.668025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90278e5-4b01-44d7-a9c9-4ee0844c7c40 admin admin] PATH_INFO: `/v3/users/5455a608638644e29b54b1b8a623d61f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:30.669249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90278e5-4b01-44d7-a9c9-4ee0844c7c40 admin admin] RBAC: Authorizing `identity:delete_user(user_id=5455a608638644e29b54b1b8a623d61f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:30.671220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a90278e5-4b01-44d7-a9c9-4ee0844c7c40 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:30.736501 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a90278e5-4b01-44d7-a9c9-4ee0844c7c40 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5455a608638644e29b54b1b8a623d61f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.763453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a90278e5-4b01-44d7-a9c9-4ee0844c7c40 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5455a608638644e29b54b1b8a623d61f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.764374 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a90278e5-4b01-44d7-a9c9-4ee0844c7c40 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5455a608638644e29b54b1b8a623d61f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.786289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a90278e5-4b01-44d7-a9c9-4ee0844c7c40 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5455a608638644e29b54b1b8a623d61f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.798600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a90278e5-4b01-44d7-a9c9-4ee0844c7c40 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5455a608638644e29b54b1b8a623d61f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:30.810438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 967/1976] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:30 2022] DELETE /identity/v3/users/5455a608638644e29b54b1b8a623d61f => generated 0 bytes in 227 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:31.753356 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:31.755009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:31.769984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799b0ae0-00b3-4e0a-8061-138d75601cc1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:31.818620 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:31.836961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c65a6072-5443-4edb-8d95-59d69466f8b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:31.837858 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6072-5443-4edb-8d95-59d69466f8b1 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:31.838145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6072-5443-4edb-8d95-59d69466f8b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:31.838423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c65a6072-5443-4edb-8d95-59d69466f8b1 admin admin] PATH_INFO: `/v3/projects/d225e24871fc44b2b5c417d7f08eb293` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:31.839604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a6072-5443-4edb-8d95-59d69466f8b1 admin admin] RBAC: Authorizing `identity:delete_project(project_id=d225e24871fc44b2b5c417d7f08eb293)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:31.841544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c65a6072-5443-4edb-8d95-59d69466f8b1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:31.890283 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c65a6072-5443-4edb-8d95-59d69466f8b1 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd225e24871fc44b2b5c417d7f08eb293', 'request_id': 'req-c65a6072-5443-4edb-8d95-59d69466f8b1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:31.898755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c65a6072-5443-4edb-8d95-59d69466f8b1 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd225e24871fc44b2b5c417d7f08eb293', 'request_id': 'req-c65a6072-5443-4edb-8d95-59d69466f8b1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:31.904003 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c65a6072-5443-4edb-8d95-59d69466f8b1 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd225e24871fc44b2b5c417d7f08eb293', 'request_id': 'req-c65a6072-5443-4edb-8d95-59d69466f8b1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:31.922246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c65a6072-5443-4edb-8d95-59d69466f8b1 admin admin] The token cache is being invalidate because project d225e24871fc44b2b5c417d7f08eb293 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:31.922559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c65a6072-5443-4edb-8d95-59d69466f8b1 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:31.923245 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c65a6072-5443-4edb-8d95-59d69466f8b1 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:31.924812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1010/1977] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:31 2022] DELETE /identity/v3/projects/d225e24871fc44b2b5c417d7f08eb293 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:31.929789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8ad2b-f1e1-4507-97cb-ec8baec8e624 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:31.930236 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8ad2b-f1e1-4507-97cb-ec8baec8e624 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:31.930332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ed8ad2b-f1e1-4507-97cb-ec8baec8e624 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:31.951207 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8ed8ad2b-f1e1-4507-97cb-ec8baec8e624 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:31.953255 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8ed8ad2b-f1e1-4507-97cb-ec8baec8e624 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:31.975512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:32.056718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 968/1978] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 121 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:32.059702 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104972-619b-48dd-8fda-818c9834126f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:32.060150 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104972-619b-48dd-8fda-818c9834126f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:32.060567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2104972-619b-48dd-8fda-818c9834126f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:32.091820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d2104972-619b-48dd-8fda-818c9834126f None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:32.092515 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d2104972-619b-48dd-8fda-818c9834126f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:32.109954 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1011/1979] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:32.115096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8ad2b-f1e1-4507-97cb-ec8baec8e624 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:32.126230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ed8ad2b-f1e1-4507-97cb-ec8baec8e624 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:32.132267 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec4596-3f36-4885-a884-abe3d5c6f98b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:32.132928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec4596-3f36-4885-a884-abe3d5c6f98b admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:32.133249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec4596-3f36-4885-a884-abe3d5c6f98b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:32.133525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55ec4596-3f36-4885-a884-abe3d5c6f98b admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:32.134248 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec4596-3f36-4885-a884-abe3d5c6f98b admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:32.134553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec4596-3f36-4885-a884-abe3d5c6f98b admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:32.136181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55ec4596-3f36-4885-a884-abe3d5c6f98b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:32.155025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 969/1980] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:32.157113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2104972-619b-48dd-8fda-818c9834126f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:32.170491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2104972-619b-48dd-8fda-818c9834126f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:32.175292 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4b690-cea5-4790-8e6e-c31544b434ac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:32.175979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4b690-cea5-4790-8e6e-c31544b434ac admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:32.176267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4b690-cea5-4790-8e6e-c31544b434ac admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:32.176540 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d4b690-cea5-4790-8e6e-c31544b434ac admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:32.177342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4b690-cea5-4790-8e6e-c31544b434ac admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:32.179250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08d4b690-cea5-4790-8e6e-c31544b434ac admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:32.208045 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1012/1981] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:32 2022] POST /identity/v3/projects => generated 373 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:32.211896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec4596-3f36-4885-a884-abe3d5c6f98b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:32.223042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55ec4596-3f36-4885-a884-abe3d5c6f98b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:32.313776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260ecea-d617-456c-a9b5-b90e12402bee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:32.314369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260ecea-d617-456c-a9b5-b90e12402bee admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:32.314658 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260ecea-d617-456c-a9b5-b90e12402bee admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:32.314935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b260ecea-d617-456c-a9b5-b90e12402bee admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:32.315619 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260ecea-d617-456c-a9b5-b90e12402bee admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:32.317596 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b260ecea-d617-456c-a9b5-b90e12402bee admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:32.339628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 970/1982] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:32 2022] POST /identity/v3/users => generated 287 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:32.344413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4b690-cea5-4790-8e6e-c31544b434ac admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:32.355694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d4b690-cea5-4790-8e6e-c31544b434ac admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:32.360307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf13036-916d-4cc6-bd4b-af59a536e4ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:32.361254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf13036-916d-4cc6-bd4b-af59a536e4ae admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:32.361674 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf13036-916d-4cc6-bd4b-af59a536e4ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:32.362110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bf13036-916d-4cc6-bd4b-af59a536e4ae admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:32.363037 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf13036-916d-4cc6-bd4b-af59a536e4ae admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:32.365017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bf13036-916d-4cc6-bd4b-af59a536e4ae admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:32.377981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1013/1983] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:32.382091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260ecea-d617-456c-a9b5-b90e12402bee admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:32.397732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b260ecea-d617-456c-a9b5-b90e12402bee admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:32.403196 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c15dd8f4-9f79-4769-a886-2a0c2b860fcd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:32.403864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd8f4-9f79-4769-a886-2a0c2b860fcd admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:32.404146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd8f4-9f79-4769-a886-2a0c2b860fcd admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:32.404418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c15dd8f4-9f79-4769-a886-2a0c2b860fcd admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:32.405166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dd8f4-9f79-4769-a886-2a0c2b860fcd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:32.407327 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c15dd8f4-9f79-4769-a886-2a0c2b860fcd admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:32.417957 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 971/1984] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:32.422687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf13036-916d-4cc6-bd4b-af59a536e4ae admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:32.437162 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bf13036-916d-4cc6-bd4b-af59a536e4ae admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:32.443017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43c7ab-5a6a-4865-81f6-f8a6a5963b53 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:32.443906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43c7ab-5a6a-4865-81f6-f8a6a5963b53 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:32.444184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43c7ab-5a6a-4865-81f6-f8a6a5963b53 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:32.444482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac43c7ab-5a6a-4865-81f6-f8a6a5963b53 admin admin] PATH_INFO: `/v3/projects/7d1b836f1ea141d8a9bb684e9c836950/users/a8cfb57d5d56415eb65f52cc9db9af82/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:32.459376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43c7ab-5a6a-4865-81f6-f8a6a5963b53 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7d1b836f1ea141d8a9bb684e9c836950, user_id=a8cfb57d5d56415eb65f52cc9db9af82, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:32.462076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac43c7ab-5a6a-4865-81f6-f8a6a5963b53 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:32.476781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1014/1985] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:32 2022] PUT /identity/v3/projects/7d1b836f1ea141d8a9bb684e9c836950/users/a8cfb57d5d56415eb65f52cc9db9af82/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:32.487225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d0e5b-b3c2-49bc-a78a-2b1d86dc1585 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:32.487512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d0e5b-b3c2-49bc-a78a-2b1d86dc1585 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:32.487788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a32d0e5b-b3c2-49bc-a78a-2b1d86dc1585 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:32.515796 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a32d0e5b-b3c2-49bc-a78a-2b1d86dc1585 None None] MFA Rules not processed for user `a8cfb57d5d56415eb65f52cc9db9af82`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:32.517012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a32d0e5b-b3c2-49bc-a78a-2b1d86dc1585 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:32.602487 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 972/1986] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:32 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:32.608248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43c7ab-5a6a-4865-81f6-f8a6a5963b53 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:32.691165 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac43c7ab-5a6a-4865-81f6-f8a6a5963b53 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:32.696265 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd090708-f4db-4530-b455-77dedb6b3090 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:32.696943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd090708-f4db-4530-b455-77dedb6b3090 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:32.697249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd090708-f4db-4530-b455-77dedb6b3090 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:32.697528 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd090708-f4db-4530-b455-77dedb6b3090 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:32.698739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd090708-f4db-4530-b455-77dedb6b3090 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:32.700330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd090708-f4db-4530-b455-77dedb6b3090 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:32.738982 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:32.751049 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1015/1987] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:32 2022] POST /identity/v3/projects => generated 373 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:32.756521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d0e5b-b3c2-49bc-a78a-2b1d86dc1585 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:32.774627 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a32d0e5b-b3c2-49bc-a78a-2b1d86dc1585 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:32.818686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:32.892462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475e700-6193-48a5-99b3-97f6b0bbca47 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:32.893784 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475e700-6193-48a5-99b3-97f6b0bbca47 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:32.894240 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475e700-6193-48a5-99b3-97f6b0bbca47 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:32.894523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1475e700-6193-48a5-99b3-97f6b0bbca47 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:32.895219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475e700-6193-48a5-99b3-97f6b0bbca47 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:32.897414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1475e700-6193-48a5-99b3-97f6b0bbca47 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:32.924768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 973/1988] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:32 2022] POST /identity/v3/users => generated 293 bytes in 170 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:32.928695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd090708-f4db-4530-b455-77dedb6b3090 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:32.942894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd090708-f4db-4530-b455-77dedb6b3090 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:32.950153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6055b-e83a-4c5f-bba7-c32f14698ec1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:32.951145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6055b-e83a-4c5f-bba7-c32f14698ec1 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:32.951466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6055b-e83a-4c5f-bba7-c32f14698ec1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:32.951805 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18f6055b-e83a-4c5f-bba7-c32f14698ec1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:32.952887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6055b-e83a-4c5f-bba7-c32f14698ec1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:32.955859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18f6055b-e83a-4c5f-bba7-c32f14698ec1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:32.978914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1016/1989] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:32 2022] GET /identity/v3/roles => generated 1420 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:32.979075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475e700-6193-48a5-99b3-97f6b0bbca47 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:32.994822 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1475e700-6193-48a5-99b3-97f6b0bbca47 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:33.010032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d4405-c335-467a-9d5a-796f405ccda9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:33.011011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4405-c335-467a-9d5a-796f405ccda9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:33.011273 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4405-c335-467a-9d5a-796f405ccda9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:33.011572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00d4405-c335-467a-9d5a-796f405ccda9 admin admin] PATH_INFO: `/v3/projects/e9ee70e75bf34d0bbf68603b7e589171/users/f60c8a4819f64ee7b88288c5e0e34c84/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:33.034777 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d4405-c335-467a-9d5a-796f405ccda9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ee70e75bf34d0bbf68603b7e589171, user_id=f60c8a4819f64ee7b88288c5e0e34c84, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:33.038444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e00d4405-c335-467a-9d5a-796f405ccda9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:33.059282 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 974/1990] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:32 2022] PUT /identity/v3/projects/e9ee70e75bf34d0bbf68603b7e589171/users/f60c8a4819f64ee7b88288c5e0e34c84/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 80 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:33.062878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6055b-e83a-4c5f-bba7-c32f14698ec1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:33.073255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18f6055b-e83a-4c5f-bba7-c32f14698ec1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:33.136299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e63d90-3e2d-4f8c-95b1-bc2be70cfd78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:33.136973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e63d90-3e2d-4f8c-95b1-bc2be70cfd78 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:33.137283 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e63d90-3e2d-4f8c-95b1-bc2be70cfd78 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:33.137558 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e63d90-3e2d-4f8c-95b1-bc2be70cfd78 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:33.138280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e63d90-3e2d-4f8c-95b1-bc2be70cfd78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:33.139909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e63d90-3e2d-4f8c-95b1-bc2be70cfd78 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:33.150324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1017/1991] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:33 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:33.154382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d4405-c335-467a-9d5a-796f405ccda9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:33.164763 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00d4405-c335-467a-9d5a-796f405ccda9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:33.169837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156a6ae-b3ad-4d2f-ae0b-0f2c1967859d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:33.170743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156a6ae-b3ad-4d2f-ae0b-0f2c1967859d admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:33.171027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156a6ae-b3ad-4d2f-ae0b-0f2c1967859d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:33.171924 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6156a6ae-b3ad-4d2f-ae0b-0f2c1967859d admin admin] PATH_INFO: `/v3/projects/e9ee70e75bf34d0bbf68603b7e589171/users/f60c8a4819f64ee7b88288c5e0e34c84/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:33.173948 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156a6ae-b3ad-4d2f-ae0b-0f2c1967859d admin admin] RBAC: Authorizing `identity:create_grant(project_id=e9ee70e75bf34d0bbf68603b7e589171, user_id=f60c8a4819f64ee7b88288c5e0e34c84, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:33.176673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6156a6ae-b3ad-4d2f-ae0b-0f2c1967859d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:33.187840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 975/1992] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:33 2022] PUT /identity/v3/projects/e9ee70e75bf34d0bbf68603b7e589171/users/f60c8a4819f64ee7b88288c5e0e34c84/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:33.198264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f21295-08a1-4818-93a3-b4abec285c35 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:33.198564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f21295-08a1-4818-93a3-b4abec285c35 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:33.198842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8f21295-08a1-4818-93a3-b4abec285c35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:33.224999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d8f21295-08a1-4818-93a3-b4abec285c35 None None] MFA Rules not processed for user `f60c8a4819f64ee7b88288c5e0e34c84`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:33.226236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d8f21295-08a1-4818-93a3-b4abec285c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:33.294399 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1018/1993] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:33 2022] POST /identity/v3/auth/tokens => generated 3307 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:33.305776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156a6ae-b3ad-4d2f-ae0b-0f2c1967859d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:33.307567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6156a6ae-b3ad-4d2f-ae0b-0f2c1967859d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:33.372593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6156a6ae-b3ad-4d2f-ae0b-0f2c1967859d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:33.376703 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd4bc65a-e77d-4796-814f-8ee57bd0475c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:33.377403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bc65a-e77d-4796-814f-8ee57bd0475c service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:33.377689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bc65a-e77d-4796-814f-8ee57bd0475c service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:33.377972 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd4bc65a-e77d-4796-814f-8ee57bd0475c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:33.437619 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4bc65a-e77d-4796-814f-8ee57bd0475c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:33.438915 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd4bc65a-e77d-4796-814f-8ee57bd0475c service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:33.452876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 976/1994] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:33 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 148 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:33.469502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f21295-08a1-4818-93a3-b4abec285c35 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:33.472096 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d8f21295-08a1-4818-93a3-b4abec285c35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:33.561731 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8f21295-08a1-4818-93a3-b4abec285c35 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:33.570359 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317c6b-511b-4cd1-abcb-9911a32588b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:33.573185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317c6b-511b-4cd1-abcb-9911a32588b7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:33.573473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317c6b-511b-4cd1-abcb-9911a32588b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:33.573766 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32317c6b-511b-4cd1-abcb-9911a32588b7 admin admin] PATH_INFO: `/v3/users/c1195d795eba41d2a938745498e7ea80` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:33.575888 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32317c6b-511b-4cd1-abcb-9911a32588b7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c1195d795eba41d2a938745498e7ea80)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:33.578311 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32317c6b-511b-4cd1-abcb-9911a32588b7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:33.591999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:33.642661 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-32317c6b-511b-4cd1-abcb-9911a32588b7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c1195d795eba41d2a938745498e7ea80'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:33.643376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-32317c6b-511b-4cd1-abcb-9911a32588b7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c1195d795eba41d2a938745498e7ea80'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:33.651039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-32317c6b-511b-4cd1-abcb-9911a32588b7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c1195d795eba41d2a938745498e7ea80'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:33.651726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-32317c6b-511b-4cd1-abcb-9911a32588b7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c1195d795eba41d2a938745498e7ea80'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:33.664935 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-32317c6b-511b-4cd1-abcb-9911a32588b7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c1195d795eba41d2a938745498e7ea80'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:33.679713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1019/1995] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:33 2022] DELETE /identity/v3/users/c1195d795eba41d2a938745498e7ea80 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:33.684341 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720a19-45ba-4059-86cf-994902d669ee None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:33.684636 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720a19-45ba-4059-86cf-994902d669ee None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:33.684923 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78720a19-45ba-4059-86cf-994902d669ee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:33.703861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-78720a19-45ba-4059-86cf-994902d669ee None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:33.705635 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-78720a19-45ba-4059-86cf-994902d669ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:33.737294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:33.787420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 977/1996] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:33.798248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317c6b-511b-4cd1-abcb-9911a32588b7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:33.799826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-32317c6b-511b-4cd1-abcb-9911a32588b7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:33.898132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32317c6b-511b-4cd1-abcb-9911a32588b7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:33.902036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885fe62-b866-47ae-ac49-0af276af9bf3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:33.902682 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885fe62-b866-47ae-ac49-0af276af9bf3 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:33.903508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885fe62-b866-47ae-ac49-0af276af9bf3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:33.903508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7885fe62-b866-47ae-ac49-0af276af9bf3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:33.917509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885fe62-b866-47ae-ac49-0af276af9bf3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:33.919871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7885fe62-b866-47ae-ac49-0af276af9bf3 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:33.931516 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1020/1997] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:33.973352 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78720a19-45ba-4059-86cf-994902d669ee None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:33.975152 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-78720a19-45ba-4059-86cf-994902d669ee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:34.057394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78720a19-45ba-4059-86cf-994902d669ee None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:34.069957 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54efcc2-83e1-4419-a30f-e3c246928bcd service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:34.070740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54efcc2-83e1-4419-a30f-e3c246928bcd service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:34.071125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54efcc2-83e1-4419-a30f-e3c246928bcd service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:34.071516 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f54efcc2-83e1-4419-a30f-e3c246928bcd service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:34.079072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f54efcc2-83e1-4419-a30f-e3c246928bcd service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:34.200059 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54efcc2-83e1-4419-a30f-e3c246928bcd service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:34.201716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f54efcc2-83e1-4419-a30f-e3c246928bcd service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:34.215205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 978/1998] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:33 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 243 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:34.360750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885fe62-b866-47ae-ac49-0af276af9bf3 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:34.362457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7885fe62-b866-47ae-ac49-0af276af9bf3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:34.394723 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7885fe62-b866-47ae-ac49-0af276af9bf3 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:34.401533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:34.401830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:34.402351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:34.402869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] PATH_INFO: `/v3/projects/2639c089c5e64114a1b04de7087544bf` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:34.404646 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2639c089c5e64114a1b04de7087544bf)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:34.407288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:34.477860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2639c089c5e64114a1b04de7087544bf', 'request_id': 'req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:34.488473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2639c089c5e64114a1b04de7087544bf', 'request_id': 'req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:34.496211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2639c089c5e64114a1b04de7087544bf', 'request_id': 'req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:34.509936 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] The token cache is being invalidate because project 2639c089c5e64114a1b04de7087544bf was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:34.510234 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:34.510893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:34.512654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1021/1999] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:34 2022] DELETE /identity/v3/projects/2639c089c5e64114a1b04de7087544bf => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:34.517267 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54efcc2-83e1-4419-a30f-e3c246928bcd service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:34.531167 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f54efcc2-83e1-4419-a30f-e3c246928bcd service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:34.601022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a269be1c-8484-4c11-834f-336371e319f0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:34.602098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269be1c-8484-4c11-834f-336371e319f0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:34.602497 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269be1c-8484-4c11-834f-336371e319f0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:34.602781 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a269be1c-8484-4c11-834f-336371e319f0 admin admin] PATH_INFO: `/v3/users/966cf65223a949529fbb81d37d22b3d6` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:34.604399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269be1c-8484-4c11-834f-336371e319f0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=966cf65223a949529fbb81d37d22b3d6)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:34.606524 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a269be1c-8484-4c11-834f-336371e319f0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:34.632620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:34.721545 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a269be1c-8484-4c11-834f-336371e319f0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '966cf65223a949529fbb81d37d22b3d6'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:34.734385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a269be1c-8484-4c11-834f-336371e319f0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '966cf65223a949529fbb81d37d22b3d6'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:34.735134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a269be1c-8484-4c11-834f-336371e319f0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '966cf65223a949529fbb81d37d22b3d6'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:34.751310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a269be1c-8484-4c11-834f-336371e319f0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '966cf65223a949529fbb81d37d22b3d6'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:34.766150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a269be1c-8484-4c11-834f-336371e319f0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '966cf65223a949529fbb81d37d22b3d6'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:34.784443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 979/2000] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:34 2022] DELETE /identity/v3/users/966cf65223a949529fbb81d37d22b3d6 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:35.102642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:35.104539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:35.121090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b969dc16-d3fc-466c-bdfc-bc34f6c78ef9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:35.137843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=17,keystone:SELECT=81,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:35.213672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98fc19b1-2de8-4e60-be63-8287fb011bb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:35.214694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc19b1-2de8-4e60-be63-8287fb011bb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:35.214982 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc19b1-2de8-4e60-be63-8287fb011bb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:35.215286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98fc19b1-2de8-4e60-be63-8287fb011bb6 admin admin] PATH_INFO: `/v3/projects/8aa29effcb50415587aafba0ba2b8328` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:35.216759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc19b1-2de8-4e60-be63-8287fb011bb6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=8aa29effcb50415587aafba0ba2b8328)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:35.219960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98fc19b1-2de8-4e60-be63-8287fb011bb6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:35.285888 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-98fc19b1-2de8-4e60-be63-8287fb011bb6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8aa29effcb50415587aafba0ba2b8328', 'request_id': 'req-98fc19b1-2de8-4e60-be63-8287fb011bb6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:35.298550 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-98fc19b1-2de8-4e60-be63-8287fb011bb6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8aa29effcb50415587aafba0ba2b8328', 'request_id': 'req-98fc19b1-2de8-4e60-be63-8287fb011bb6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:35.307568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-98fc19b1-2de8-4e60-be63-8287fb011bb6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8aa29effcb50415587aafba0ba2b8328', 'request_id': 'req-98fc19b1-2de8-4e60-be63-8287fb011bb6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:35.322481 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-98fc19b1-2de8-4e60-be63-8287fb011bb6 admin admin] The token cache is being invalidate because project 8aa29effcb50415587aafba0ba2b8328 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:35.322762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-98fc19b1-2de8-4e60-be63-8287fb011bb6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:35.323617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-98fc19b1-2de8-4e60-be63-8287fb011bb6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:35.326093 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1022/2001] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:35 2022] DELETE /identity/v3/projects/8aa29effcb50415587aafba0ba2b8328 => generated 0 bytes in 224 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:35.332445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf21b6-c32b-41dd-ade7-ad65a2e6350f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:35.333068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf21b6-c32b-41dd-ade7-ad65a2e6350f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:35.333181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efaf21b6-c32b-41dd-ade7-ad65a2e6350f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:35.357997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-efaf21b6-c32b-41dd-ade7-ad65a2e6350f None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:35.360764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-efaf21b6-c32b-41dd-ade7-ad65a2e6350f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:35.517356 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 980/2002] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:35.524839 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a3d8b-0ec8-44aa-82be-906603afe97a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:35.525315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a3d8b-0ec8-44aa-82be-906603afe97a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:35.525731 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c29a3d8b-0ec8-44aa-82be-906603afe97a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:35.555704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c29a3d8b-0ec8-44aa-82be-906603afe97a None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:35.557134 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c29a3d8b-0ec8-44aa-82be-906603afe97a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:35.574294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1023/2003] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:35 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:35.574418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf21b6-c32b-41dd-ade7-ad65a2e6350f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:35.581479 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efaf21b6-c32b-41dd-ade7-ad65a2e6350f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:35.586381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724bd66-d863-4039-9076-e6ecb00edef2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:35.587047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724bd66-d863-4039-9076-e6ecb00edef2 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:35.587329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724bd66-d863-4039-9076-e6ecb00edef2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:35.587628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3724bd66-d863-4039-9076-e6ecb00edef2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:35.588343 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724bd66-d863-4039-9076-e6ecb00edef2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:35.588647 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724bd66-d863-4039-9076-e6ecb00edef2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:35.590292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3724bd66-d863-4039-9076-e6ecb00edef2 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:35.604961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 981/2004] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:35.610466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a3d8b-0ec8-44aa-82be-906603afe97a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:35.620910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c29a3d8b-0ec8-44aa-82be-906603afe97a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:35.625723 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade3b61-064e-4421-a2c0-954e2489147c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:35.626545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade3b61-064e-4421-a2c0-954e2489147c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:35.626899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade3b61-064e-4421-a2c0-954e2489147c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:35.627184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eade3b61-064e-4421-a2c0-954e2489147c admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:35.627878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade3b61-064e-4421-a2c0-954e2489147c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:35.629830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eade3b61-064e-4421-a2c0-954e2489147c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:35.659644 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1024/2005] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:35 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:35.660700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724bd66-d863-4039-9076-e6ecb00edef2 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:35.673447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3724bd66-d863-4039-9076-e6ecb00edef2 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:35.735137 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbeb47-6969-411e-b293-9658231116a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:35.735915 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbeb47-6969-411e-b293-9658231116a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:35.736214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbeb47-6969-411e-b293-9658231116a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:35.736615 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9bbeb47-6969-411e-b293-9658231116a4 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:35.737359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbeb47-6969-411e-b293-9658231116a4 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:35.739593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9bbeb47-6969-411e-b293-9658231116a4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:35.762458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 982/2006] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:35 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:35.765565 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade3b61-064e-4421-a2c0-954e2489147c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:35.776862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eade3b61-064e-4421-a2c0-954e2489147c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:35.784900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344ea3-3d6f-4243-b176-db0e67d1e808 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:35.785943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344ea3-3d6f-4243-b176-db0e67d1e808 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:35.786509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344ea3-3d6f-4243-b176-db0e67d1e808 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:35.787051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff344ea3-3d6f-4243-b176-db0e67d1e808 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:35.788680 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344ea3-3d6f-4243-b176-db0e67d1e808 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:35.791248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff344ea3-3d6f-4243-b176-db0e67d1e808 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:35.809531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1025/2007] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:35.813786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbeb47-6969-411e-b293-9658231116a4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:35.834080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9bbeb47-6969-411e-b293-9658231116a4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:35.839442 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fa2a79-b5e5-4658-8c18-085affe39f93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:35.840269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa2a79-b5e5-4658-8c18-085affe39f93 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:35.840650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa2a79-b5e5-4658-8c18-085affe39f93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:35.841053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fa2a79-b5e5-4658-8c18-085affe39f93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:35.842179 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa2a79-b5e5-4658-8c18-085affe39f93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:35.844268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9fa2a79-b5e5-4658-8c18-085affe39f93 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:35.850981 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=9,keystone:SELECT=87,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:35.860598 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 983/2008] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:35 2022] GET /identity/v3/roles => generated 1420 bytes in 48 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:35.864501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344ea3-3d6f-4243-b176-db0e67d1e808 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:35.878278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff344ea3-3d6f-4243-b176-db0e67d1e808 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:35.884503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0127b-437b-43d3-bb0f-dfc35d7f741a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:35.885439 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0127b-437b-43d3-bb0f-dfc35d7f741a admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:35.885724 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0127b-437b-43d3-bb0f-dfc35d7f741a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:35.886006 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfb0127b-437b-43d3-bb0f-dfc35d7f741a admin admin] PATH_INFO: `/v3/projects/3c96df84104b4e4bbbd3e73ff2694764/users/cd2e7d9722f543f98006b05fcffd3b6e/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:35.903476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0127b-437b-43d3-bb0f-dfc35d7f741a admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c96df84104b4e4bbbd3e73ff2694764, user_id=cd2e7d9722f543f98006b05fcffd3b6e, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:35.906925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfb0127b-437b-43d3-bb0f-dfc35d7f741a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:35.924441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1026/2009] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:35 2022] PUT /identity/v3/projects/3c96df84104b4e4bbbd3e73ff2694764/users/cd2e7d9722f543f98006b05fcffd3b6e/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 60 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:35.934891 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32661b32-dc03-44af-b04d-e0bc69dc9bd5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:35.935346 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32661b32-dc03-44af-b04d-e0bc69dc9bd5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:35.935510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32661b32-dc03-44af-b04d-e0bc69dc9bd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:35.970416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-32661b32-dc03-44af-b04d-e0bc69dc9bd5 None None] MFA Rules not processed for user `cd2e7d9722f543f98006b05fcffd3b6e`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:35.971734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-32661b32-dc03-44af-b04d-e0bc69dc9bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:36.076661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 984/2010] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:35 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:36.106305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0127b-437b-43d3-bb0f-dfc35d7f741a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:36.108156 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dfb0127b-437b-43d3-bb0f-dfc35d7f741a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:36.114008 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32661b32-dc03-44af-b04d-e0bc69dc9bd5 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:36.115815 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-32661b32-dc03-44af-b04d-e0bc69dc9bd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:36.157577 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:36.192358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfb0127b-437b-43d3-bb0f-dfc35d7f741a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:36.199745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32661b32-dc03-44af-b04d-e0bc69dc9bd5 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:36.202889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88837e-2b44-48a2-bcc6-1832eff24b37 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:36.204104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88837e-2b44-48a2-bcc6-1832eff24b37 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:36.204499 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cd97649-6d19-4ecb-ac38-247533a09746 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:36.204622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88837e-2b44-48a2-bcc6-1832eff24b37 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:36.204951 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a88837e-2b44-48a2-bcc6-1832eff24b37 admin admin] PATH_INFO: `/v3/users/a8cfb57d5d56415eb65f52cc9db9af82` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:36.206396 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88837e-2b44-48a2-bcc6-1832eff24b37 admin admin] RBAC: Authorizing `identity:delete_user(user_id=a8cfb57d5d56415eb65f52cc9db9af82)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:36.206627 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97649-6d19-4ecb-ac38-247533a09746 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:36.206962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97649-6d19-4ecb-ac38-247533a09746 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:36.207305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cd97649-6d19-4ecb-ac38-247533a09746 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:36.209187 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a88837e-2b44-48a2-bcc6-1832eff24b37 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:36.218203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd97649-6d19-4ecb-ac38-247533a09746 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:36.219641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cd97649-6d19-4ecb-ac38-247533a09746 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:36.234665 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 985/2011] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:36 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 121 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:36.267139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0a88837e-2b44-48a2-bcc6-1832eff24b37 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a8cfb57d5d56415eb65f52cc9db9af82'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:36.268017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0a88837e-2b44-48a2-bcc6-1832eff24b37 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a8cfb57d5d56415eb65f52cc9db9af82'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:36.277413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0a88837e-2b44-48a2-bcc6-1832eff24b37 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a8cfb57d5d56415eb65f52cc9db9af82'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:36.278552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0a88837e-2b44-48a2-bcc6-1832eff24b37 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a8cfb57d5d56415eb65f52cc9db9af82'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:36.293351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0a88837e-2b44-48a2-bcc6-1832eff24b37 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a8cfb57d5d56415eb65f52cc9db9af82'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:36.316671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1027/2012] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:36 2022] DELETE /identity/v3/users/a8cfb57d5d56415eb65f52cc9db9af82 => generated 0 bytes in 211 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:36.321061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47038d96-3b1b-4f01-b2d1-bd8efeb74e9b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:36.321390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47038d96-3b1b-4f01-b2d1-bd8efeb74e9b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:36.321676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47038d96-3b1b-4f01-b2d1-bd8efeb74e9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:36.353693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-47038d96-3b1b-4f01-b2d1-bd8efeb74e9b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:36.355138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-47038d96-3b1b-4f01-b2d1-bd8efeb74e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:36.460774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 986/2013] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:36 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 141 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:36.476141 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88837e-2b44-48a2-bcc6-1832eff24b37 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:36.477825 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0a88837e-2b44-48a2-bcc6-1832eff24b37 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:36.590734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a88837e-2b44-48a2-bcc6-1832eff24b37 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:36.603281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a28d23-d179-409e-9b77-3cb3752fa901 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:36.604482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a28d23-d179-409e-9b77-3cb3752fa901 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:36.604857 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a28d23-d179-409e-9b77-3cb3752fa901 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:36.605232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2a28d23-d179-409e-9b77-3cb3752fa901 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:36.632540 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a28d23-d179-409e-9b77-3cb3752fa901 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:36.637266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2a28d23-d179-409e-9b77-3cb3752fa901 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:36.667753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1028/2014] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:36 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 192 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:37.176089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47038d96-3b1b-4f01-b2d1-bd8efeb74e9b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:37.183867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-47038d96-3b1b-4f01-b2d1-bd8efeb74e9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:37.198298 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47038d96-3b1b-4f01-b2d1-bd8efeb74e9b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:37.204182 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:37.205220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:37.205576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:37.205927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] PATH_INFO: `/v3/projects/7d1b836f1ea141d8a9bb684e9c836950` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:37.207376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7d1b836f1ea141d8a9bb684e9c836950)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:37.209597 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:37.259233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:DELETE=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:37.278948 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7d1b836f1ea141d8a9bb684e9c836950', 'request_id': 'req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:37.287726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7d1b836f1ea141d8a9bb684e9c836950', 'request_id': 'req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:37.295316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7d1b836f1ea141d8a9bb684e9c836950', 'request_id': 'req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:37.310644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] The token cache is being invalidate because project 7d1b836f1ea141d8a9bb684e9c836950 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:37.312332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:37.312332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:37.313998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 987/2015] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:37 2022] DELETE /identity/v3/projects/7d1b836f1ea141d8a9bb684e9c836950 => generated 0 bytes in 138 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:37.317703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a28d23-d179-409e-9b77-3cb3752fa901 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:37.328327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2a28d23-d179-409e-9b77-3cb3752fa901 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:37.397902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2f7e2b6-495c-4efa-b585-b27009e3fc03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:37.399048 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7e2b6-495c-4efa-b585-b27009e3fc03 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:37.399497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7e2b6-495c-4efa-b585-b27009e3fc03 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:37.399939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2f7e2b6-495c-4efa-b585-b27009e3fc03 admin admin] PATH_INFO: `/v3/users/f60c8a4819f64ee7b88288c5e0e34c84` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:37.401352 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7e2b6-495c-4efa-b585-b27009e3fc03 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f60c8a4819f64ee7b88288c5e0e34c84)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:37.403499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2f7e2b6-495c-4efa-b585-b27009e3fc03 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:37.406905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:37.470392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d2f7e2b6-495c-4efa-b585-b27009e3fc03 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f60c8a4819f64ee7b88288c5e0e34c84'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:37.471037 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d2f7e2b6-495c-4efa-b585-b27009e3fc03 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f60c8a4819f64ee7b88288c5e0e34c84'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:37.480485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d2f7e2b6-495c-4efa-b585-b27009e3fc03 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f60c8a4819f64ee7b88288c5e0e34c84'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:37.481209 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d2f7e2b6-495c-4efa-b585-b27009e3fc03 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f60c8a4819f64ee7b88288c5e0e34c84'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:37.500314 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d2f7e2b6-495c-4efa-b585-b27009e3fc03 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f60c8a4819f64ee7b88288c5e0e34c84'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:37.524225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1029/2016] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:37 2022] DELETE /identity/v3/users/f60c8a4819f64ee7b88288c5e0e34c84 => generated 0 bytes in 207 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:37.831983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:37.834077 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:37.864886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-012bf7d3-04a8-4c58-9bc4-43581d6a82b9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:37.941465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69fd71e0-a3fa-4329-9328-ad3e05dcc533 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:37.942557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd71e0-a3fa-4329-9328-ad3e05dcc533 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:37.942861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd71e0-a3fa-4329-9328-ad3e05dcc533 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:37.943359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69fd71e0-a3fa-4329-9328-ad3e05dcc533 admin admin] PATH_INFO: `/v3/projects/e9ee70e75bf34d0bbf68603b7e589171` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:37.944693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd71e0-a3fa-4329-9328-ad3e05dcc533 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e9ee70e75bf34d0bbf68603b7e589171)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:37.946800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69fd71e0-a3fa-4329-9328-ad3e05dcc533 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:38.010980 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-69fd71e0-a3fa-4329-9328-ad3e05dcc533 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e9ee70e75bf34d0bbf68603b7e589171', 'request_id': 'req-69fd71e0-a3fa-4329-9328-ad3e05dcc533'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:38.021802 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-69fd71e0-a3fa-4329-9328-ad3e05dcc533 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e9ee70e75bf34d0bbf68603b7e589171', 'request_id': 'req-69fd71e0-a3fa-4329-9328-ad3e05dcc533'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:38.034286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-69fd71e0-a3fa-4329-9328-ad3e05dcc533 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e9ee70e75bf34d0bbf68603b7e589171', 'request_id': 'req-69fd71e0-a3fa-4329-9328-ad3e05dcc533'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:38.049707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-69fd71e0-a3fa-4329-9328-ad3e05dcc533 admin admin] The token cache is being invalidate because project e9ee70e75bf34d0bbf68603b7e589171 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:38.050061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-69fd71e0-a3fa-4329-9328-ad3e05dcc533 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:38.050878 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-69fd71e0-a3fa-4329-9328-ad3e05dcc533 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:38.053080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 988/2017] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:37 2022] DELETE /identity/v3/projects/e9ee70e75bf34d0bbf68603b7e589171 => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:38.058151 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60ad8a-21af-4369-8ad3-820cd3585c5c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:38.058609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60ad8a-21af-4369-8ad3-820cd3585c5c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:38.058887 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c60ad8a-21af-4369-8ad3-820cd3585c5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:38.082194 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3c60ad8a-21af-4369-8ad3-820cd3585c5c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:38.083490 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3c60ad8a-21af-4369-8ad3-820cd3585c5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:38.167877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1030/2018] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:38.177222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcce4e-55be-4a4e-8728-6cd9810b0269 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:38.177634 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcce4e-55be-4a4e-8728-6cd9810b0269 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:38.178021 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35fcce4e-55be-4a4e-8728-6cd9810b0269 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:38.197405 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-35fcce4e-55be-4a4e-8728-6cd9810b0269 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:38.198779 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-35fcce4e-55be-4a4e-8728-6cd9810b0269 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:38.207914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 989/2019] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:38.212306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60ad8a-21af-4369-8ad3-820cd3585c5c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:38.223488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c60ad8a-21af-4369-8ad3-820cd3585c5c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:38.229681 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc20a0-f4da-4db5-948e-f43b630ec2c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:38.230641 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc20a0-f4da-4db5-948e-f43b630ec2c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:38.230998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc20a0-f4da-4db5-948e-f43b630ec2c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:38.231343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cc20a0-f4da-4db5-948e-f43b630ec2c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:38.232152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc20a0-f4da-4db5-948e-f43b630ec2c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:38.232656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc20a0-f4da-4db5-948e-f43b630ec2c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:38.235286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98cc20a0-f4da-4db5-948e-f43b630ec2c6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:38.254334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1031/2020] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:38.255367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcce4e-55be-4a4e-8728-6cd9810b0269 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:38.267006 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35fcce4e-55be-4a4e-8728-6cd9810b0269 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:38.272535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a7e81-1c9b-4208-8851-fc00e62bd793 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:38.273273 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a7e81-1c9b-4208-8851-fc00e62bd793 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:38.273575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a7e81-1c9b-4208-8851-fc00e62bd793 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:38.273866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5a7e81-1c9b-4208-8851-fc00e62bd793 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:38.274617 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a7e81-1c9b-4208-8851-fc00e62bd793 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:38.276608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5a7e81-1c9b-4208-8851-fc00e62bd793 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:38.305213 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 990/2021] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:38 2022] POST /identity/v3/projects => generated 373 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:38.309431 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc20a0-f4da-4db5-948e-f43b630ec2c6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:38.319129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98cc20a0-f4da-4db5-948e-f43b630ec2c6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:38.406234 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925dc9f-3c3a-4d53-8882-285355b08667 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:38.406912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925dc9f-3c3a-4d53-8882-285355b08667 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:38.407330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925dc9f-3c3a-4d53-8882-285355b08667 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:38.407609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2925dc9f-3c3a-4d53-8882-285355b08667 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:38.408303 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925dc9f-3c3a-4d53-8882-285355b08667 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:38.410241 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2925dc9f-3c3a-4d53-8882-285355b08667 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:38.432462 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=86,keystone:DELETE=10,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:38.447591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a7e81-1c9b-4208-8851-fc00e62bd793 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:38.447950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1032/2022] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:38 2022] POST /identity/v3/users => generated 287 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:38.461364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5a7e81-1c9b-4208-8851-fc00e62bd793 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:38.467504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a660e9-4953-4221-b75b-fb9aea825872 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:38.469182 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a660e9-4953-4221-b75b-fb9aea825872 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:38.469585 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a660e9-4953-4221-b75b-fb9aea825872 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:38.470220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a660e9-4953-4221-b75b-fb9aea825872 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:38.475606 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a660e9-4953-4221-b75b-fb9aea825872 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:38.477682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79a660e9-4953-4221-b75b-fb9aea825872 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:38.490539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 991/2023] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:38.494560 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925dc9f-3c3a-4d53-8882-285355b08667 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:38.507216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2925dc9f-3c3a-4d53-8882-285355b08667 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:38.512764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15cbdd25-261b-41e7-a5b7-17a329911129 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:38.513505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbdd25-261b-41e7-a5b7-17a329911129 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:38.513790 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbdd25-261b-41e7-a5b7-17a329911129 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:38.514073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15cbdd25-261b-41e7-a5b7-17a329911129 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:38.515429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbdd25-261b-41e7-a5b7-17a329911129 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:38.517264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15cbdd25-261b-41e7-a5b7-17a329911129 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:38.539460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1033/2024] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:38 2022] GET /identity/v3/roles => generated 1420 bytes in 42 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:38.540814 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a660e9-4953-4221-b75b-fb9aea825872 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:38.550869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a660e9-4953-4221-b75b-fb9aea825872 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:38.555501 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137ee8d-7579-4971-b838-89abf3a71099 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:38.556382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137ee8d-7579-4971-b838-89abf3a71099 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:38.556666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137ee8d-7579-4971-b838-89abf3a71099 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:38.556943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1137ee8d-7579-4971-b838-89abf3a71099 admin admin] PATH_INFO: `/v3/projects/fdd45fd8330547218c8f236b7df95da3/users/b59318e8ff1d4d24aa7a89ab6ece16c5/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:38.559299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:38.575381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137ee8d-7579-4971-b838-89abf3a71099 admin admin] RBAC: Authorizing `identity:create_grant(project_id=fdd45fd8330547218c8f236b7df95da3, user_id=b59318e8ff1d4d24aa7a89ab6ece16c5, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:38.578824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1137ee8d-7579-4971-b838-89abf3a71099 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:38.592425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 992/2025] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:38 2022] PUT /identity/v3/projects/fdd45fd8330547218c8f236b7df95da3/users/b59318e8ff1d4d24aa7a89ab6ece16c5/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:38.603637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5199b-f586-4cb1-8cf8-865d9fdd9184 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:38.604315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5199b-f586-4cb1-8cf8-865d9fdd9184 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:38.604699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3c5199b-f586-4cb1-8cf8-865d9fdd9184 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:38.634243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b3c5199b-f586-4cb1-8cf8-865d9fdd9184 None None] MFA Rules not processed for user `b59318e8ff1d4d24aa7a89ab6ece16c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:38.635466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b3c5199b-f586-4cb1-8cf8-865d9fdd9184 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:38.700779 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1034/2026] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:38 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:38.713094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137ee8d-7579-4971-b838-89abf3a71099 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:38.714832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1137ee8d-7579-4971-b838-89abf3a71099 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:38.775127 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1137ee8d-7579-4971-b838-89abf3a71099 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:38.784688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-927d3096-c8f7-487a-aee9-07c899f36570 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:38.786274 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d3096-c8f7-487a-aee9-07c899f36570 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:38.786739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d3096-c8f7-487a-aee9-07c899f36570 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:38.787225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-927d3096-c8f7-487a-aee9-07c899f36570 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:38.798524 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d3096-c8f7-487a-aee9-07c899f36570 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:38.800000 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-927d3096-c8f7-487a-aee9-07c899f36570 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:38.809793 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 993/2027] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:38 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:38.835965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5199b-f586-4cb1-8cf8-865d9fdd9184 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:38.902682 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3c5199b-f586-4cb1-8cf8-865d9fdd9184 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:38.907660 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8bd16-bfa1-4080-bc5f-3e4c1d3d79a2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:38.908528 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8bd16-bfa1-4080-bc5f-3e4c1d3d79a2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:38.908813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8bd16-bfa1-4080-bc5f-3e4c1d3d79a2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:38.909120 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd8bd16-bfa1-4080-bc5f-3e4c1d3d79a2 admin admin] PATH_INFO: `/v3/users/b59318e8ff1d4d24aa7a89ab6ece16c5` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:38.910324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8bd16-bfa1-4080-bc5f-3e4c1d3d79a2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=b59318e8ff1d4d24aa7a89ab6ece16c5)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:38.912298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd8bd16-bfa1-4080-bc5f-3e4c1d3d79a2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:38.956441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9bd8bd16-bfa1-4080-bc5f-3e4c1d3d79a2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b59318e8ff1d4d24aa7a89ab6ece16c5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:38.957133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9bd8bd16-bfa1-4080-bc5f-3e4c1d3d79a2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b59318e8ff1d4d24aa7a89ab6ece16c5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:38.964162 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9bd8bd16-bfa1-4080-bc5f-3e4c1d3d79a2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b59318e8ff1d4d24aa7a89ab6ece16c5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:38.964807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9bd8bd16-bfa1-4080-bc5f-3e4c1d3d79a2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b59318e8ff1d4d24aa7a89ab6ece16c5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:38.977155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9bd8bd16-bfa1-4080-bc5f-3e4c1d3d79a2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b59318e8ff1d4d24aa7a89ab6ece16c5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:38.981263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:38.992575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1035/2028] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:38 2022] DELETE /identity/v3/users/b59318e8ff1d4d24aa7a89ab6ece16c5 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:38.997241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828b85-b91c-43df-a435-16ebf6d65782 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:38.997701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828b85-b91c-43df-a435-16ebf6d65782 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:38.997858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3828b85-b91c-43df-a435-16ebf6d65782 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:39.016407 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a3828b85-b91c-43df-a435-16ebf6d65782 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:39.017638 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a3828b85-b91c-43df-a435-16ebf6d65782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:39.076529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 994/2029] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:39.086554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8bd16-bfa1-4080-bc5f-3e4c1d3d79a2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:39.088038 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9bd8bd16-bfa1-4080-bc5f-3e4c1d3d79a2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:39.153419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd8bd16-bfa1-4080-bc5f-3e4c1d3d79a2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:39.157091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e0e44-0abe-44fc-b0f3-81a2e3231fb8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:39.157768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e0e44-0abe-44fc-b0f3-81a2e3231fb8 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:39.158015 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e0e44-0abe-44fc-b0f3-81a2e3231fb8 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:39.158296 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af4e0e44-0abe-44fc-b0f3-81a2e3231fb8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:39.167795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e0e44-0abe-44fc-b0f3-81a2e3231fb8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:39.169257 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af4e0e44-0abe-44fc-b0f3-81a2e3231fb8 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:39.179800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1036/2030] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:39 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:39.509645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3828b85-b91c-43df-a435-16ebf6d65782 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:39.512816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a3828b85-b91c-43df-a435-16ebf6d65782 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:39.539031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3828b85-b91c-43df-a435-16ebf6d65782 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:39.548849 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10ef687c-313d-46bb-b87f-06fb0943fbae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:39.549765 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef687c-313d-46bb-b87f-06fb0943fbae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:39.550075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef687c-313d-46bb-b87f-06fb0943fbae admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:39.550438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10ef687c-313d-46bb-b87f-06fb0943fbae admin admin] PATH_INFO: `/v3/projects/fdd45fd8330547218c8f236b7df95da3` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:39.552464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef687c-313d-46bb-b87f-06fb0943fbae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fdd45fd8330547218c8f236b7df95da3)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:39.554455 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10ef687c-313d-46bb-b87f-06fb0943fbae admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:39.664112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e0e44-0abe-44fc-b0f3-81a2e3231fb8 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:39.665889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-af4e0e44-0abe-44fc-b0f3-81a2e3231fb8 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:39.696719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10ef687c-313d-46bb-b87f-06fb0943fbae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fdd45fd8330547218c8f236b7df95da3', 'request_id': 'req-10ef687c-313d-46bb-b87f-06fb0943fbae'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:39.707357 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af4e0e44-0abe-44fc-b0f3-81a2e3231fb8 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:39.714017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10ef687c-313d-46bb-b87f-06fb0943fbae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fdd45fd8330547218c8f236b7df95da3', 'request_id': 'req-10ef687c-313d-46bb-b87f-06fb0943fbae'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:39.728209 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10ef687c-313d-46bb-b87f-06fb0943fbae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fdd45fd8330547218c8f236b7df95da3', 'request_id': 'req-10ef687c-313d-46bb-b87f-06fb0943fbae'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:39.751859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10ef687c-313d-46bb-b87f-06fb0943fbae admin admin] The token cache is being invalidate because project fdd45fd8330547218c8f236b7df95da3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:39.752214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10ef687c-313d-46bb-b87f-06fb0943fbae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:39.769968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10ef687c-313d-46bb-b87f-06fb0943fbae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:39.775863 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 995/2031] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:39 2022] DELETE /identity/v3/projects/fdd45fd8330547218c8f236b7df95da3 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:39.781175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba536cc6-300b-400f-a7de-62a89798d7d8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:39.781475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba536cc6-300b-400f-a7de-62a89798d7d8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:39.781746 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba536cc6-300b-400f-a7de-62a89798d7d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:39.848978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ba536cc6-300b-400f-a7de-62a89798d7d8 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:39.851664 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ba536cc6-300b-400f-a7de-62a89798d7d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:39.864358 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:39.888000 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f261b0e7-2eb6-40d2-88d5-4aa9a861a229 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:39.889329 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261b0e7-2eb6-40d2-88d5-4aa9a861a229 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:39.890520 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261b0e7-2eb6-40d2-88d5-4aa9a861a229 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:39.891052 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f261b0e7-2eb6-40d2-88d5-4aa9a861a229 admin admin] PATH_INFO: `/v3/users/86f148cfd1704d3e8758ae83b64b3176` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:39.895750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261b0e7-2eb6-40d2-88d5-4aa9a861a229 admin admin] RBAC: Authorizing `identity:delete_user(user_id=86f148cfd1704d3e8758ae83b64b3176)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:39.899437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f261b0e7-2eb6-40d2-88d5-4aa9a861a229 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:40.019580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f261b0e7-2eb6-40d2-88d5-4aa9a861a229 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '86f148cfd1704d3e8758ae83b64b3176'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:40.020617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f261b0e7-2eb6-40d2-88d5-4aa9a861a229 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '86f148cfd1704d3e8758ae83b64b3176'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:40.033028 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 996/2032] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:39 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 253 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:40.034464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bae5b-8a4b-40e7-bedc-0e60b39a69b8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:40.035253 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bae5b-8a4b-40e7-bedc-0e60b39a69b8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:40.035664 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e58bae5b-8a4b-40e7-bedc-0e60b39a69b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:40.035952 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f261b0e7-2eb6-40d2-88d5-4aa9a861a229 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '86f148cfd1704d3e8758ae83b64b3176'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:40.036746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f261b0e7-2eb6-40d2-88d5-4aa9a861a229 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '86f148cfd1704d3e8758ae83b64b3176'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:40.066735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e58bae5b-8a4b-40e7-bedc-0e60b39a69b8 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:40.068269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e58bae5b-8a4b-40e7-bedc-0e60b39a69b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:40.068580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f261b0e7-2eb6-40d2-88d5-4aa9a861a229 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '86f148cfd1704d3e8758ae83b64b3176'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:40.087910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1037/2033] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:39 2022] DELETE /identity/v3/users/86f148cfd1704d3e8758ae83b64b3176 => generated 0 bytes in 424 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:40.090150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 997/2034] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:40.092709 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434438b-8df0-4663-a12e-b28e267ba0ef None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:40.094137 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bae5b-8a4b-40e7-bedc-0e60b39a69b8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:40.097212 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434438b-8df0-4663-a12e-b28e267ba0ef None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:40.097529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8434438b-8df0-4663-a12e-b28e267ba0ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:40.103429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e58bae5b-8a4b-40e7-bedc-0e60b39a69b8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:40.116258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8434438b-8df0-4663-a12e-b28e267ba0ef None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:40.117571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8434438b-8df0-4663-a12e-b28e267ba0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:40.131385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:40.183926 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0de29-f56f-47cd-aded-8e5b4f598bac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:40.184691 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0de29-f56f-47cd-aded-8e5b4f598bac admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:40.184996 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0de29-f56f-47cd-aded-8e5b4f598bac admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:40.185428 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb0de29-f56f-47cd-aded-8e5b4f598bac admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:40.186255 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0de29-f56f-47cd-aded-8e5b4f598bac admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:40.187102 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0de29-f56f-47cd-aded-8e5b4f598bac admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:40.188849 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb0de29-f56f-47cd-aded-8e5b4f598bac admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:40.212610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 998/2035] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 119 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:40.217844 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0de29-f56f-47cd-aded-8e5b4f598bac admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:40.237068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1038/2036] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:40.241473 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb0de29-f56f-47cd-aded-8e5b4f598bac admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:40.242929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434438b-8df0-4663-a12e-b28e267ba0ef None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:40.244499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8434438b-8df0-4663-a12e-b28e267ba0ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:40.246102 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbefe1-c0bd-4741-a633-1d3588851aa3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:40.246976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbefe1-c0bd-4741-a633-1d3588851aa3 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:40.247477 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbefe1-c0bd-4741-a633-1d3588851aa3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:40.247965 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3dbefe1-c0bd-4741-a633-1d3588851aa3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:40.249703 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbefe1-c0bd-4741-a633-1d3588851aa3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:40.253370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3dbefe1-c0bd-4741-a633-1d3588851aa3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:40.288704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 999/2037] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:40 2022] POST /identity/v3/projects => generated 399 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:40.294481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbefe1-c0bd-4741-a633-1d3588851aa3 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:40.311039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8434438b-8df0-4663-a12e-b28e267ba0ef None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:40.366901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c479291-8acc-41b9-95a0-378a2c757b71 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:40.367175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3dbefe1-c0bd-4741-a633-1d3588851aa3 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:40.367755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c479291-8acc-41b9-95a0-378a2c757b71 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:40.368044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c479291-8acc-41b9-95a0-378a2c757b71 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:40.368315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c479291-8acc-41b9-95a0-378a2c757b71 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:40.372366 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17b2c7-a000-4a47-a539-4878f2eb3f36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:40.373228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17b2c7-a000-4a47-a539-4878f2eb3f36 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:40.373589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17b2c7-a000-4a47-a539-4878f2eb3f36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:40.374465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c17b2c7-a000-4a47-a539-4878f2eb3f36 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:40.375242 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17b2c7-a000-4a47-a539-4878f2eb3f36 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:40.377273 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c17b2c7-a000-4a47-a539-4878f2eb3f36 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:40.379607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c479291-8acc-41b9-95a0-378a2c757b71 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:40.381328 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c479291-8acc-41b9-95a0-378a2c757b71 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:40.393332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1039/2038] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:40.414747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1000/2039] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:40 2022] POST /identity/v3/users => generated 300 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:40.419383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c479291-8acc-41b9-95a0-378a2c757b71 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:40.432664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c479291-8acc-41b9-95a0-378a2c757b71 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:40.445327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b7452-f45a-4e40-a086-0b6ddcb42eed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:40.446033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b7452-f45a-4e40-a086-0b6ddcb42eed admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:40.446319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b7452-f45a-4e40-a086-0b6ddcb42eed admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:40.447235 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a71b7452-f45a-4e40-a086-0b6ddcb42eed admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:40.447989 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b7452-f45a-4e40-a086-0b6ddcb42eed admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:40.449748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a71b7452-f45a-4e40-a086-0b6ddcb42eed admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:40.466460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17b2c7-a000-4a47-a539-4878f2eb3f36 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:40.473539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:40.478251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1040/2040] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 49 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:40.480764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c17b2c7-a000-4a47-a539-4878f2eb3f36 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:40.490112 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46386f08-2b42-44a2-a781-3303b0f64baa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:40.490837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46386f08-2b42-44a2-a781-3303b0f64baa admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:40.491562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46386f08-2b42-44a2-a781-3303b0f64baa admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:40.492229 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46386f08-2b42-44a2-a781-3303b0f64baa admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:40.492968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46386f08-2b42-44a2-a781-3303b0f64baa admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:40.494712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46386f08-2b42-44a2-a781-3303b0f64baa admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:40.506707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1001/2041] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:40 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:40.510876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b7452-f45a-4e40-a086-0b6ddcb42eed admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:40.522166 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a71b7452-f45a-4e40-a086-0b6ddcb42eed admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:40.527043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf38fda-4286-4c85-903f-6753fb0d2119 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:40.527919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf38fda-4286-4c85-903f-6753fb0d2119 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:40.528208 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf38fda-4286-4c85-903f-6753fb0d2119 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:40.528480 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf38fda-4286-4c85-903f-6753fb0d2119 admin admin] PATH_INFO: `/v3/projects/c80783d394454944841e56f0077c5474/users/a4f95703464a41058765d0c0eec3fa07/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:40.550617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf38fda-4286-4c85-903f-6753fb0d2119 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c80783d394454944841e56f0077c5474, user_id=a4f95703464a41058765d0c0eec3fa07, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:40.553709 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf38fda-4286-4c85-903f-6753fb0d2119 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:40.571578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1041/2042] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:40 2022] PUT /identity/v3/projects/c80783d394454944841e56f0077c5474/users/a4f95703464a41058765d0c0eec3fa07/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:40.583197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713abd9e-0611-41b5-998e-d0d6463da493 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:40.583197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713abd9e-0611-41b5-998e-d0d6463da493 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:40.583197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713abd9e-0611-41b5-998e-d0d6463da493 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:40.623508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-713abd9e-0611-41b5-998e-d0d6463da493 None None] MFA Rules not processed for user `a4f95703464a41058765d0c0eec3fa07`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:40.626806 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-713abd9e-0611-41b5-998e-d0d6463da493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:40.727328 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1002/2043] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:40 2022] POST /identity/v3/auth/tokens => generated 3266 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:40.737387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf38fda-4286-4c85-903f-6753fb0d2119 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:40.739983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-adf38fda-4286-4c85-903f-6753fb0d2119 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:40.801314 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:40.819054 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf38fda-4286-4c85-903f-6753fb0d2119 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:40.828613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04039a-50ce-4ed7-a91f-980c7a23f2d1 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:40.830021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04039a-50ce-4ed7-a91f-980c7a23f2d1 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:40.830576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04039a-50ce-4ed7-a91f-980c7a23f2d1 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:40.831076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a04039a-50ce-4ed7-a91f-980c7a23f2d1 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:40.850233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04039a-50ce-4ed7-a91f-980c7a23f2d1 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:40.852069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a04039a-50ce-4ed7-a91f-980c7a23f2d1 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:40.879502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1042/2044] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:40 2022] GET /identity/v3/auth/tokens => generated 3266 bytes in 142 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:41.079889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713abd9e-0611-41b5-998e-d0d6463da493 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:41.081472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-713abd9e-0611-41b5-998e-d0d6463da493 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:41.212443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713abd9e-0611-41b5-998e-d0d6463da493 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:41.217813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:41.218894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:41.219249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:41.219604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] PATH_INFO: `/v3/projects/e25f06fec2244e75b7558ef7c6727d3c` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:41.221193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] RBAC: Authorizing `identity:delete_project(project_id=e25f06fec2244e75b7558ef7c6727d3c)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:41.223250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:41.335750 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'e25f06fec2244e75b7558ef7c6727d3c', 'request_id': 'req-1ec94fbd-d669-4a67-ab10-dd23a1079a80'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:41.361500 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'e25f06fec2244e75b7558ef7c6727d3c', 'request_id': 'req-1ec94fbd-d669-4a67-ab10-dd23a1079a80'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:41.369385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'e25f06fec2244e75b7558ef7c6727d3c', 'request_id': 'req-1ec94fbd-d669-4a67-ab10-dd23a1079a80'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:41.395590 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] The token cache is being invalidate because project e25f06fec2244e75b7558ef7c6727d3c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:41.395987 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:41.397367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:41.402363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1003/2045] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:41 2022] DELETE /identity/v3/projects/e25f06fec2244e75b7558ef7c6727d3c => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:41.409788 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04039a-50ce-4ed7-a91f-980c7a23f2d1 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:41.424233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a04039a-50ce-4ed7-a91f-980c7a23f2d1 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:41.516857 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7cd45-45f3-449d-af9a-364dc46b1d5f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:41.518120 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7cd45-45f3-449d-af9a-364dc46b1d5f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:41.518329 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7cd45-45f3-449d-af9a-364dc46b1d5f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:41.518849 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bde7cd45-45f3-449d-af9a-364dc46b1d5f admin admin] PATH_INFO: `/v3/users/01085cf98416461db010939043bec7c7` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:41.520499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7cd45-45f3-449d-af9a-364dc46b1d5f admin admin] RBAC: Authorizing `identity:delete_user(user_id=01085cf98416461db010939043bec7c7)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:41.524173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bde7cd45-45f3-449d-af9a-364dc46b1d5f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:41.610588 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bde7cd45-45f3-449d-af9a-364dc46b1d5f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '01085cf98416461db010939043bec7c7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:41.611357 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bde7cd45-45f3-449d-af9a-364dc46b1d5f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '01085cf98416461db010939043bec7c7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:41.630684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bde7cd45-45f3-449d-af9a-364dc46b1d5f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '01085cf98416461db010939043bec7c7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:41.631470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bde7cd45-45f3-449d-af9a-364dc46b1d5f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '01085cf98416461db010939043bec7c7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:41.650201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bde7cd45-45f3-449d-af9a-364dc46b1d5f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '01085cf98416461db010939043bec7c7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:41.681661 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1043/2046] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:41 2022] DELETE /identity/v3/users/01085cf98416461db010939043bec7c7 => generated 0 bytes in 275 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:42.219855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:42.222131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:42.243408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec94fbd-d669-4a67-ab10-dd23a1079a80 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:42.258882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:42.341805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adc1947f-bce6-491e-a13b-7876c9c845e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:42.343318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1947f-bce6-491e-a13b-7876c9c845e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:42.343681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1947f-bce6-491e-a13b-7876c9c845e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:42.344028 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adc1947f-bce6-491e-a13b-7876c9c845e4 admin admin] PATH_INFO: `/v3/projects/0a7d43de21024a8786413efb7d800116` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:42.345427 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1947f-bce6-491e-a13b-7876c9c845e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0a7d43de21024a8786413efb7d800116)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:42.347430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adc1947f-bce6-491e-a13b-7876c9c845e4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:42.397261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7cd45-45f3-449d-af9a-364dc46b1d5f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:42.398897 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bde7cd45-45f3-449d-af9a-364dc46b1d5f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:42.414204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bde7cd45-45f3-449d-af9a-364dc46b1d5f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:42.440361 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0dd0271-d138-4cc8-bd34-1eb0290f937f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:42.441370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd0271-d138-4cc8-bd34-1eb0290f937f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:42.442145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd0271-d138-4cc8-bd34-1eb0290f937f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:42.442145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0dd0271-d138-4cc8-bd34-1eb0290f937f admin admin] PATH_INFO: `/v3/users/cd2e7d9722f543f98006b05fcffd3b6e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:42.443878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd0271-d138-4cc8-bd34-1eb0290f937f admin admin] RBAC: Authorizing `identity:delete_user(user_id=cd2e7d9722f543f98006b05fcffd3b6e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:42.446035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0dd0271-d138-4cc8-bd34-1eb0290f937f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:42.479798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-adc1947f-bce6-491e-a13b-7876c9c845e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0a7d43de21024a8786413efb7d800116', 'request_id': 'req-adc1947f-bce6-491e-a13b-7876c9c845e4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:42.490969 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-adc1947f-bce6-491e-a13b-7876c9c845e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0a7d43de21024a8786413efb7d800116', 'request_id': 'req-adc1947f-bce6-491e-a13b-7876c9c845e4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:42.499493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-adc1947f-bce6-491e-a13b-7876c9c845e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0a7d43de21024a8786413efb7d800116', 'request_id': 'req-adc1947f-bce6-491e-a13b-7876c9c845e4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:42.515893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-adc1947f-bce6-491e-a13b-7876c9c845e4 admin admin] The token cache is being invalidate because project 0a7d43de21024a8786413efb7d800116 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:42.516349 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-adc1947f-bce6-491e-a13b-7876c9c845e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:42.517289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e0dd0271-d138-4cc8-bd34-1eb0290f937f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'cd2e7d9722f543f98006b05fcffd3b6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:42.517412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-adc1947f-bce6-491e-a13b-7876c9c845e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:42.518574 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e0dd0271-d138-4cc8-bd34-1eb0290f937f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'cd2e7d9722f543f98006b05fcffd3b6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:42.519569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1004/2047] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:42 2022] DELETE /identity/v3/projects/0a7d43de21024a8786413efb7d800116 => generated 0 bytes in 300 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:42.525565 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f789-ac99-4eb0-be2e-0fe9fe0a0db0 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:42.525927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f789-ac99-4eb0-be2e-0fe9fe0a0db0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:42.526265 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5f8f789-ac99-4eb0-be2e-0fe9fe0a0db0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:42.527451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e0dd0271-d138-4cc8-bd34-1eb0290f937f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'cd2e7d9722f543f98006b05fcffd3b6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:42.529482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e0dd0271-d138-4cc8-bd34-1eb0290f937f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'cd2e7d9722f543f98006b05fcffd3b6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:42.532108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=82,keystone:DELETE=17,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:42.547342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e0dd0271-d138-4cc8-bd34-1eb0290f937f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'cd2e7d9722f543f98006b05fcffd3b6e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:42.549986 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b5f8f789-ac99-4eb0-be2e-0fe9fe0a0db0 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:42.553171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b5f8f789-ac99-4eb0-be2e-0fe9fe0a0db0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:42.577504 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1044/2048] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:42 2022] DELETE /identity/v3/users/cd2e7d9722f543f98006b05fcffd3b6e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:42.582144 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c104f2-4714-40e0-b26c-0e1ae6b45105 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:42.582807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c104f2-4714-40e0-b26c-0e1ae6b45105 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:42.583782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19c104f2-4714-40e0-b26c-0e1ae6b45105 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:42.608076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-19c104f2-4714-40e0-b26c-0e1ae6b45105 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:42.609644 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-19c104f2-4714-40e0-b26c-0e1ae6b45105 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:42.672218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1005/2049] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:42.680965 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef4eec-c429-4429-aba9-1717718ac1a0 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:42.681361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef4eec-c429-4429-aba9-1717718ac1a0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:42.681735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ef4eec-c429-4429-aba9-1717718ac1a0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:42.704387 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b4ef4eec-c429-4429-aba9-1717718ac1a0 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:42.706131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b4ef4eec-c429-4429-aba9-1717718ac1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:42.710457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1045/2050] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:42.716115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1006/2051] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:42.721337 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef4eec-c429-4429-aba9-1717718ac1a0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:42.721509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c104f2-4714-40e0-b26c-0e1ae6b45105 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:42.723071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b4ef4eec-c429-4429-aba9-1717718ac1a0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:42.739884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19c104f2-4714-40e0-b26c-0e1ae6b45105 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:42.746977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e7ab2-5cd7-4d1e-af2e-f4fc57e4064d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:42.747658 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e7ab2-5cd7-4d1e-af2e-f4fc57e4064d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:42.747945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e7ab2-5cd7-4d1e-af2e-f4fc57e4064d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:42.748227 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35e7ab2-5cd7-4d1e-af2e-f4fc57e4064d admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:42.749535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e7ab2-5cd7-4d1e-af2e-f4fc57e4064d admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:42.749848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e7ab2-5cd7-4d1e-af2e-f4fc57e4064d admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:42.751491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b35e7ab2-5cd7-4d1e-af2e-f4fc57e4064d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:42.780690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1046/2052] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 55 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:42.784660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:42.792926 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e7ab2-5cd7-4d1e-af2e-f4fc57e4064d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:42.809907 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ef4eec-c429-4429-aba9-1717718ac1a0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:42.815864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f7f8d-13f2-4950-9a7f-ec3930d93ebf service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:42.816539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f7f8d-13f2-4950-9a7f-ec3930d93ebf service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:42.816823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f7f8d-13f2-4950-9a7f-ec3930d93ebf service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:42.817133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf7f7f8d-13f2-4950-9a7f-ec3930d93ebf service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:42.821166 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35e7ab2-5cd7-4d1e-af2e-f4fc57e4064d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:42.830017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f7f8d-13f2-4950-9a7f-ec3930d93ebf service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:42.832257 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7a5c2-5c57-42cb-9c9b-38fc0095dbee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:42.833563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7a5c2-5c57-42cb-9c9b-38fc0095dbee admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:42.834066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7a5c2-5c57-42cb-9c9b-38fc0095dbee admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:42.834311 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30d7a5c2-5c57-42cb-9c9b-38fc0095dbee admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:42.835051 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf7f7f8d-13f2-4950-9a7f-ec3930d93ebf service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:42.835181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7a5c2-5c57-42cb-9c9b-38fc0095dbee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:42.837516 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30d7a5c2-5c57-42cb-9c9b-38fc0095dbee admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:42.852452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1007/2053] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:42.912210 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1047/2054] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:42 2022] POST /identity/v3/projects => generated 371 bytes in 121 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:42.916555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f7f8d-13f2-4950-9a7f-ec3930d93ebf service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:42.928567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf7f7f8d-13f2-4950-9a7f-ec3930d93ebf service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:43.070313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d935acf-98e9-4c3d-80dc-b972e8909928 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:43.072569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d935acf-98e9-4c3d-80dc-b972e8909928 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:43.072760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d935acf-98e9-4c3d-80dc-b972e8909928 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:43.073113 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d935acf-98e9-4c3d-80dc-b972e8909928 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:43.074229 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d935acf-98e9-4c3d-80dc-b972e8909928 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:43.076191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d935acf-98e9-4c3d-80dc-b972e8909928 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:43.116543 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7a5c2-5c57-42cb-9c9b-38fc0095dbee admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:43.117798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1008/2055] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:42 2022] POST /identity/v3/users => generated 286 bytes in 201 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:43.137309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30d7a5c2-5c57-42cb-9c9b-38fc0095dbee admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:43.144764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451fabe-7237-43e6-b304-7d686f5700b8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:43.146062 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451fabe-7237-43e6-b304-7d686f5700b8 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:43.146672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451fabe-7237-43e6-b304-7d686f5700b8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:43.147186 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3451fabe-7237-43e6-b304-7d686f5700b8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:43.148815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451fabe-7237-43e6-b304-7d686f5700b8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:43.151871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3451fabe-7237-43e6-b304-7d686f5700b8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:43.171648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1048/2056] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:43.173193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d935acf-98e9-4c3d-80dc-b972e8909928 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:43.192045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d935acf-98e9-4c3d-80dc-b972e8909928 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:43.209615 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cada71f2-f1a7-414e-a998-764ad14c1e81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:43.211459 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada71f2-f1a7-414e-a998-764ad14c1e81 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:43.211942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada71f2-f1a7-414e-a998-764ad14c1e81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:43.214313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cada71f2-f1a7-414e-a998-764ad14c1e81 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:43.214313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada71f2-f1a7-414e-a998-764ad14c1e81 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:43.215351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cada71f2-f1a7-414e-a998-764ad14c1e81 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:43.241561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1009/2057] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:43 2022] GET /identity/v3/roles => generated 1420 bytes in 68 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:43.244915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451fabe-7237-43e6-b304-7d686f5700b8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:43.257295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3451fabe-7237-43e6-b304-7d686f5700b8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:43.263711 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf28a87-364e-47b2-91df-8a5a8a7050ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:43.264900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf28a87-364e-47b2-91df-8a5a8a7050ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:43.265396 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf28a87-364e-47b2-91df-8a5a8a7050ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:43.265849 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccf28a87-364e-47b2-91df-8a5a8a7050ab admin admin] PATH_INFO: `/v3/projects/fa04870f6c474f058c8ad5807fe58ee8/users/eeabf32118c94a3091839933b6bbab37/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:43.286013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf28a87-364e-47b2-91df-8a5a8a7050ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=fa04870f6c474f058c8ad5807fe58ee8, user_id=eeabf32118c94a3091839933b6bbab37, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:43.289069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccf28a87-364e-47b2-91df-8a5a8a7050ab admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:43.306695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1049/2058] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:43 2022] PUT /identity/v3/projects/fa04870f6c474f058c8ad5807fe58ee8/users/eeabf32118c94a3091839933b6bbab37/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:43.318034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e586222-5ada-4307-90c5-c705ddf8aad0 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:43.318325 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e586222-5ada-4307-90c5-c705ddf8aad0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:43.318679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e586222-5ada-4307-90c5-c705ddf8aad0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:43.367240 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3e586222-5ada-4307-90c5-c705ddf8aad0 None None] MFA Rules not processed for user `eeabf32118c94a3091839933b6bbab37`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:43.369339 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3e586222-5ada-4307-90c5-c705ddf8aad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:43.468798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1010/2059] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:43 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 147 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:43.476785 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf28a87-364e-47b2-91df-8a5a8a7050ab admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:43.479341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ccf28a87-364e-47b2-91df-8a5a8a7050ab admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:43.566136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccf28a87-364e-47b2-91df-8a5a8a7050ab admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:43.577812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d256841b-95d3-4b74-a27d-192f39a81501 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:43.579072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256841b-95d3-4b74-a27d-192f39a81501 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:43.579571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256841b-95d3-4b74-a27d-192f39a81501 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:43.579827 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d256841b-95d3-4b74-a27d-192f39a81501 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:43.591254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256841b-95d3-4b74-a27d-192f39a81501 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:43.606229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d256841b-95d3-4b74-a27d-192f39a81501 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:43.633229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1050/2060] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:43 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 157 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:43.848115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e586222-5ada-4307-90c5-c705ddf8aad0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:43.849686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3e586222-5ada-4307-90c5-c705ddf8aad0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:43.990030 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:44.025147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e586222-5ada-4307-90c5-c705ddf8aad0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:44.032650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8095d6-274c-4b17-acfe-578d87434de9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:44.034277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8095d6-274c-4b17-acfe-578d87434de9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:44.034596 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8095d6-274c-4b17-acfe-578d87434de9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:44.034867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8095d6-274c-4b17-acfe-578d87434de9 admin admin] PATH_INFO: `/v3/projects/3c96df84104b4e4bbbd3e73ff2694764` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:44.043576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8095d6-274c-4b17-acfe-578d87434de9 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c96df84104b4e4bbbd3e73ff2694764)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:44.046137 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9c8095d6-274c-4b17-acfe-578d87434de9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:44.118560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9c8095d6-274c-4b17-acfe-578d87434de9 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c96df84104b4e4bbbd3e73ff2694764', 'request_id': 'req-9c8095d6-274c-4b17-acfe-578d87434de9'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:44.128104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9c8095d6-274c-4b17-acfe-578d87434de9 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c96df84104b4e4bbbd3e73ff2694764', 'request_id': 'req-9c8095d6-274c-4b17-acfe-578d87434de9'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:44.138451 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9c8095d6-274c-4b17-acfe-578d87434de9 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c96df84104b4e4bbbd3e73ff2694764', 'request_id': 'req-9c8095d6-274c-4b17-acfe-578d87434de9'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:44.157504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9c8095d6-274c-4b17-acfe-578d87434de9 admin admin] The token cache is being invalidate because project 3c96df84104b4e4bbbd3e73ff2694764 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:44.157959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9c8095d6-274c-4b17-acfe-578d87434de9 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:44.158715 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9c8095d6-274c-4b17-acfe-578d87434de9 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:44.162134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1011/2061] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:43 2022] DELETE /identity/v3/projects/3c96df84104b4e4bbbd3e73ff2694764 => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:44.165601 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebd85a-16da-421a-8e90-c5fb7eea33db None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:44.165894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebd85a-16da-421a-8e90-c5fb7eea33db None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:44.166178 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ebd85a-16da-421a-8e90-c5fb7eea33db None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:44.187679 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d6ebd85a-16da-421a-8e90-c5fb7eea33db None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:44.188928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d6ebd85a-16da-421a-8e90-c5fb7eea33db None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:44.193780 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:DELETE=3,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:44.256219 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1051/2062] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:44.263834 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9dabb-6bee-4361-a6aa-ed9e524166a8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:44.264864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9dabb-6bee-4361-a6aa-ed9e524166a8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:44.265073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98a9dabb-6bee-4361-a6aa-ed9e524166a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:44.283882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-98a9dabb-6bee-4361-a6aa-ed9e524166a8 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:44.285102 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-98a9dabb-6bee-4361-a6aa-ed9e524166a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:44.293424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1012/2063] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:44.297585 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebd85a-16da-421a-8e90-c5fb7eea33db None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:44.307133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ebd85a-16da-421a-8e90-c5fb7eea33db None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:44.311720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b52816-466f-4402-9c92-fa1245dfc629 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:44.312369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b52816-466f-4402-9c92-fa1245dfc629 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:44.312655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b52816-466f-4402-9c92-fa1245dfc629 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:44.312938 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65b52816-466f-4402-9c92-fa1245dfc629 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:44.313680 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b52816-466f-4402-9c92-fa1245dfc629 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:44.313990 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b52816-466f-4402-9c92-fa1245dfc629 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:44.315572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65b52816-466f-4402-9c92-fa1245dfc629 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:44.327992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1052/2064] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:44.331929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9dabb-6bee-4361-a6aa-ed9e524166a8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:44.344724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98a9dabb-6bee-4361-a6aa-ed9e524166a8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:44.351229 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719083b6-8125-46a4-bd97-7112f35874cb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:44.351892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719083b6-8125-46a4-bd97-7112f35874cb admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:44.352172 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719083b6-8125-46a4-bd97-7112f35874cb admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:44.352449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-719083b6-8125-46a4-bd97-7112f35874cb admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:44.353172 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719083b6-8125-46a4-bd97-7112f35874cb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:44.355386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-719083b6-8125-46a4-bd97-7112f35874cb admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:44.385832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1013/2065] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:44 2022] POST /identity/v3/projects => generated 383 bytes in 51 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:44.387101 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b52816-466f-4402-9c92-fa1245dfc629 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:44.398302 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65b52816-466f-4402-9c92-fa1245dfc629 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:44.457735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8141b31-55ac-4860-82b2-e8288c7cf359 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:44.458460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8141b31-55ac-4860-82b2-e8288c7cf359 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:44.458743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8141b31-55ac-4860-82b2-e8288c7cf359 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:44.459021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8141b31-55ac-4860-82b2-e8288c7cf359 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:44.459724 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8141b31-55ac-4860-82b2-e8288c7cf359 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:44.461838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8141b31-55ac-4860-82b2-e8288c7cf359 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:44.484138 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1053/2066] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:44 2022] POST /identity/v3/users => generated 292 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:44.488264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719083b6-8125-46a4-bd97-7112f35874cb admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:44.501984 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-719083b6-8125-46a4-bd97-7112f35874cb admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:44.506594 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55990c-bc25-4a11-9952-bf49903535b7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:44.507286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55990c-bc25-4a11-9952-bf49903535b7 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:44.507570 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55990c-bc25-4a11-9952-bf49903535b7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:44.507860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b55990c-bc25-4a11-9952-bf49903535b7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:44.508568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55990c-bc25-4a11-9952-bf49903535b7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:44.510373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b55990c-bc25-4a11-9952-bf49903535b7 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:44.521272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1014/2067] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:44.525177 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8141b31-55ac-4860-82b2-e8288c7cf359 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:44.535240 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8141b31-55ac-4860-82b2-e8288c7cf359 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:44.540260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fed715d-500c-47cb-90c9-6b6ba5225829 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:44.541242 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed715d-500c-47cb-90c9-6b6ba5225829 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:44.541643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed715d-500c-47cb-90c9-6b6ba5225829 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:44.541943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fed715d-500c-47cb-90c9-6b6ba5225829 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:44.542915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed715d-500c-47cb-90c9-6b6ba5225829 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:44.547243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fed715d-500c-47cb-90c9-6b6ba5225829 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:44.555819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1054/2068] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:44 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:44.560221 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55990c-bc25-4a11-9952-bf49903535b7 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:44.570918 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b55990c-bc25-4a11-9952-bf49903535b7 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:44.575723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5803a-1812-4df6-b864-566c50b3c949 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:44.576607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5803a-1812-4df6-b864-566c50b3c949 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:44.577433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5803a-1812-4df6-b864-566c50b3c949 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:44.577723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6e5803a-1812-4df6-b864-566c50b3c949 admin admin] PATH_INFO: `/v3/projects/3561965aadfe4f798d7f212063c603cd/users/14b096e168df4f5a9a45b1656e42c2c4/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:44.594037 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5803a-1812-4df6-b864-566c50b3c949 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3561965aadfe4f798d7f212063c603cd, user_id=14b096e168df4f5a9a45b1656e42c2c4, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:44.596729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6e5803a-1812-4df6-b864-566c50b3c949 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:44.610504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1015/2069] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:44 2022] PUT /identity/v3/projects/3561965aadfe4f798d7f212063c603cd/users/14b096e168df4f5a9a45b1656e42c2c4/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:44.620709 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f105c01-4dfe-4de1-9e17-329398a34c75 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:44.621024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f105c01-4dfe-4de1-9e17-329398a34c75 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:44.621307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f105c01-4dfe-4de1-9e17-329398a34c75 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:44.651724 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2f105c01-4dfe-4de1-9e17-329398a34c75 None None] MFA Rules not processed for user `14b096e168df4f5a9a45b1656e42c2c4`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:44.653004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2f105c01-4dfe-4de1-9e17-329398a34c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:44.661139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5803a-1812-4df6-b864-566c50b3c949 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:44.662831 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f6e5803a-1812-4df6-b864-566c50b3c949 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:44.726889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6e5803a-1812-4df6-b864-566c50b3c949 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:44.729154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1055/2070] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:44 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:44.733264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-245af52d-5829-4b1f-b3dd-5b98429025c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:44.733264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245af52d-5829-4b1f-b3dd-5b98429025c6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:44.733264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245af52d-5829-4b1f-b3dd-5b98429025c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:44.733264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-245af52d-5829-4b1f-b3dd-5b98429025c6 admin admin] PATH_INFO: `/v3/users/48414757f16040ef92828dc407b3d91f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:44.734482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245af52d-5829-4b1f-b3dd-5b98429025c6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=48414757f16040ef92828dc407b3d91f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:44.736445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-245af52d-5829-4b1f-b3dd-5b98429025c6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:44.740413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f105c01-4dfe-4de1-9e17-329398a34c75 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:44.741912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2f105c01-4dfe-4de1-9e17-329398a34c75 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:44.751149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:44.753485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:44.786129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-245af52d-5829-4b1f-b3dd-5b98429025c6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '48414757f16040ef92828dc407b3d91f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:44.794491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-245af52d-5829-4b1f-b3dd-5b98429025c6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '48414757f16040ef92828dc407b3d91f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:44.795227 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-245af52d-5829-4b1f-b3dd-5b98429025c6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '48414757f16040ef92828dc407b3d91f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:44.805199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f105c01-4dfe-4de1-9e17-329398a34c75 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:44.807770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-245af52d-5829-4b1f-b3dd-5b98429025c6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '48414757f16040ef92828dc407b3d91f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:44.808823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe70418-d369-4abc-a865-c30cc14fbcc7 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:44.809494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe70418-d369-4abc-a865-c30cc14fbcc7 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:44.809779 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe70418-d369-4abc-a865-c30cc14fbcc7 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:44.810057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe70418-d369-4abc-a865-c30cc14fbcc7 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:44.815850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-245af52d-5829-4b1f-b3dd-5b98429025c6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '48414757f16040ef92828dc407b3d91f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:44.820189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe70418-d369-4abc-a865-c30cc14fbcc7 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:44.821686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffe70418-d369-4abc-a865-c30cc14fbcc7 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:44.822588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1016/2071] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:44 2022] DELETE /identity/v3/users/48414757f16040ef92828dc407b3d91f => generated 0 bytes in 162 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:44.827455 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a611f9-bd07-4076-ad8a-76adcaceb8c9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:44.827880 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a611f9-bd07-4076-ad8a-76adcaceb8c9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:44.827993 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78a611f9-bd07-4076-ad8a-76adcaceb8c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:44.832616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1056/2072] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:44 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:22:44.846755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-78a611f9-bd07-4076-ad8a-76adcaceb8c9 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:44.847947 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-78a611f9-bd07-4076-ad8a-76adcaceb8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:44.910111 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1017/2073] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:44.919805 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe70418-d369-4abc-a865-c30cc14fbcc7 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:44.921798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ffe70418-d369-4abc-a865-c30cc14fbcc7 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:45.026198 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe70418-d369-4abc-a865-c30cc14fbcc7 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:45.139045 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e323c-9ba5-4cd2-9eda-db43ec99be5b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:45.145451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e323c-9ba5-4cd2-9eda-db43ec99be5b service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:45.145451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e323c-9ba5-4cd2-9eda-db43ec99be5b service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:45.145451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b0e323c-9ba5-4cd2-9eda-db43ec99be5b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:45.162944 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e323c-9ba5-4cd2-9eda-db43ec99be5b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:45.171969 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b0e323c-9ba5-4cd2-9eda-db43ec99be5b service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:45.194890 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1057/2074] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:44 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 276 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:45.620536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a611f9-bd07-4076-ad8a-76adcaceb8c9 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:45.621981 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-78a611f9-bd07-4076-ad8a-76adcaceb8c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:45.636176 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78a611f9-bd07-4076-ad8a-76adcaceb8c9 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:45.641514 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:45.642407 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:45.642689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:45.643163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] PATH_INFO: `/v3/projects/891959613a334dbab91893e04b7b1ad4` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:45.644373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] RBAC: Authorizing `identity:delete_project(project_id=891959613a334dbab91893e04b7b1ad4)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:45.646501 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:45.696695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '891959613a334dbab91893e04b7b1ad4', 'request_id': 'req-2822a1a2-9ed6-4b27-90a3-e7af6e901682'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.705694 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '891959613a334dbab91893e04b7b1ad4', 'request_id': 'req-2822a1a2-9ed6-4b27-90a3-e7af6e901682'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.711526 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '891959613a334dbab91893e04b7b1ad4', 'request_id': 'req-2822a1a2-9ed6-4b27-90a3-e7af6e901682'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.731260 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] The token cache is being invalidate because project 891959613a334dbab91893e04b7b1ad4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:45.731550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.732198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.733835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1018/2075] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:45 2022] DELETE /identity/v3/projects/891959613a334dbab91893e04b7b1ad4 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:45.737810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e323c-9ba5-4cd2-9eda-db43ec99be5b service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:45.747317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b0e323c-9ba5-4cd2-9eda-db43ec99be5b service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:45.787618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:45.789904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:45.812723 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9897d-1f62-40f6-84cb-7d4c355cf3d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:45.813817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9897d-1f62-40f6-84cb-7d4c355cf3d2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:45.814107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9897d-1f62-40f6-84cb-7d4c355cf3d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:45.814384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20f9897d-1f62-40f6-84cb-7d4c355cf3d2 admin admin] PATH_INFO: `/v3/users/8f6169b45f7b49b1a74f88984db379ab` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:45.815572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9897d-1f62-40f6-84cb-7d4c355cf3d2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8f6169b45f7b49b1a74f88984db379ab)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:45.817541 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20f9897d-1f62-40f6-84cb-7d4c355cf3d2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:45.818712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=16,keystone:SELECT=82,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:45.823637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:45.867547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-20f9897d-1f62-40f6-84cb-7d4c355cf3d2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8f6169b45f7b49b1a74f88984db379ab'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.868336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-20f9897d-1f62-40f6-84cb-7d4c355cf3d2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8f6169b45f7b49b1a74f88984db379ab'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.872279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2822a1a2-9ed6-4b27-90a3-e7af6e901682 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:45.876105 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-20f9897d-1f62-40f6-84cb-7d4c355cf3d2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8f6169b45f7b49b1a74f88984db379ab'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.876814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-20f9897d-1f62-40f6-84cb-7d4c355cf3d2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8f6169b45f7b49b1a74f88984db379ab'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.878592 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a3578-cd6b-43fb-a9fa-6b94370e9003 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:45.879660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a3578-cd6b-43fb-a9fa-6b94370e9003 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:45.880047 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a3578-cd6b-43fb-a9fa-6b94370e9003 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:45.880421 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f8a3578-cd6b-43fb-a9fa-6b94370e9003 admin admin] PATH_INFO: `/v3/users/f85ef7eb24b14d41a72e5e1ef0c96e70` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:45.881896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a3578-cd6b-43fb-a9fa-6b94370e9003 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85ef7eb24b14d41a72e5e1ef0c96e70)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:45.884419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f8a3578-cd6b-43fb-a9fa-6b94370e9003 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:45.892144 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-20f9897d-1f62-40f6-84cb-7d4c355cf3d2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8f6169b45f7b49b1a74f88984db379ab'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.910050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1058/2076] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:45 2022] DELETE /identity/v3/users/8f6169b45f7b49b1a74f88984db379ab => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:45.945645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5f8a3578-cd6b-43fb-a9fa-6b94370e9003 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85ef7eb24b14d41a72e5e1ef0c96e70'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.958237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5f8a3578-cd6b-43fb-a9fa-6b94370e9003 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85ef7eb24b14d41a72e5e1ef0c96e70'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.959341 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5f8a3578-cd6b-43fb-a9fa-6b94370e9003 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85ef7eb24b14d41a72e5e1ef0c96e70'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.981759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5f8a3578-cd6b-43fb-a9fa-6b94370e9003 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85ef7eb24b14d41a72e5e1ef0c96e70'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.991735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5f8a3578-cd6b-43fb-a9fa-6b94370e9003 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85ef7eb24b14d41a72e5e1ef0c96e70'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:45.999364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1019/2077] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:45 2022] DELETE /identity/v3/users/f85ef7eb24b14d41a72e5e1ef0c96e70 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:46.197793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9897d-1f62-40f6-84cb-7d4c355cf3d2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:46.199805 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-20f9897d-1f62-40f6-84cb-7d4c355cf3d2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:46.258706 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a3578-cd6b-43fb-a9fa-6b94370e9003 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:46.260339 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5f8a3578-cd6b-43fb-a9fa-6b94370e9003 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:46.316930 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20f9897d-1f62-40f6-84cb-7d4c355cf3d2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:46.367053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f8a3578-cd6b-43fb-a9fa-6b94370e9003 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:46.371556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:46.373051 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:46.373342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:46.373655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] PATH_INFO: `/v3/projects/95206fc3574c4f5da372fcfc3bebc22f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:46.374978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] RBAC: Authorizing `identity:delete_project(project_id=95206fc3574c4f5da372fcfc3bebc22f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:46.376889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:46.402152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:46.403028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:46.403307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:46.403579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033 admin admin] PATH_INFO: `/v3/projects/0f43909270b841ff86969e55949c213b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:46.404809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0f43909270b841ff86969e55949c213b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:46.408838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:46.428805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:46.438170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '95206fc3574c4f5da372fcfc3bebc22f', 'request_id': 'req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.449211 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '95206fc3574c4f5da372fcfc3bebc22f', 'request_id': 'req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.455873 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87,keystone:DELETE=12,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:46.458095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '95206fc3574c4f5da372fcfc3bebc22f', 'request_id': 'req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.472554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] The token cache is being invalidate because project 95206fc3574c4f5da372fcfc3bebc22f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:46.473059 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0f43909270b841ff86969e55949c213b', 'request_id': 'req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.475276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.475966 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.478193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1020/2078] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:46 2022] DELETE /identity/v3/projects/95206fc3574c4f5da372fcfc3bebc22f => generated 0 bytes in 220 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:46.479404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:46.482489 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:46.491481 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0f43909270b841ff86969e55949c213b', 'request_id': 'req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.500415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0f43909270b841ff86969e55949c213b', 'request_id': 'req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.517718 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033 admin admin] The token cache is being invalidate because project 0f43909270b841ff86969e55949c213b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:46.520152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.520910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ba2eb576-aa21-45ef-8ba5-5aa9afcca033 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.527110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1059/2079] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:46 2022] DELETE /identity/v3/projects/0f43909270b841ff86969e55949c213b => generated 0 bytes in 327 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:46.527110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e011468-11ce-4b84-b80a-17b28ed09d5c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:46.527110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e011468-11ce-4b84-b80a-17b28ed09d5c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:46.527110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e011468-11ce-4b84-b80a-17b28ed09d5c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:46.550819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3e011468-11ce-4b84-b80a-17b28ed09d5c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:46.552154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3e011468-11ce-4b84-b80a-17b28ed09d5c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:46.569468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7ad7f6-9ac2-4a01-9972-201a86fd5a45 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:46.626897 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1060/2080] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:46.628582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816fbf2-0dae-41be-9304-3a5b4e3f5603 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:46.628869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816fbf2-0dae-41be-9304-3a5b4e3f5603 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:46.629181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a816fbf2-0dae-41be-9304-3a5b4e3f5603 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:46.639073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d0c36-8bfa-4df1-a15b-feb5b911dc5a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:46.639990 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d0c36-8bfa-4df1-a15b-feb5b911dc5a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:46.640300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d0c36-8bfa-4df1-a15b-feb5b911dc5a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:46.640692 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d0c36-8bfa-4df1-a15b-feb5b911dc5a admin admin] PATH_INFO: `/v3/users/a4f95703464a41058765d0c0eec3fa07` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:46.643121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d0c36-8bfa-4df1-a15b-feb5b911dc5a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a4f95703464a41058765d0c0eec3fa07)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:46.645939 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d0c36-8bfa-4df1-a15b-feb5b911dc5a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:46.647778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a816fbf2-0dae-41be-9304-3a5b4e3f5603 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:46.649068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a816fbf2-0dae-41be-9304-3a5b4e3f5603 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:46.657251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1061/2081] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:46.658829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794adce-d555-4247-9c61-eb0c3be3a974 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:46.658829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794adce-d555-4247-9c61-eb0c3be3a974 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:46.659119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7794adce-d555-4247-9c61-eb0c3be3a974 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:46.697533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7794adce-d555-4247-9c61-eb0c3be3a974 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:46.698739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7794adce-d555-4247-9c61-eb0c3be3a974 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:46.714997 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1062/2082] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:46.716279 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a305083-44bd-468f-89a4-29a3d22bbdf4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:46.716564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a305083-44bd-468f-89a4-29a3d22bbdf4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:46.716836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a305083-44bd-468f-89a4-29a3d22bbdf4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:46.721133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a0d0c36-8bfa-4df1-a15b-feb5b911dc5a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a4f95703464a41058765d0c0eec3fa07'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.730085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a0d0c36-8bfa-4df1-a15b-feb5b911dc5a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a4f95703464a41058765d0c0eec3fa07'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.730893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a0d0c36-8bfa-4df1-a15b-feb5b911dc5a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a4f95703464a41058765d0c0eec3fa07'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.735665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6a305083-44bd-468f-89a4-29a3d22bbdf4 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:46.736883 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6a305083-44bd-468f-89a4-29a3d22bbdf4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:46.744752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a0d0c36-8bfa-4df1-a15b-feb5b911dc5a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a4f95703464a41058765d0c0eec3fa07'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.746341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1063/2083] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:46.747434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:46.747834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a305083-44bd-468f-89a4-29a3d22bbdf4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:46.756367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a0d0c36-8bfa-4df1-a15b-feb5b911dc5a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a4f95703464a41058765d0c0eec3fa07'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:46.758647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a305083-44bd-468f-89a4-29a3d22bbdf4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:46.763685 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2d4b6c3-3245-43d7-9693-13c2aa3c1c38 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:46.764369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4b6c3-3245-43d7-9693-13c2aa3c1c38 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:46.764584 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1021/2084] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:46 2022] DELETE /identity/v3/users/a4f95703464a41058765d0c0eec3fa07 => generated 0 bytes in 286 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:46.764707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4b6c3-3245-43d7-9693-13c2aa3c1c38 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:46.764913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2d4b6c3-3245-43d7-9693-13c2aa3c1c38 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:46.765400 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d0c36-8bfa-4df1-a15b-feb5b911dc5a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:46.765983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4b6c3-3245-43d7-9693-13c2aa3c1c38 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:46.766300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4b6c3-3245-43d7-9693-13c2aa3c1c38 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:46.766744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4a0d0c36-8bfa-4df1-a15b-feb5b911dc5a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:46.767898 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2d4b6c3-3245-43d7-9693-13c2aa3c1c38 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:46.784048 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1064/2085] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:46.785793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c6c3b-feb1-4515-99dd-115c26ac600d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:46.786086 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c6c3b-feb1-4515-99dd-115c26ac600d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:46.786368 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-417c6c3b-feb1-4515-99dd-115c26ac600d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:46.805101 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-417c6c3b-feb1-4515-99dd-115c26ac600d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:46.806394 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-417c6c3b-feb1-4515-99dd-115c26ac600d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:46.836111 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d0c36-8bfa-4df1-a15b-feb5b911dc5a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:46.841644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90360e44-4819-4a9f-bc82-405b440abb65 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:46.842822 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90360e44-4819-4a9f-bc82-405b440abb65 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:46.843105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90360e44-4819-4a9f-bc82-405b440abb65 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:46.843381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90360e44-4819-4a9f-bc82-405b440abb65 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:46.844100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90360e44-4819-4a9f-bc82-405b440abb65 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:46.844409 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90360e44-4819-4a9f-bc82-405b440abb65 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:46.846042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90360e44-4819-4a9f-bc82-405b440abb65 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:46.858981 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1022/2086] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 94 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:46.859847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90360e44-4819-4a9f-bc82-405b440abb65 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:46.863208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-90360e44-4819-4a9f-bc82-405b440abb65 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:46.867418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1065/2087] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:46.868225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c6c3b-feb1-4515-99dd-115c26ac600d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:46.876846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90360e44-4819-4a9f-bc82-405b440abb65 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:46.877560 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-417c6c3b-feb1-4515-99dd-115c26ac600d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:46.881487 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c1382-eb05-4b34-972a-fc58c9c00af2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:46.882414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c1382-eb05-4b34-972a-fc58c9c00af2 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:46.882551 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491273c4-b062-4afc-8ad4-7fc6a4ec5659 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:46.882644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c1382-eb05-4b34-972a-fc58c9c00af2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:46.882738 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-987c1382-eb05-4b34-972a-fc58c9c00af2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:46.883005 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491273c4-b062-4afc-8ad4-7fc6a4ec5659 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:46.883295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491273c4-b062-4afc-8ad4-7fc6a4ec5659 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:46.883393 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c1382-eb05-4b34-972a-fc58c9c00af2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:46.883569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-491273c4-b062-4afc-8ad4-7fc6a4ec5659 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:46.884380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491273c4-b062-4afc-8ad4-7fc6a4ec5659 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:46.885325 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-987c1382-eb05-4b34-972a-fc58c9c00af2 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:46.886443 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-491273c4-b062-4afc-8ad4-7fc6a4ec5659 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:46.913033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1023/2088] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:46 2022] POST /identity/v3/projects => generated 363 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:46.913392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c1382-eb05-4b34-972a-fc58c9c00af2 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:46.913819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1066/2089] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:46 2022] POST /identity/v3/projects => generated 357 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:46.915056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-987c1382-eb05-4b34-972a-fc58c9c00af2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:46.916653 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491273c4-b062-4afc-8ad4-7fc6a4ec5659 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:46.927378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=5,keystone:SELECT=93,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:46.972223 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-987c1382-eb05-4b34-972a-fc58c9c00af2 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:46.980076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-491273c4-b062-4afc-8ad4-7fc6a4ec5659 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:46.985359 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12497b65-57c6-4b27-b69b-ce62b7dcad8f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:46.986026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497b65-57c6-4b27-b69b-ce62b7dcad8f admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:46.986310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497b65-57c6-4b27-b69b-ce62b7dcad8f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:46.986588 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12497b65-57c6-4b27-b69b-ce62b7dcad8f admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:46.987273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12497b65-57c6-4b27-b69b-ce62b7dcad8f admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:46.989208 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12497b65-57c6-4b27-b69b-ce62b7dcad8f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.016582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1067/2090] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:46 2022] POST /identity/v3/users => generated 282 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:47.016582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12497b65-57c6-4b27-b69b-ce62b7dcad8f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.030726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0c2cb-5a67-4009-818c-864634e80593 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.031200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12497b65-57c6-4b27-b69b-ce62b7dcad8f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.031407 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c2cb-5a67-4009-818c-864634e80593 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.031782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c2cb-5a67-4009-818c-864634e80593 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.032075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e0c2cb-5a67-4009-818c-864634e80593 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.038296 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb6b5f-5c9b-4574-a35d-4ea28697def1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.038975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb6b5f-5c9b-4574-a35d-4ea28697def1 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.039264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb6b5f-5c9b-4574-a35d-4ea28697def1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.039545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56bb6b5f-5c9b-4574-a35d-4ea28697def1 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.040270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb6b5f-5c9b-4574-a35d-4ea28697def1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.042248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56bb6b5f-5c9b-4574-a35d-4ea28697def1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.042711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0c2cb-5a67-4009-818c-864634e80593 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.044364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e0c2cb-5a67-4009-818c-864634e80593 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.055636 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1024/2091] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:47.056529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0c2cb-5a67-4009-818c-864634e80593 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.066770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1068/2092] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:47 2022] POST /identity/v3/users => generated 279 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:47.067313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e0c2cb-5a67-4009-818c-864634e80593 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.070730 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb6b5f-5c9b-4574-a35d-4ea28697def1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.072860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231388c-cfd4-4c6a-8580-bd8d72524074 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.074036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231388c-cfd4-4c6a-8580-bd8d72524074 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.074326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231388c-cfd4-4c6a-8580-bd8d72524074 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.074609 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8231388c-cfd4-4c6a-8580-bd8d72524074 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.075337 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231388c-cfd4-4c6a-8580-bd8d72524074 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.077120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8231388c-cfd4-4c6a-8580-bd8d72524074 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.081146 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56bb6b5f-5c9b-4574-a35d-4ea28697def1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.086311 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a745a9-467d-4245-9766-3327be55af55 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.086978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a745a9-467d-4245-9766-3327be55af55 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.087263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a745a9-467d-4245-9766-3327be55af55 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.087540 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a745a9-467d-4245-9766-3327be55af55 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.088168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1025/2093] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:47.088280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a745a9-467d-4245-9766-3327be55af55 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.089890 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a745a9-467d-4245-9766-3327be55af55 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.093215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231388c-cfd4-4c6a-8580-bd8d72524074 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.103760 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1069/2094] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:47.105147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8231388c-cfd4-4c6a-8580-bd8d72524074 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.109226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a745a9-467d-4245-9766-3327be55af55 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.111466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306c4df-ba16-4529-9561-7e08380b656c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.112206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306c4df-ba16-4529-9561-7e08380b656c admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.112543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306c4df-ba16-4529-9561-7e08380b656c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.112858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a306c4df-ba16-4529-9561-7e08380b656c admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.113747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306c4df-ba16-4529-9561-7e08380b656c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.115468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a306c4df-ba16-4529-9561-7e08380b656c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.121127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a745a9-467d-4245-9766-3327be55af55 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.128019 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c184a7b-ad84-49ca-809c-b18e2d94ee13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.128602 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1026/2095] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:47.128784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184a7b-ad84-49ca-809c-b18e2d94ee13 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.129098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184a7b-ad84-49ca-809c-b18e2d94ee13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.129378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c184a7b-ad84-49ca-809c-b18e2d94ee13 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.130101 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c184a7b-ad84-49ca-809c-b18e2d94ee13 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.131932 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c184a7b-ad84-49ca-809c-b18e2d94ee13 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.133283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306c4df-ba16-4529-9561-7e08380b656c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.139959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=1,keystone:SELECT=98,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:47.146084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a306c4df-ba16-4529-9561-7e08380b656c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.147142 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1070/2096] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:47.151567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c184a7b-ad84-49ca-809c-b18e2d94ee13 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.157203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42e218f-ac05-4dc2-a2bf-78ac8803a562 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.158241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e218f-ac05-4dc2-a2bf-78ac8803a562 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.158604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e218f-ac05-4dc2-a2bf-78ac8803a562 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.159311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42e218f-ac05-4dc2-a2bf-78ac8803a562 admin admin] PATH_INFO: `/v3/projects/7e7d45278de2433e96cb20485769aa30/users/174a920cc3314f669ed5f09cefc90ace/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.165821 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c184a7b-ad84-49ca-809c-b18e2d94ee13 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.171116 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97f1a86d-60ca-4e3c-942b-d11f2346665a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.171935 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1a86d-60ca-4e3c-942b-d11f2346665a admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.172317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1a86d-60ca-4e3c-942b-d11f2346665a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.172648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97f1a86d-60ca-4e3c-942b-d11f2346665a admin admin] PATH_INFO: `/v3/projects/39fe49d60f904db895d8327b32cee2ea/users/adfac407bac34f7990717651014f0084/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.185921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e218f-ac05-4dc2-a2bf-78ac8803a562 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7e7d45278de2433e96cb20485769aa30, user_id=174a920cc3314f669ed5f09cefc90ace, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.190978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42e218f-ac05-4dc2-a2bf-78ac8803a562 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.204871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1a86d-60ca-4e3c-942b-d11f2346665a admin admin] RBAC: Authorizing `identity:create_grant(project_id=39fe49d60f904db895d8327b32cee2ea, user_id=adfac407bac34f7990717651014f0084, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.210900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97f1a86d-60ca-4e3c-942b-d11f2346665a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.213903 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1027/2097] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:47 2022] PUT /identity/v3/projects/7e7d45278de2433e96cb20485769aa30/users/174a920cc3314f669ed5f09cefc90ace/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 81 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:47.231427 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a843c-3bb6-4f99-a8a1-eab1851f1a7a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.231849 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a843c-3bb6-4f99-a8a1-eab1851f1a7a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.232350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-619a843c-3bb6-4f99-a8a1-eab1851f1a7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.243673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1071/2098] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:47 2022] PUT /identity/v3/projects/39fe49d60f904db895d8327b32cee2ea/users/adfac407bac34f7990717651014f0084/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 93 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:47.256034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b19bea-8df0-4a0f-8434-afbc0acbae31 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.256245 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b19bea-8df0-4a0f-8434-afbc0acbae31 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.256529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b19bea-8df0-4a0f-8434-afbc0acbae31 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.265868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-619a843c-3bb6-4f99-a8a1-eab1851f1a7a None None] MFA Rules not processed for user `174a920cc3314f669ed5f09cefc90ace`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:47.267282 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-619a843c-3bb6-4f99-a8a1-eab1851f1a7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:47.287371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-87b19bea-8df0-4a0f-8434-afbc0acbae31 None None] MFA Rules not processed for user `adfac407bac34f7990717651014f0084`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:47.288907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-87b19bea-8df0-4a0f-8434-afbc0acbae31 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:47.341081 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1028/2099] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:47 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:47.346099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a843c-3bb6-4f99-a8a1-eab1851f1a7a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.373602 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1072/2100] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:47 2022] POST /identity/v3/auth/tokens => generated 3224 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:47.378710 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b19bea-8df0-4a0f-8434-afbc0acbae31 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.423143 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:47.453162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-619a843c-3bb6-4f99-a8a1-eab1851f1a7a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.458830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02431dd0-e456-49b6-92f4-5a203b1e6713 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.459528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02431dd0-e456-49b6-92f4-5a203b1e6713 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.459781 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02431dd0-e456-49b6-92f4-5a203b1e6713 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.460058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02431dd0-e456-49b6-92f4-5a203b1e6713 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.460752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02431dd0-e456-49b6-92f4-5a203b1e6713 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.462724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02431dd0-e456-49b6-92f4-5a203b1e6713 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.466190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b19bea-8df0-4a0f-8434-afbc0acbae31 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.473076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aef253-e7d4-48e1-b33a-068575f2071e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.474266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aef253-e7d4-48e1-b33a-068575f2071e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.474725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aef253-e7d4-48e1-b33a-068575f2071e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.475170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8aef253-e7d4-48e1-b33a-068575f2071e admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.476027 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aef253-e7d4-48e1-b33a-068575f2071e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.478337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8aef253-e7d4-48e1-b33a-068575f2071e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.490542 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1029/2101] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:47 2022] POST /identity/v3/projects => generated 365 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:47.491288 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02431dd0-e456-49b6-92f4-5a203b1e6713 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.493529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-02431dd0-e456-49b6-92f4-5a203b1e6713 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:47.511311 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1073/2102] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:47 2022] POST /identity/v3/projects => generated 355 bytes in 133 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:47.512000 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aef253-e7d4-48e1-b33a-068575f2071e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.562464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:47.575201 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02431dd0-e456-49b6-92f4-5a203b1e6713 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.589662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8aef253-e7d4-48e1-b33a-068575f2071e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.594456 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078768c-06e3-437e-84c0-9bde98a4da7b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.595290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078768c-06e3-437e-84c0-9bde98a4da7b admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.595605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078768c-06e3-437e-84c0-9bde98a4da7b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.595930 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1078768c-06e3-437e-84c0-9bde98a4da7b admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.596648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078768c-06e3-437e-84c0-9bde98a4da7b admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.598625 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1078768c-06e3-437e-84c0-9bde98a4da7b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.621775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1074/2103] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:47 2022] POST /identity/v3/users => generated 289 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:47.621775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078768c-06e3-437e-84c0-9bde98a4da7b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.629624 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1078768c-06e3-437e-84c0-9bde98a4da7b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.634188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b53b6-e382-47d2-9ddc-ccddc5a511aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.634842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b53b6-e382-47d2-9ddc-ccddc5a511aa admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.635122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b53b6-e382-47d2-9ddc-ccddc5a511aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.635402 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889b53b6-e382-47d2-9ddc-ccddc5a511aa admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.636071 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b53b6-e382-47d2-9ddc-ccddc5a511aa admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.637116 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.637998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.638123 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-889b53b6-e382-47d2-9ddc-ccddc5a511aa admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.638277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.638549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] PATH_INFO: `/v3/projects/c80783d394454944841e56f0077c5474` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.640292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c80783d394454944841e56f0077c5474)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.642222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.662237 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1075/2104] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:47 2022] POST /identity/v3/users => generated 284 bytes in 40 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:47.662237 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b53b6-e382-47d2-9ddc-ccddc5a511aa admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.662237 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-889b53b6-e382-47d2-9ddc-ccddc5a511aa admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:47.673544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889b53b6-e382-47d2-9ddc-ccddc5a511aa admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.678544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432547a-a0b8-47fe-9bab-729c13e3af21 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.679559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432547a-a0b8-47fe-9bab-729c13e3af21 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.679863 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432547a-a0b8-47fe-9bab-729c13e3af21 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.680146 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c432547a-a0b8-47fe-9bab-729c13e3af21 admin admin] PATH_INFO: `/v3/users/14b096e168df4f5a9a45b1656e42c2c4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.681412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432547a-a0b8-47fe-9bab-729c13e3af21 admin admin] RBAC: Authorizing `identity:delete_user(user_id=14b096e168df4f5a9a45b1656e42c2c4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.683370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c432547a-a0b8-47fe-9bab-729c13e3af21 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.692637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c80783d394454944841e56f0077c5474', 'request_id': 'req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:47.700553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c80783d394454944841e56f0077c5474', 'request_id': 'req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:47.707132 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c80783d394454944841e56f0077c5474', 'request_id': 'req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:47.721114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] The token cache is being invalidate because project c80783d394454944841e56f0077c5474 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:47.721531 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:47.722222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:47.724122 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1030/2105] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:47 2022] DELETE /identity/v3/projects/c80783d394454944841e56f0077c5474 => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:47.724973 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.726510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:47.751453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c432547a-a0b8-47fe-9bab-729c13e3af21 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '14b096e168df4f5a9a45b1656e42c2c4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:47.752268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c432547a-a0b8-47fe-9bab-729c13e3af21 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '14b096e168df4f5a9a45b1656e42c2c4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:47.760803 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c432547a-a0b8-47fe-9bab-729c13e3af21 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '14b096e168df4f5a9a45b1656e42c2c4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:47.761741 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c432547a-a0b8-47fe-9bab-729c13e3af21 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '14b096e168df4f5a9a45b1656e42c2c4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:47.777041 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c432547a-a0b8-47fe-9bab-729c13e3af21 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '14b096e168df4f5a9a45b1656e42c2c4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:47.779879 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=83,keystone:INSERT=8,keystone:DELETE=9 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:47.799742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1076/2106] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:47 2022] DELETE /identity/v3/users/14b096e168df4f5a9a45b1656e42c2c4 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:47.800803 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432547a-a0b8-47fe-9bab-729c13e3af21 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.802580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c432547a-a0b8-47fe-9bab-729c13e3af21 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:47.853670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c6080dd-f7eb-4ab7-b2dc-002ada8ebf04 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.906569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:47.930271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c432547a-a0b8-47fe-9bab-729c13e3af21 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.935476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce70af1-e19e-466c-adc7-2807362101c1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.935631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6db114b8-1a3c-466e-9292-5b3c263956bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.936840 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db114b8-1a3c-466e-9292-5b3c263956bd admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.937086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce70af1-e19e-466c-adc7-2807362101c1 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.937189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db114b8-1a3c-466e-9292-5b3c263956bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.937415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6db114b8-1a3c-466e-9292-5b3c263956bd admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.937518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce70af1-e19e-466c-adc7-2807362101c1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.937762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ce70af1-e19e-466c-adc7-2807362101c1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.938137 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db114b8-1a3c-466e-9292-5b3c263956bd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.938563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce70af1-e19e-466c-adc7-2807362101c1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.939745 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6db114b8-1a3c-466e-9292-5b3c263956bd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.940206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ce70af1-e19e-466c-adc7-2807362101c1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.950108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1077/2107] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 150 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:47.953331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1031/2108] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:47 2022] GET /identity/v3/roles => generated 1420 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:47.953475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e0223-8579-466f-ad4c-2bef4f4817d6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.953475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e0223-8579-466f-ad4c-2bef4f4817d6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.953475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f84e0223-8579-466f-ad4c-2bef4f4817d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.955033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce70af1-e19e-466c-adc7-2807362101c1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.956714 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0ce70af1-e19e-466c-adc7-2807362101c1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:47.969224 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ce70af1-e19e-466c-adc7-2807362101c1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.969670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f84e0223-8579-466f-ad4c-2bef4f4817d6 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:47.970834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f84e0223-8579-466f-ad4c-2bef4f4817d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:47.974287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0435c5b-ea5c-479f-b630-facc53dc4eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:47.975164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435c5b-ea5c-479f-b630-facc53dc4eec admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:47.975445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435c5b-ea5c-479f-b630-facc53dc4eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:47.975721 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0435c5b-ea5c-479f-b630-facc53dc4eec admin admin] PATH_INFO: `/v3/projects/1b4967cd7f464c4489cc4b664d0c20bd/users/d73c3173b12e4100bef83cda936447e4/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:47.978484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1078/2109] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:47 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:47.981917 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e0223-8579-466f-ad4c-2bef4f4817d6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:47.991531 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0435c5b-ea5c-479f-b630-facc53dc4eec admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b4967cd7f464c4489cc4b664d0c20bd, user_id=d73c3173b12e4100bef83cda936447e4, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:47.993750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f84e0223-8579-466f-ad4c-2bef4f4817d6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:47.994452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0435c5b-ea5c-479f-b630-facc53dc4eec admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:47.999348 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ee119-53f2-48ef-9026-a6b8a064d23b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:48.000271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ee119-53f2-48ef-9026-a6b8a064d23b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.000547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ee119-53f2-48ef-9026-a6b8a064d23b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.000825 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-071ee119-53f2-48ef-9026-a6b8a064d23b admin admin] PATH_INFO: `/v3/projects/159e3eeb05374feb9c1ba639f5091d79/users/e7de802814fc4696987f48b8fe28e408/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.009904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1032/2110] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:47 2022] PUT /identity/v3/projects/1b4967cd7f464c4489cc4b664d0c20bd/users/d73c3173b12e4100bef83cda936447e4/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:48.010798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0435c5b-ea5c-479f-b630-facc53dc4eec admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:48.014233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d0435c5b-ea5c-479f-b630-facc53dc4eec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:48.017356 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ee119-53f2-48ef-9026-a6b8a064d23b admin admin] RBAC: Authorizing `identity:create_grant(project_id=159e3eeb05374feb9c1ba639f5091d79, user_id=e7de802814fc4696987f48b8fe28e408, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:48.020250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-071ee119-53f2-48ef-9026-a6b8a064d23b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:48.033611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1079/2111] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:47 2022] PUT /identity/v3/projects/159e3eeb05374feb9c1ba639f5091d79/users/e7de802814fc4696987f48b8fe28e408/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:48.034679 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ee119-53f2-48ef-9026-a6b8a064d23b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:48.075021 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0435c5b-ea5c-479f-b630-facc53dc4eec admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:48.105893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-071ee119-53f2-48ef-9026-a6b8a064d23b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:48.111185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad971a-55d8-46c5-8fcd-72979cbda8a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:48.111993 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad971a-55d8-46c5-8fcd-72979cbda8a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.112276 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad971a-55d8-46c5-8fcd-72979cbda8a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.112550 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cad971a-55d8-46c5-8fcd-72979cbda8a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.113300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad971a-55d8-46c5-8fcd-72979cbda8a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:48.114929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cad971a-55d8-46c5-8fcd-72979cbda8a9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:48.125069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995762f0-64a2-44da-bbca-d1b1130b4cba service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:48.125716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995762f0-64a2-44da-bbca-d1b1130b4cba service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.125823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1080/2112] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 92 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:48.126002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995762f0-64a2-44da-bbca-d1b1130b4cba service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.126280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-995762f0-64a2-44da-bbca-d1b1130b4cba service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.126658 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad971a-55d8-46c5-8fcd-72979cbda8a9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:48.136357 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cad971a-55d8-46c5-8fcd-72979cbda8a9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:48.137909 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995762f0-64a2-44da-bbca-d1b1130b4cba service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:48.139420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-995762f0-64a2-44da-bbca-d1b1130b4cba service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:48.141087 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4bf0e-9a0a-4a8e-8a28-e19c67cfbae0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:48.141784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4bf0e-9a0a-4a8e-8a28-e19c67cfbae0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.142072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4bf0e-9a0a-4a8e-8a28-e19c67cfbae0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.142353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60e4bf0e-9a0a-4a8e-8a28-e19c67cfbae0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.143067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4bf0e-9a0a-4a8e-8a28-e19c67cfbae0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:48.144650 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60e4bf0e-9a0a-4a8e-8a28-e19c67cfbae0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:48.150869 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1033/2113] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 140 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:48.151692 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995762f0-64a2-44da-bbca-d1b1130b4cba service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:48.155352 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1081/2114] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:48 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:48.159571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4bf0e-9a0a-4a8e-8a28-e19c67cfbae0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:48.161261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-995762f0-64a2-44da-bbca-d1b1130b4cba service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:48.167363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ad30ec5-e122-420a-9982-4d4afb0bdfed admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:48.167568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30ec5-e122-420a-9982-4d4afb0bdfed admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.167875 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30ec5-e122-420a-9982-4d4afb0bdfed admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.168214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ad30ec5-e122-420a-9982-4d4afb0bdfed admin admin] PATH_INFO: `/v3/projects/1b4967cd7f464c4489cc4b664d0c20bd/users/d73c3173b12e4100bef83cda936447e4/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.170238 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad30ec5-e122-420a-9982-4d4afb0bdfed admin admin] RBAC: Authorizing `identity:create_grant(project_id=1b4967cd7f464c4489cc4b664d0c20bd, user_id=d73c3173b12e4100bef83cda936447e4, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:48.171334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60e4bf0e-9a0a-4a8e-8a28-e19c67cfbae0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:48.173599 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ad30ec5-e122-420a-9982-4d4afb0bdfed admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:48.176048 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d21a30c9-a093-4f53-ba78-56b2553ea6fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:48.177188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a30c9-a093-4f53-ba78-56b2553ea6fe admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.177307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a30c9-a093-4f53-ba78-56b2553ea6fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.177569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d21a30c9-a093-4f53-ba78-56b2553ea6fe admin admin] PATH_INFO: `/v3/projects/159e3eeb05374feb9c1ba639f5091d79/users/e7de802814fc4696987f48b8fe28e408/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.183991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a30c9-a093-4f53-ba78-56b2553ea6fe admin admin] RBAC: Authorizing `identity:create_grant(project_id=159e3eeb05374feb9c1ba639f5091d79, user_id=e7de802814fc4696987f48b8fe28e408, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:48.185040 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1034/2115] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:48 2022] PUT /identity/v3/projects/1b4967cd7f464c4489cc4b664d0c20bd/users/d73c3173b12e4100bef83cda936447e4/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:48.188499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d21a30c9-a093-4f53-ba78-56b2553ea6fe admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:48.196481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd815637-4676-401e-9a17-9fe286b50635 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.196832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd815637-4676-401e-9a17-9fe286b50635 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.197218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd815637-4676-401e-9a17-9fe286b50635 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.203035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1082/2116] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:48 2022] PUT /identity/v3/projects/159e3eeb05374feb9c1ba639f5091d79/users/e7de802814fc4696987f48b8fe28e408/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 44 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:48.214143 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b67df3-9a7d-4a3e-9630-5fda20594f62 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.214445 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b67df3-9a7d-4a3e-9630-5fda20594f62 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.214719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05b67df3-9a7d-4a3e-9630-5fda20594f62 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.227392 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-bd815637-4676-401e-9a17-9fe286b50635 None None] MFA Rules not processed for user `d73c3173b12e4100bef83cda936447e4`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:48.228600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bd815637-4676-401e-9a17-9fe286b50635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:48.247616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-05b67df3-9a7d-4a3e-9630-5fda20594f62 None None] MFA Rules not processed for user `e7de802814fc4696987f48b8fe28e408`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:48.249631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-05b67df3-9a7d-4a3e-9630-5fda20594f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:48.274349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:48.276352 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:48.305729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1035/2117] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:48 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:48.321503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd815637-4676-401e-9a17-9fe286b50635 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:48.323142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bd815637-4676-401e-9a17-9fe286b50635 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:48.345021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1083/2118] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:48 2022] POST /identity/v3/auth/tokens => generated 3289 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:48.356804 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b67df3-9a7d-4a3e-9630-5fda20594f62 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:48.359008 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-05b67df3-9a7d-4a3e-9630-5fda20594f62 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:48.395572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd815637-4676-401e-9a17-9fe286b50635 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:48.399842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c195106-6639-491a-b5a1-d0280cb65f0b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:48.400548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c195106-6639-491a-b5a1-d0280cb65f0b service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.401076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c195106-6639-491a-b5a1-d0280cb65f0b service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.401672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c195106-6639-491a-b5a1-d0280cb65f0b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.412546 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c195106-6639-491a-b5a1-d0280cb65f0b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:48.414179 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c195106-6639-491a-b5a1-d0280cb65f0b service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:48.425534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1036/2119] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:48 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:48.435463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05b67df3-9a7d-4a3e-9630-5fda20594f62 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:48.440808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036422d8-0504-4540-a04a-9c8af4ba101e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:48.442178 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036422d8-0504-4540-a04a-9c8af4ba101e service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.442371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036422d8-0504-4540-a04a-9c8af4ba101e service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.442624 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036422d8-0504-4540-a04a-9c8af4ba101e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.447539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c195106-6639-491a-b5a1-d0280cb65f0b service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:48.449159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8c195106-6639-491a-b5a1-d0280cb65f0b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:48.455149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036422d8-0504-4540-a04a-9c8af4ba101e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:48.458056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036422d8-0504-4540-a04a-9c8af4ba101e service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:48.471281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1084/2120] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:48 2022] GET /identity/v3/auth/tokens => generated 3289 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:22:48.555613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c195106-6639-491a-b5a1-d0280cb65f0b service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:48.557613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036422d8-0504-4540-a04a-9c8af4ba101e service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:48.560664 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bbca379-61da-48ba-b0e1-9ce99bd80b20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:48.561944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbca379-61da-48ba-b0e1-9ce99bd80b20 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.562250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbca379-61da-48ba-b0e1-9ce99bd80b20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.562496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bbca379-61da-48ba-b0e1-9ce99bd80b20 admin admin] PATH_INFO: `/v3/projects/3561965aadfe4f798d7f212063c603cd` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.563887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbca379-61da-48ba-b0e1-9ce99bd80b20 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3561965aadfe4f798d7f212063c603cd)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:48.566657 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bbca379-61da-48ba-b0e1-9ce99bd80b20 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:48.569717 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036422d8-0504-4540-a04a-9c8af4ba101e service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:48.574391 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48626e89-9057-4d63-a72f-9161c3286b2f service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:48.575125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626e89-9057-4d63-a72f-9161c3286b2f service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.575628 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626e89-9057-4d63-a72f-9161c3286b2f service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.575768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48626e89-9057-4d63-a72f-9161c3286b2f service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.578533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-48626e89-9057-4d63-a72f-9161c3286b2f service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:48.631302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0bbca379-61da-48ba-b0e1-9ce99bd80b20 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3561965aadfe4f798d7f212063c603cd', 'request_id': 'req-0bbca379-61da-48ba-b0e1-9ce99bd80b20'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:48.643949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0bbca379-61da-48ba-b0e1-9ce99bd80b20 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3561965aadfe4f798d7f212063c603cd', 'request_id': 'req-0bbca379-61da-48ba-b0e1-9ce99bd80b20'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:48.658773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48626e89-9057-4d63-a72f-9161c3286b2f service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:48.659151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0bbca379-61da-48ba-b0e1-9ce99bd80b20 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3561965aadfe4f798d7f212063c603cd', 'request_id': 'req-0bbca379-61da-48ba-b0e1-9ce99bd80b20'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:48.660190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48626e89-9057-4d63-a72f-9161c3286b2f service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:48.675894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1085/2121] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:48 2022] GET /identity/v3/auth/tokens => generated 3224 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:22:48.676180 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0bbca379-61da-48ba-b0e1-9ce99bd80b20 admin admin] The token cache is being invalidate because project 3561965aadfe4f798d7f212063c603cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:48.676568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0bbca379-61da-48ba-b0e1-9ce99bd80b20 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:48.677873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0bbca379-61da-48ba-b0e1-9ce99bd80b20 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:48.679532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1037/2122] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:48 2022] DELETE /identity/v3/projects/3561965aadfe4f798d7f212063c603cd => generated 0 bytes in 233 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:48.684064 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18960d23-3ebd-43df-b24f-5a34d5da1e48 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.684805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18960d23-3ebd-43df-b24f-5a34d5da1e48 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.684805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18960d23-3ebd-43df-b24f-5a34d5da1e48 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.710540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-18960d23-3ebd-43df-b24f-5a34d5da1e48 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:48.712013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-18960d23-3ebd-43df-b24f-5a34d5da1e48 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:48.722654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:48.788115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1038/2123] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:48.797808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f989907-55a1-4688-b97e-b7ca98909348 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.798253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f989907-55a1-4688-b97e-b7ca98909348 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.798499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f989907-55a1-4688-b97e-b7ca98909348 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.819084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7f989907-55a1-4688-b97e-b7ca98909348 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:48.820319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7f989907-55a1-4688-b97e-b7ca98909348 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:48.839851 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1086/2124] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:48.844225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18960d23-3ebd-43df-b24f-5a34d5da1e48 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:48.860082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18960d23-3ebd-43df-b24f-5a34d5da1e48 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:48.872674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b773b-7414-4bc6-ad3f-c9fc237273de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:48.873527 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b773b-7414-4bc6-ad3f-c9fc237273de admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.875170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b773b-7414-4bc6-ad3f-c9fc237273de admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.875170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d28b773b-7414-4bc6-ad3f-c9fc237273de admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.875492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b773b-7414-4bc6-ad3f-c9fc237273de admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:48.875868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b773b-7414-4bc6-ad3f-c9fc237273de admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:48.877658 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d28b773b-7414-4bc6-ad3f-c9fc237273de admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:48.889963 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1039/2125] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:48.896320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f989907-55a1-4688-b97e-b7ca98909348 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:48.904411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f989907-55a1-4688-b97e-b7ca98909348 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:48.909589 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83a75d-53cb-4a64-b393-141e9032473c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:48.910248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83a75d-53cb-4a64-b393-141e9032473c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:48.910534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83a75d-53cb-4a64-b393-141e9032473c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:48.911259 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb83a75d-53cb-4a64-b393-141e9032473c admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:48.911491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83a75d-53cb-4a64-b393-141e9032473c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:48.913706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb83a75d-53cb-4a64-b393-141e9032473c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:48.947591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1087/2126] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:48 2022] POST /identity/v3/projects => generated 381 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:48.952316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b773b-7414-4bc6-ad3f-c9fc237273de admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:48.964345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d28b773b-7414-4bc6-ad3f-c9fc237273de admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:48.967882 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83a75d-53cb-4a64-b393-141e9032473c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:48.969736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cb83a75d-53cb-4a64-b393-141e9032473c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:49.003460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:49.029082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4852be-1705-4531-991a-bfbb9a98ecd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:49.030437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4852be-1705-4531-991a-bfbb9a98ecd7 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:49.030838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4852be-1705-4531-991a-bfbb9a98ecd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:49.031121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec4852be-1705-4531-991a-bfbb9a98ecd7 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:49.031821 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4852be-1705-4531-991a-bfbb9a98ecd7 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:49.033928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec4852be-1705-4531-991a-bfbb9a98ecd7 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:49.038830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb83a75d-53cb-4a64-b393-141e9032473c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:49.043830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1004f9ae-e9f1-492f-b5f3-61cee097a540 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:49.044489 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004f9ae-e9f1-492f-b5f3-61cee097a540 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:49.044767 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004f9ae-e9f1-492f-b5f3-61cee097a540 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:49.045069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1004f9ae-e9f1-492f-b5f3-61cee097a540 admin admin] PATH_INFO: `/v3/users/174a920cc3314f669ed5f09cefc90ace` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:49.046927 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004f9ae-e9f1-492f-b5f3-61cee097a540 admin admin] RBAC: Authorizing `identity:delete_user(user_id=174a920cc3314f669ed5f09cefc90ace)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:49.049193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1004f9ae-e9f1-492f-b5f3-61cee097a540 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:49.056912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1040/2127] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:48 2022] POST /identity/v3/users => generated 291 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:49.060819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4852be-1705-4531-991a-bfbb9a98ecd7 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:49.070654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec4852be-1705-4531-991a-bfbb9a98ecd7 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:49.075624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdaa73-de6f-440b-91f3-037cd5dba813 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:49.076360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdaa73-de6f-440b-91f3-037cd5dba813 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:49.076670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdaa73-de6f-440b-91f3-037cd5dba813 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:49.077061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19bdaa73-de6f-440b-91f3-037cd5dba813 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:49.078084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdaa73-de6f-440b-91f3-037cd5dba813 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:49.079690 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19bdaa73-de6f-440b-91f3-037cd5dba813 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:49.090221 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1041/2128] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:49.094656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdaa73-de6f-440b-91f3-037cd5dba813 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:49.101297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1004f9ae-e9f1-492f-b5f3-61cee097a540 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '174a920cc3314f669ed5f09cefc90ace'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:49.102086 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1004f9ae-e9f1-492f-b5f3-61cee097a540 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '174a920cc3314f669ed5f09cefc90ace'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:49.105784 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19bdaa73-de6f-440b-91f3-037cd5dba813 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:49.110389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1004f9ae-e9f1-492f-b5f3-61cee097a540 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '174a920cc3314f669ed5f09cefc90ace'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:49.111033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1004f9ae-e9f1-492f-b5f3-61cee097a540 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '174a920cc3314f669ed5f09cefc90ace'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:49.111189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d44b-21c5-4c8e-bd72-841889bff13e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:49.111984 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d44b-21c5-4c8e-bd72-841889bff13e admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:49.112451 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d44b-21c5-4c8e-bd72-841889bff13e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:49.112726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7529d44b-21c5-4c8e-bd72-841889bff13e admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:49.113476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529d44b-21c5-4c8e-bd72-841889bff13e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:49.115057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7529d44b-21c5-4c8e-bd72-841889bff13e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:49.123471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1004f9ae-e9f1-492f-b5f3-61cee097a540 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '174a920cc3314f669ed5f09cefc90ace'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:49.126235 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1042/2129] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:49 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:49.130760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d44b-21c5-4c8e-bd72-841889bff13e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:49.132511 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7529d44b-21c5-4c8e-bd72-841889bff13e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:49.137476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1088/2130] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:48 2022] DELETE /identity/v3/users/174a920cc3314f669ed5f09cefc90ace => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:49.141710 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49769b45-d00f-46a5-b4e8-938c2e946108 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:49.142008 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49769b45-d00f-46a5-b4e8-938c2e946108 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:49.142296 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49769b45-d00f-46a5-b4e8-938c2e946108 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:49.146958 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7529d44b-21c5-4c8e-bd72-841889bff13e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:49.162504 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-49769b45-d00f-46a5-b4e8-938c2e946108 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:49.163750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-49769b45-d00f-46a5-b4e8-938c2e946108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:49.207935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a3a8f58-8579-412a-aa07-3fc547969c71 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:49.208821 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a8f58-8579-412a-aa07-3fc547969c71 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:49.209141 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a8f58-8579-412a-aa07-3fc547969c71 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:49.209418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a3a8f58-8579-412a-aa07-3fc547969c71 admin admin] PATH_INFO: `/v3/projects/d2a0d8b760fc467ca80e4d5460ef6700/users/3cab4b811e944bc6af6d73927de3bd27/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:49.221587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:49.224608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1089/2131] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:49.225440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a8f58-8579-412a-aa07-3fc547969c71 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d2a0d8b760fc467ca80e4d5460ef6700, user_id=3cab4b811e944bc6af6d73927de3bd27, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:49.228578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a3a8f58-8579-412a-aa07-3fc547969c71 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:49.237070 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49769b45-d00f-46a5-b4e8-938c2e946108 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:49.238683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-49769b45-d00f-46a5-b4e8-938c2e946108 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:49.246748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1043/2132] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:49 2022] PUT /identity/v3/projects/d2a0d8b760fc467ca80e4d5460ef6700/users/3cab4b811e944bc6af6d73927de3bd27/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 117 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:49.252050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28e7c8-9ea4-4e63-8531-6a5fced21dd0 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:49.252548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28e7c8-9ea4-4e63-8531-6a5fced21dd0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:49.253819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba28e7c8-9ea4-4e63-8531-6a5fced21dd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:49.270239 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ba28e7c8-9ea4-4e63-8531-6a5fced21dd0 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:49.271443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ba28e7c8-9ea4-4e63-8531-6a5fced21dd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:49.299013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:49.303487 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49769b45-d00f-46a5-b4e8-938c2e946108 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:49.334695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1044/2133] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:49.344481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28e7c8-9ea4-4e63-8531-6a5fced21dd0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:49.358314 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fae91-b69e-4196-a7c9-2652088625ad service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:49.359295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fae91-b69e-4196-a7c9-2652088625ad service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:49.359563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fae91-b69e-4196-a7c9-2652088625ad service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:49.359880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a51fae91-b69e-4196-a7c9-2652088625ad service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:49.369816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fae91-b69e-4196-a7c9-2652088625ad service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:49.371333 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a51fae91-b69e-4196-a7c9-2652088625ad service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:49.382081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1090/2134] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 146 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:22:49.403838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba28e7c8-9ea4-4e63-8531-6a5fced21dd0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:49.407945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff04761-69cd-4826-9b4c-d9fb291dc948 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:49.408818 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff04761-69cd-4826-9b4c-d9fb291dc948 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:49.408945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff04761-69cd-4826-9b4c-d9fb291dc948 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:49.409170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dff04761-69cd-4826-9b4c-d9fb291dc948 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:49.419024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff04761-69cd-4826-9b4c-d9fb291dc948 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:49.421044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dff04761-69cd-4826-9b4c-d9fb291dc948 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:49.431270 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1045/2135] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:22:49.709232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fae91-b69e-4196-a7c9-2652088625ad service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:49.710809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a51fae91-b69e-4196-a7c9-2652088625ad service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:49.726499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a51fae91-b69e-4196-a7c9-2652088625ad service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:49.731560 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16998aed-183c-49bd-8301-b596d7576dfc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:49.733417 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16998aed-183c-49bd-8301-b596d7576dfc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:49.733848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16998aed-183c-49bd-8301-b596d7576dfc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:49.734075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16998aed-183c-49bd-8301-b596d7576dfc admin admin] PATH_INFO: `/v3/projects/7e7d45278de2433e96cb20485769aa30` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:49.735715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16998aed-183c-49bd-8301-b596d7576dfc admin admin] RBAC: Authorizing `identity:delete_project(project_id=7e7d45278de2433e96cb20485769aa30)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:49.737693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16998aed-183c-49bd-8301-b596d7576dfc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:49.791121 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-16998aed-183c-49bd-8301-b596d7576dfc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7e7d45278de2433e96cb20485769aa30', 'request_id': 'req-16998aed-183c-49bd-8301-b596d7576dfc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:49.809579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-16998aed-183c-49bd-8301-b596d7576dfc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7e7d45278de2433e96cb20485769aa30', 'request_id': 'req-16998aed-183c-49bd-8301-b596d7576dfc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:49.817182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-16998aed-183c-49bd-8301-b596d7576dfc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7e7d45278de2433e96cb20485769aa30', 'request_id': 'req-16998aed-183c-49bd-8301-b596d7576dfc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:49.829615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-16998aed-183c-49bd-8301-b596d7576dfc admin admin] The token cache is being invalidate because project 7e7d45278de2433e96cb20485769aa30 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:49.832145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-16998aed-183c-49bd-8301-b596d7576dfc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:49.833019 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-16998aed-183c-49bd-8301-b596d7576dfc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:49.835706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1091/2136] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:49 2022] DELETE /identity/v3/projects/7e7d45278de2433e96cb20485769aa30 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:49.839380 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff04761-69cd-4826-9b4c-d9fb291dc948 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:49.851287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dff04761-69cd-4826-9b4c-d9fb291dc948 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:49.926875 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c5f6b-ed91-4fca-8a13-5344a7a62809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:49.927874 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c5f6b-ed91-4fca-8a13-5344a7a62809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:49.928156 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c5f6b-ed91-4fca-8a13-5344a7a62809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:49.928433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616c5f6b-ed91-4fca-8a13-5344a7a62809 admin admin] PATH_INFO: `/v3/users/d73c3173b12e4100bef83cda936447e4` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:49.929757 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c5f6b-ed91-4fca-8a13-5344a7a62809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d73c3173b12e4100bef83cda936447e4)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:49.931624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-616c5f6b-ed91-4fca-8a13-5344a7a62809 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:49.982644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:49.998982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-616c5f6b-ed91-4fca-8a13-5344a7a62809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd73c3173b12e4100bef83cda936447e4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:50.012466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-616c5f6b-ed91-4fca-8a13-5344a7a62809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd73c3173b12e4100bef83cda936447e4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:50.015505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-616c5f6b-ed91-4fca-8a13-5344a7a62809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd73c3173b12e4100bef83cda936447e4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:50.038693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-616c5f6b-ed91-4fca-8a13-5344a7a62809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd73c3173b12e4100bef83cda936447e4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:50.048732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-616c5f6b-ed91-4fca-8a13-5344a7a62809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd73c3173b12e4100bef83cda936447e4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:50.061309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1046/2137] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:49 2022] DELETE /identity/v3/users/d73c3173b12e4100bef83cda936447e4 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:50.309661 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb030bc-0ac1-4634-9ccb-1d975a5c9863 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:50.309960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb030bc-0ac1-4634-9ccb-1d975a5c9863 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:50.310351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cb030bc-0ac1-4634-9ccb-1d975a5c9863 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:50.355364 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5cb030bc-0ac1-4634-9ccb-1d975a5c9863 None None] MFA Rules not processed for user `3cab4b811e944bc6af6d73927de3bd27`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:50.356640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5cb030bc-0ac1-4634-9ccb-1d975a5c9863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:50.463186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c5f6b-ed91-4fca-8a13-5344a7a62809 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:50.465677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1092/2138] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:50 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:50.466156 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-616c5f6b-ed91-4fca-8a13-5344a7a62809 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:50.478681 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb030bc-0ac1-4634-9ccb-1d975a5c9863 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:50.480629 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5cb030bc-0ac1-4634-9ccb-1d975a5c9863 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:50.521132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:50.571537 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cb030bc-0ac1-4634-9ccb-1d975a5c9863 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:50.575397 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368fdeee-de5c-4698-ab6d-382988f478ea service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:50.576119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fdeee-de5c-4698-ab6d-382988f478ea service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:50.576607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fdeee-de5c-4698-ab6d-382988f478ea service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:50.577475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368fdeee-de5c-4698-ab6d-382988f478ea service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:50.577785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616c5f6b-ed91-4fca-8a13-5344a7a62809 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:50.582304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1646388-3d53-41b9-854c-a0dce230f365 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:50.583166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1646388-3d53-41b9-854c-a0dce230f365 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:50.583447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1646388-3d53-41b9-854c-a0dce230f365 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:50.583724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1646388-3d53-41b9-854c-a0dce230f365 admin admin] PATH_INFO: `/v3/projects/1b4967cd7f464c4489cc4b664d0c20bd` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:50.584897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1646388-3d53-41b9-854c-a0dce230f365 admin admin] RBAC: Authorizing `identity:delete_project(project_id=1b4967cd7f464c4489cc4b664d0c20bd)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:50.586656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fdeee-de5c-4698-ab6d-382988f478ea service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:50.586846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1646388-3d53-41b9-854c-a0dce230f365 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:50.588017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368fdeee-de5c-4698-ab6d-382988f478ea service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:50.597153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1093/2139] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:50 2022] GET /identity/v3/auth/tokens => generated 3248 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:22:50.632968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b1646388-3d53-41b9-854c-a0dce230f365 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '1b4967cd7f464c4489cc4b664d0c20bd', 'request_id': 'req-b1646388-3d53-41b9-854c-a0dce230f365'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:50.642322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b1646388-3d53-41b9-854c-a0dce230f365 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '1b4967cd7f464c4489cc4b664d0c20bd', 'request_id': 'req-b1646388-3d53-41b9-854c-a0dce230f365'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:50.648588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b1646388-3d53-41b9-854c-a0dce230f365 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '1b4967cd7f464c4489cc4b664d0c20bd', 'request_id': 'req-b1646388-3d53-41b9-854c-a0dce230f365'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:50.660043 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b1646388-3d53-41b9-854c-a0dce230f365 admin admin] The token cache is being invalidate because project 1b4967cd7f464c4489cc4b664d0c20bd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:50.660334 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b1646388-3d53-41b9-854c-a0dce230f365 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:50.660977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-b1646388-3d53-41b9-854c-a0dce230f365 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:50.662591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1047/2140] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:50 2022] DELETE /identity/v3/projects/1b4967cd7f464c4489cc4b664d0c20bd => generated 0 bytes in 201 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:50.667593 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f5185-f780-4eab-9173-41d85ee2a522 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:50.667882 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f5185-f780-4eab-9173-41d85ee2a522 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:50.668157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-416f5185-f780-4eab-9173-41d85ee2a522 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:50.685196 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-416f5185-f780-4eab-9173-41d85ee2a522 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:50.686947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-416f5185-f780-4eab-9173-41d85ee2a522 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:50.757981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1094/2141] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:50.766331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00e0bb-a564-4cea-8073-84a0daefa697 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:50.766809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00e0bb-a564-4cea-8073-84a0daefa697 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:50.767097 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c00e0bb-a564-4cea-8073-84a0daefa697 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:50.785508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0c00e0bb-a564-4cea-8073-84a0daefa697 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:50.786720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0c00e0bb-a564-4cea-8073-84a0daefa697 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:50.795030 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1048/2142] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:50 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:50.800913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f5185-f780-4eab-9173-41d85ee2a522 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:50.814945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-416f5185-f780-4eab-9173-41d85ee2a522 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:50.820401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff721359-6fc2-417d-9ea3-47e7f6fe3ab5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:50.821120 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff721359-6fc2-417d-9ea3-47e7f6fe3ab5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:50.821496 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff721359-6fc2-417d-9ea3-47e7f6fe3ab5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:50.821778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff721359-6fc2-417d-9ea3-47e7f6fe3ab5 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:50.822509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff721359-6fc2-417d-9ea3-47e7f6fe3ab5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:50.822825 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff721359-6fc2-417d-9ea3-47e7f6fe3ab5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:50.824426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff721359-6fc2-417d-9ea3-47e7f6fe3ab5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:50.841308 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1095/2143] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:50 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:22:50.843920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00e0bb-a564-4cea-8073-84a0daefa697 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:50.853739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c00e0bb-a564-4cea-8073-84a0daefa697 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:50.858897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9265964-7b53-4016-8f6d-f6f4182dfc18 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:50.859759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9265964-7b53-4016-8f6d-f6f4182dfc18 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:50.860193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9265964-7b53-4016-8f6d-f6f4182dfc18 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:50.860615 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9265964-7b53-4016-8f6d-f6f4182dfc18 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:50.861486 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9265964-7b53-4016-8f6d-f6f4182dfc18 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:50.863538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9265964-7b53-4016-8f6d-f6f4182dfc18 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:50.897441 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1049/2144] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:50 2022] POST /identity/v3/projects => generated 387 bytes in 54 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:50.901485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff721359-6fc2-417d-9ea3-47e7f6fe3ab5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:50.911935 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff721359-6fc2-417d-9ea3-47e7f6fe3ab5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:50.970740 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351de2b-1164-4a4f-a376-099b0604e9de admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:50.971408 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351de2b-1164-4a4f-a376-099b0604e9de admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:50.971724 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351de2b-1164-4a4f-a376-099b0604e9de admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:50.972002 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e351de2b-1164-4a4f-a376-099b0604e9de admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:50.972704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351de2b-1164-4a4f-a376-099b0604e9de admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:50.974695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e351de2b-1164-4a4f-a376-099b0604e9de admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:50.994632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1096/2145] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:50 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:22:50.999449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9265964-7b53-4016-8f6d-f6f4182dfc18 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:51.011031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9265964-7b53-4016-8f6d-f6f4182dfc18 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:51.016552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64ea6f-489b-43fc-a748-722daba7f0e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:51.017252 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64ea6f-489b-43fc-a748-722daba7f0e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.017593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64ea6f-489b-43fc-a748-722daba7f0e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.017821 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a64ea6f-489b-43fc-a748-722daba7f0e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:51.018539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64ea6f-489b-43fc-a748-722daba7f0e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:51.020143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a64ea6f-489b-43fc-a748-722daba7f0e8 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:51.033742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1050/2146] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:50 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:51.034781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351de2b-1164-4a4f-a376-099b0604e9de admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:51.044703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e351de2b-1164-4a4f-a376-099b0604e9de admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:51.049738 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66eda1c6-2015-4f26-b51e-6c73e6e37d93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:51.050398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eda1c6-2015-4f26-b51e-6c73e6e37d93 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.050677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eda1c6-2015-4f26-b51e-6c73e6e37d93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.050951 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66eda1c6-2015-4f26-b51e-6c73e6e37d93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:51.051667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eda1c6-2015-4f26-b51e-6c73e6e37d93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:51.053313 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66eda1c6-2015-4f26-b51e-6c73e6e37d93 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:51.063910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1097/2147] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:51.068131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64ea6f-489b-43fc-a748-722daba7f0e8 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:51.075548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=85,keystone:DELETE=12,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:51.079152 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a64ea6f-489b-43fc-a748-722daba7f0e8 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:51.085071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6abf6-d558-4de2-a4f9-d6fa51730677 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:51.086557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6abf6-d558-4de2-a4f9-d6fa51730677 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.087052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6abf6-d558-4de2-a4f9-d6fa51730677 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.087335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a6abf6-d558-4de2-a4f9-d6fa51730677 admin admin] PATH_INFO: `/v3/projects/2fe9db9ff54140cb9814cf0a18c8fb99/users/06f347a32a184bcba917240c72b47f8e/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:51.106942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6abf6-d558-4de2-a4f9-d6fa51730677 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fe9db9ff54140cb9814cf0a18c8fb99, user_id=06f347a32a184bcba917240c72b47f8e, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:51.110413 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3a6abf6-d558-4de2-a4f9-d6fa51730677 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:51.127317 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1051/2148] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:51 2022] PUT /identity/v3/projects/2fe9db9ff54140cb9814cf0a18c8fb99/users/06f347a32a184bcba917240c72b47f8e/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:51.138190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e916ddd-6705-4f7f-babe-5d74053b4aeb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.138484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e916ddd-6705-4f7f-babe-5d74053b4aeb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.138789 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e916ddd-6705-4f7f-babe-5d74053b4aeb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:51.182123 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3e916ddd-6705-4f7f-babe-5d74053b4aeb None None] MFA Rules not processed for user `06f347a32a184bcba917240c72b47f8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:51.183450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3e916ddd-6705-4f7f-babe-5d74053b4aeb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:51.205686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:51.257490 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1098/2149] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:51.261870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6abf6-d558-4de2-a4f9-d6fa51730677 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:51.325791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a6abf6-d558-4de2-a4f9-d6fa51730677 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:51.331768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82494088-ee4c-49ba-92c1-4a412ea989a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:51.332528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82494088-ee4c-49ba-92c1-4a412ea989a6 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.332877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82494088-ee4c-49ba-92c1-4a412ea989a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.333218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82494088-ee4c-49ba-92c1-4a412ea989a6 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:51.333924 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82494088-ee4c-49ba-92c1-4a412ea989a6 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:51.336219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82494088-ee4c-49ba-92c1-4a412ea989a6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:51.364548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1052/2150] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:51 2022] POST /identity/v3/projects => generated 385 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:51.368593 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e916ddd-6705-4f7f-babe-5d74053b4aeb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:51.380282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e916ddd-6705-4f7f-babe-5d74053b4aeb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:51.440958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a4489-07a0-443a-be9a-7316cd1c56bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:51.441809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4489-07a0-443a-be9a-7316cd1c56bc admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.442041 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4489-07a0-443a-be9a-7316cd1c56bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.442318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-546a4489-07a0-443a-be9a-7316cd1c56bc admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:51.443188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a4489-07a0-443a-be9a-7316cd1c56bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:51.445357 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-546a4489-07a0-443a-be9a-7316cd1c56bc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:51.471897 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1099/2151] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:51 2022] POST /identity/v3/users => generated 293 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:51.477373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82494088-ee4c-49ba-92c1-4a412ea989a6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:51.491414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82494088-ee4c-49ba-92c1-4a412ea989a6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:51.496186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e58cf-b728-4aae-a673-3b884c452e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:51.496862 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e58cf-b728-4aae-a673-3b884c452e22 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.497282 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e58cf-b728-4aae-a673-3b884c452e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.497618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-358e58cf-b728-4aae-a673-3b884c452e22 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:51.498449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e58cf-b728-4aae-a673-3b884c452e22 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:51.500163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-358e58cf-b728-4aae-a673-3b884c452e22 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:51.515890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1053/2152] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:51.530047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a4489-07a0-443a-be9a-7316cd1c56bc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:51.545018 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-546a4489-07a0-443a-be9a-7316cd1c56bc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:51.551041 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-799d64fb-d1b4-4c3c-a760-c0e3bc2595d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:51.551724 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d64fb-d1b4-4c3c-a760-c0e3bc2595d5 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.552009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d64fb-d1b4-4c3c-a760-c0e3bc2595d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.552318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-799d64fb-d1b4-4c3c-a760-c0e3bc2595d5 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:51.553074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d64fb-d1b4-4c3c-a760-c0e3bc2595d5 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:51.554666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-799d64fb-d1b4-4c3c-a760-c0e3bc2595d5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:51.566268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1100/2153] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:51.570483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e58cf-b728-4aae-a673-3b884c452e22 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:51.580727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-358e58cf-b728-4aae-a673-3b884c452e22 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:51.586788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e163f2-3a72-496b-8f03-a140c915cd74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:51.588189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e163f2-3a72-496b-8f03-a140c915cd74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.588460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e163f2-3a72-496b-8f03-a140c915cd74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.588791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34e163f2-3a72-496b-8f03-a140c915cd74 admin admin] PATH_INFO: `/v3/projects/015cccbbac1c451c94a1226e3b09d7e6/users/2fe5454359ec4058aa0540d245eeab5c/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:51.608704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e163f2-3a72-496b-8f03-a140c915cd74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=015cccbbac1c451c94a1226e3b09d7e6, user_id=2fe5454359ec4058aa0540d245eeab5c, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:51.611484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34e163f2-3a72-496b-8f03-a140c915cd74 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:51.625645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1054/2154] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:51 2022] PUT /identity/v3/projects/015cccbbac1c451c94a1226e3b09d7e6/users/2fe5454359ec4058aa0540d245eeab5c/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:51.635463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d635-fbdd-44d0-8d56-593b10d4e358 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.635775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d635-fbdd-44d0-8d56-593b10d4e358 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.636053 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66f5d635-fbdd-44d0-8d56-593b10d4e358 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:51.673049 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-66f5d635-fbdd-44d0-8d56-593b10d4e358 None None] MFA Rules not processed for user `2fe5454359ec4058aa0540d245eeab5c`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:51.674209 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-66f5d635-fbdd-44d0-8d56-593b10d4e358 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:51.741170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1101/2155] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:51 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:51.745606 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e163f2-3a72-496b-8f03-a140c915cd74 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:51.806740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34e163f2-3a72-496b-8f03-a140c915cd74 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:51.811573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5970ced-ff53-405e-b2a2-c531a0d94564 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:51.812255 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5970ced-ff53-405e-b2a2-c531a0d94564 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.812538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5970ced-ff53-405e-b2a2-c531a0d94564 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.812816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5970ced-ff53-405e-b2a2-c531a0d94564 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:51.813559 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5970ced-ff53-405e-b2a2-c531a0d94564 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:51.815485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5970ced-ff53-405e-b2a2-c531a0d94564 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:51.839957 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1055/2156] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:22:51 2022] POST /identity/v3/projects => generated 387 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:51.844554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5d635-fbdd-44d0-8d56-593b10d4e358 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:51.855401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66f5d635-fbdd-44d0-8d56-593b10d4e358 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:51.878745 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:51.915544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27805980-5b39-45f6-96ab-d9dbfdf97d9d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:51.916313 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805980-5b39-45f6-96ab-d9dbfdf97d9d admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.916650 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805980-5b39-45f6-96ab-d9dbfdf97d9d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.916930 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27805980-5b39-45f6-96ab-d9dbfdf97d9d admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:51.917774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27805980-5b39-45f6-96ab-d9dbfdf97d9d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:51.919832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27805980-5b39-45f6-96ab-d9dbfdf97d9d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:51.940779 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1102/2157] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:22:51 2022] POST /identity/v3/users => generated 300 bytes in 97 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:22:51.944518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5970ced-ff53-405e-b2a2-c531a0d94564 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:51.955045 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a8e03-fbd2-4884-9aaf-6b6679ac4344 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.955406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a8e03-fbd2-4884-9aaf-6b6679ac4344 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.955690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-081a8e03-fbd2-4884-9aaf-6b6679ac4344 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:51.955901 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5970ced-ff53-405e-b2a2-c531a0d94564 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:51.960776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bf8be-e430-4953-afa8-3fd0323f89d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:51.961470 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bf8be-e430-4953-afa8-3fd0323f89d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.961754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bf8be-e430-4953-afa8-3fd0323f89d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.962036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-992bf8be-e430-4953-afa8-3fd0323f89d1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:51.962782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bf8be-e430-4953-afa8-3fd0323f89d1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:51.964390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-992bf8be-e430-4953-afa8-3fd0323f89d1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:51.973568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-081a8e03-fbd2-4884-9aaf-6b6679ac4344 None None] MFA Rules not processed for user `3cab4b811e944bc6af6d73927de3bd27`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:51.974780 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-081a8e03-fbd2-4884-9aaf-6b6679ac4344 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:51.975733 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1056/2158] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:51 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:22:51.979946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bf8be-e430-4953-afa8-3fd0323f89d1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:51.985834 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:51.989837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-992bf8be-e430-4953-afa8-3fd0323f89d1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:51.996383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddfa8b-0a10-4a4a-8b17-26e84bc091ea admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:51.997290 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddfa8b-0a10-4a4a-8b17-26e84bc091ea admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:51.997562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddfa8b-0a10-4a4a-8b17-26e84bc091ea admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:51.997837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8ddfa8b-0a10-4a4a-8b17-26e84bc091ea admin admin] PATH_INFO: `/v3/projects/f35dc4716c47471a970389acd6d3a023/users/bc2249bfcbd44ee38191940a35aa43cb/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:52.014093 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddfa8b-0a10-4a4a-8b17-26e84bc091ea admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35dc4716c47471a970389acd6d3a023, user_id=bc2249bfcbd44ee38191940a35aa43cb, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:52.017522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8ddfa8b-0a10-4a4a-8b17-26e84bc091ea admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:52.031578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1057/2159] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:51 2022] PUT /identity/v3/projects/f35dc4716c47471a970389acd6d3a023/users/bc2249bfcbd44ee38191940a35aa43cb/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:22:52.035408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddfa8b-0a10-4a4a-8b17-26e84bc091ea admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:52.039793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1103/2160] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:51 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:52.101144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8ddfa8b-0a10-4a4a-8b17-26e84bc091ea admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:52.106676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1840d02-2bb0-4bdd-8509-1bc9c1bc1f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:52.107380 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1840d02-2bb0-4bdd-8509-1bc9c1bc1f61 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:52.107668 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1840d02-2bb0-4bdd-8509-1bc9c1bc1f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:52.107940 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1840d02-2bb0-4bdd-8509-1bc9c1bc1f61 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:52.108656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1840d02-2bb0-4bdd-8509-1bc9c1bc1f61 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:52.110279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a1840d02-2bb0-4bdd-8509-1bc9c1bc1f61 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:52.123813 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1058/2161] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:22:52 2022] GET /identity/v3/roles => generated 1420 bytes in 85 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:22:52.125220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a8e03-fbd2-4884-9aaf-6b6679ac4344 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:52.135907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-081a8e03-fbd2-4884-9aaf-6b6679ac4344 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:52.140934 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c86f7d-11ee-4dc1-8ee2-eca59a8808a8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:52.143675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c86f7d-11ee-4dc1-8ee2-eca59a8808a8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:52.143967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c86f7d-11ee-4dc1-8ee2-eca59a8808a8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:52.144252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3c86f7d-11ee-4dc1-8ee2-eca59a8808a8 admin admin] PATH_INFO: `/v3/projects/f35dc4716c47471a970389acd6d3a023/users/bc2249bfcbd44ee38191940a35aa43cb/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:52.146315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c86f7d-11ee-4dc1-8ee2-eca59a8808a8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=f35dc4716c47471a970389acd6d3a023, user_id=bc2249bfcbd44ee38191940a35aa43cb, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:52.149202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3c86f7d-11ee-4dc1-8ee2-eca59a8808a8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:52.159944 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1104/2162] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:22:52 2022] PUT /identity/v3/projects/f35dc4716c47471a970389acd6d3a023/users/bc2249bfcbd44ee38191940a35aa43cb/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:52.169947 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4851ab-1c7c-4be4-a1a9-10253c8a1a16 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:52.170272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4851ab-1c7c-4be4-a1a9-10253c8a1a16 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:52.170556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea4851ab-1c7c-4be4-a1a9-10253c8a1a16 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:52.197588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ea4851ab-1c7c-4be4-a1a9-10253c8a1a16 None None] MFA Rules not processed for user `bc2249bfcbd44ee38191940a35aa43cb`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:52.198787 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ea4851ab-1c7c-4be4-a1a9-10253c8a1a16 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:52.270402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1059/2163] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:52 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:52.280955 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c86f7d-11ee-4dc1-8ee2-eca59a8808a8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:52.282764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e3c86f7d-11ee-4dc1-8ee2-eca59a8808a8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:52.345100 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3c86f7d-11ee-4dc1-8ee2-eca59a8808a8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:52.348727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa748a-8028-41de-959c-0724a9a455ed service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:52.349424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa748a-8028-41de-959c-0724a9a455ed service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:52.349700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa748a-8028-41de-959c-0724a9a455ed service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:52.349971 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9aa748a-8028-41de-959c-0724a9a455ed service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:52.361127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa748a-8028-41de-959c-0724a9a455ed service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:52.363054 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9aa748a-8028-41de-959c-0724a9a455ed service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:52.374419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1105/2164] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:52 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:53.227203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4851ab-1c7c-4be4-a1a9-10253c8a1a16 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:53.241360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea4851ab-1c7c-4be4-a1a9-10253c8a1a16 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:53.246299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0fa24-a441-469c-9a59-5bca920c8c70 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:53.246967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0fa24-a441-469c-9a59-5bca920c8c70 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:53.247266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0fa24-a441-469c-9a59-5bca920c8c70 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:53.247533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e0fa24-a441-469c-9a59-5bca920c8c70 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:53.314582 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0fa24-a441-469c-9a59-5bca920c8c70 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:53.316314 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e0fa24-a441-469c-9a59-5bca920c8c70 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:53.321877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:53.328645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1060/2165] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:53 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:57.528464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa748a-8028-41de-959c-0724a9a455ed service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:57.530464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c9aa748a-8028-41de-959c-0724a9a455ed service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:57.541786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9aa748a-8028-41de-959c-0724a9a455ed service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:57.546195 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2da98c-baa8-4e32-857a-46886c2dd8aa service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:57.546848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2da98c-baa8-4e32-857a-46886c2dd8aa service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:57.547120 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2da98c-baa8-4e32-857a-46886c2dd8aa service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:57.547397 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2da98c-baa8-4e32-857a-46886c2dd8aa service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:57.594806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:57.608056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2da98c-baa8-4e32-857a-46886c2dd8aa service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:57.609518 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2da98c-baa8-4e32-857a-46886c2dd8aa service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:57.618624 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1106/2166] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:57 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:58.962395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0fa24-a441-469c-9a59-5bca920c8c70 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:58.963821 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-62e0fa24-a441-469c-9a59-5bca920c8c70 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:59.027980 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e0fa24-a441-469c-9a59-5bca920c8c70 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:59.033020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505cb7e-339d-4020-b6a3-726e7df53c72 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:59.033887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505cb7e-339d-4020-b6a3-726e7df53c72 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:59.034169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505cb7e-339d-4020-b6a3-726e7df53c72 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:59.034446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e505cb7e-339d-4020-b6a3-726e7df53c72 admin admin] PATH_INFO: `/v3/users/eeabf32118c94a3091839933b6bbab37` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:59.035613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505cb7e-339d-4020-b6a3-726e7df53c72 admin admin] RBAC: Authorizing `identity:delete_user(user_id=eeabf32118c94a3091839933b6bbab37)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:59.037579 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e505cb7e-339d-4020-b6a3-726e7df53c72 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:59.083810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e505cb7e-339d-4020-b6a3-726e7df53c72 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'eeabf32118c94a3091839933b6bbab37'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:59.090651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e505cb7e-339d-4020-b6a3-726e7df53c72 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'eeabf32118c94a3091839933b6bbab37'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:59.091313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e505cb7e-339d-4020-b6a3-726e7df53c72 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'eeabf32118c94a3091839933b6bbab37'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:59.103920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e505cb7e-339d-4020-b6a3-726e7df53c72 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'eeabf32118c94a3091839933b6bbab37'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:59.111579 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e505cb7e-339d-4020-b6a3-726e7df53c72 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'eeabf32118c94a3091839933b6bbab37'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:59.117989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1061/2167] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:58 2022] DELETE /identity/v3/users/eeabf32118c94a3091839933b6bbab37 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:59.122471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97355095-00c8-410b-80f1-32dde775816d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:59.122947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97355095-00c8-410b-80f1-32dde775816d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:59.123052 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97355095-00c8-410b-80f1-32dde775816d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:59.140576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-97355095-00c8-410b-80f1-32dde775816d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:59.141990 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-97355095-00c8-410b-80f1-32dde775816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:59.203233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1107/2168] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:59.212951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505cb7e-339d-4020-b6a3-726e7df53c72 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:59.214372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e505cb7e-339d-4020-b6a3-726e7df53c72 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:59.275909 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e505cb7e-339d-4020-b6a3-726e7df53c72 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:59.280082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-887a9dba-b7aa-4fd7-92b2-df8c371d2ae3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:59.280729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a9dba-b7aa-4fd7-92b2-df8c371d2ae3 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:59.281046 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a9dba-b7aa-4fd7-92b2-df8c371d2ae3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:59.281328 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-887a9dba-b7aa-4fd7-92b2-df8c371d2ae3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:59.290404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a9dba-b7aa-4fd7-92b2-df8c371d2ae3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:59.291835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-887a9dba-b7aa-4fd7-92b2-df8c371d2ae3 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:59.301237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1062/2169] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:22:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:22:59.608200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97355095-00c8-410b-80f1-32dde775816d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:59.610392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-97355095-00c8-410b-80f1-32dde775816d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:59.645558 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97355095-00c8-410b-80f1-32dde775816d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:59.655078 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:59.656248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:59.656445 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:59.656786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] PATH_INFO: `/v3/projects/fa04870f6c474f058c8ad5807fe58ee8` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:59.658058 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] RBAC: Authorizing `identity:delete_project(project_id=fa04870f6c474f058c8ad5807fe58ee8)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:59.660511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:59.726064 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'fa04870f6c474f058c8ad5807fe58ee8', 'request_id': 'req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:59.734853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'fa04870f6c474f058c8ad5807fe58ee8', 'request_id': 'req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:59.743056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'fa04870f6c474f058c8ad5807fe58ee8', 'request_id': 'req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:59.756409 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] The token cache is being invalidate because project fa04870f6c474f058c8ad5807fe58ee8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:22:59.756705 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:59.757380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:22:59.759258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1108/2170] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:22:59 2022] DELETE /identity/v3/projects/fa04870f6c474f058c8ad5807fe58ee8 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:22:59.764338 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58cfb2-144f-49e1-8970-bb9758354191 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:59.764657 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58cfb2-144f-49e1-8970-bb9758354191 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:59.764964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f58cfb2-144f-49e1-8970-bb9758354191 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:59.790201 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3f58cfb2-144f-49e1-8970-bb9758354191 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:59.791476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3f58cfb2-144f-49e1-8970-bb9758354191 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:59.814979 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:22:59.866284 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:59.867603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:59.896460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1063/2171] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:22:59.905301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888482-feba-424c-ad4b-3ea6054bb4dc None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:59.905655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888482-feba-424c-ad4b-3ea6054bb4dc None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:59.905945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1888482-feba-424c-ad4b-3ea6054bb4dc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:59.931815 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e1888482-feba-424c-ad4b-3ea6054bb4dc None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:22:59.933563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e1888482-feba-424c-ad4b-3ea6054bb4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:22:59.944416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1064/2172] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:22:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:22:59.953494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1888482-feba-424c-ad4b-3ea6054bb4dc None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:22:59.962534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5dfe5102-aa57-4bcc-b560-eb1f6f9a71ae admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:59.964039 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1888482-feba-424c-ad4b-3ea6054bb4dc None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:22:59.971418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c018da4a-d39b-418d-840a-4110ea4a84bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:59.972053 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018da4a-d39b-418d-840a-4110ea4a84bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:59.972407 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018da4a-d39b-418d-840a-4110ea4a84bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:59.972751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c018da4a-d39b-418d-840a-4110ea4a84bb admin admin] PATH_INFO: `/v3/users/06f347a32a184bcba917240c72b47f8e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:59.974251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018da4a-d39b-418d-840a-4110ea4a84bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=06f347a32a184bcba917240c72b47f8e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:59.975059 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4898797-793c-4fe5-af76-1ec41e626dce admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:22:59.976147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c018da4a-d39b-418d-840a-4110ea4a84bb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:59.976279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4898797-793c-4fe5-af76-1ec41e626dce admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:22:59.976954 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4898797-793c-4fe5-af76-1ec41e626dce admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:22:59.977381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4898797-793c-4fe5-af76-1ec41e626dce admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:22:59.978184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4898797-793c-4fe5-af76-1ec41e626dce admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:22:59.978498 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4898797-793c-4fe5-af76-1ec41e626dce admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:22:59.981220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4898797-793c-4fe5-af76-1ec41e626dce admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:22:59.993550 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:00.005032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1065/2173] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:22:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:23:00.006680 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4898797-793c-4fe5-af76-1ec41e626dce admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:00.021533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4898797-793c-4fe5-af76-1ec41e626dce admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:00.026607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890040a9-c367-4db7-a426-29c183ef5616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:00.027266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890040a9-c367-4db7-a426-29c183ef5616 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:00.027554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890040a9-c367-4db7-a426-29c183ef5616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:00.027832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-890040a9-c367-4db7-a426-29c183ef5616 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:00.028578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890040a9-c367-4db7-a426-29c183ef5616 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:00.031322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-890040a9-c367-4db7-a426-29c183ef5616 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:00.035593 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c018da4a-d39b-418d-840a-4110ea4a84bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '06f347a32a184bcba917240c72b47f8e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.036246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c018da4a-d39b-418d-840a-4110ea4a84bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '06f347a32a184bcba917240c72b47f8e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.043287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c018da4a-d39b-418d-840a-4110ea4a84bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '06f347a32a184bcba917240c72b47f8e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.043928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c018da4a-d39b-418d-840a-4110ea4a84bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '06f347a32a184bcba917240c72b47f8e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.056561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c018da4a-d39b-418d-840a-4110ea4a84bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '06f347a32a184bcba917240c72b47f8e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.059146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1066/2174] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:23:00 2022] POST /identity/v3/projects => generated 387 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:23:00.065203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890040a9-c367-4db7-a426-29c183ef5616 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:00.066811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-890040a9-c367-4db7-a426-29c183ef5616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:00.069206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1109/2175] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:22:59 2022] DELETE /identity/v3/users/06f347a32a184bcba917240c72b47f8e => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:23:00.073406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8227b-b830-421f-a3b7-96e63f2fa74a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:00.073755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8227b-b830-421f-a3b7-96e63f2fa74a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:00.074035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b8227b-b830-421f-a3b7-96e63f2fa74a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:00.092615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d7b8227b-b830-421f-a3b7-96e63f2fa74a None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:00.093855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d7b8227b-b830-421f-a3b7-96e63f2fa74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:00.131414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-890040a9-c367-4db7-a426-29c183ef5616 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:00.164097 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1110/2176] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:23:00.176393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8227b-b830-421f-a3b7-96e63f2fa74a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:00.178152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d7b8227b-b830-421f-a3b7-96e63f2fa74a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:00.201078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf5fd1-73bd-4ad4-b5f6-590729978507 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:00.201689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5fd1-73bd-4ad4-b5f6-590729978507 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:00.201976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5fd1-73bd-4ad4-b5f6-590729978507 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:00.202256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59cf5fd1-73bd-4ad4-b5f6-590729978507 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:00.202940 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf5fd1-73bd-4ad4-b5f6-590729978507 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:00.204868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59cf5fd1-73bd-4ad4-b5f6-590729978507 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:00.225039 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1067/2177] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:23:00 2022] POST /identity/v3/users => generated 294 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:00.229050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf5fd1-73bd-4ad4-b5f6-590729978507 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:00.239103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59cf5fd1-73bd-4ad4-b5f6-590729978507 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:00.239263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b8227b-b830-421f-a3b7-96e63f2fa74a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:00.242921 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7eeca4-91a2-4e0f-be99-7bf63eea4558 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:00.243704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d60e7f-82d2-4afd-acec-b216bce4f1e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:00.243826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eeca4-91a2-4e0f-be99-7bf63eea4558 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:00.244001 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eeca4-91a2-4e0f-be99-7bf63eea4558 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:00.244282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef7eeca4-91a2-4e0f-be99-7bf63eea4558 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:00.244373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d60e7f-82d2-4afd-acec-b216bce4f1e8 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:00.244611 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d60e7f-82d2-4afd-acec-b216bce4f1e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:00.244893 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24d60e7f-82d2-4afd-acec-b216bce4f1e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:00.245637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d60e7f-82d2-4afd-acec-b216bce4f1e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:00.247232 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24d60e7f-82d2-4afd-acec-b216bce4f1e8 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:00.254301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7eeca4-91a2-4e0f-be99-7bf63eea4558 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:00.255731 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef7eeca4-91a2-4e0f-be99-7bf63eea4558 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:00.260663 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1068/2178] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:23:00.261993 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d60e7f-82d2-4afd-acec-b216bce4f1e8 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:00.265562 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1111/2179] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:23:00.271529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24d60e7f-82d2-4afd-acec-b216bce4f1e8 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:00.276036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acadfe9f-b950-47af-a3d9-36c1fad269b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:00.276684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadfe9f-b950-47af-a3d9-36c1fad269b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:00.277007 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadfe9f-b950-47af-a3d9-36c1fad269b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:00.277289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acadfe9f-b950-47af-a3d9-36c1fad269b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:00.278000 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadfe9f-b950-47af-a3d9-36c1fad269b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:00.280120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acadfe9f-b950-47af-a3d9-36c1fad269b4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:00.281493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:00.296225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1069/2180] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:00 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:23:00.297340 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7eeca4-91a2-4e0f-be99-7bf63eea4558 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:00.306807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef7eeca4-91a2-4e0f-be99-7bf63eea4558 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:00.311634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5925925-093f-4b11-b243-44b712353691 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:00.312563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5925925-093f-4b11-b243-44b712353691 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:00.312967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5925925-093f-4b11-b243-44b712353691 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:00.313278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5925925-093f-4b11-b243-44b712353691 admin admin] PATH_INFO: `/v3/projects/c5a600d706504ef0b04cf57c6bce913c/users/7779725522d4409bbd09f3c4fd07df31/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:00.329811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5925925-093f-4b11-b243-44b712353691 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c5a600d706504ef0b04cf57c6bce913c, user_id=7779725522d4409bbd09f3c4fd07df31, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:00.332703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5925925-093f-4b11-b243-44b712353691 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:00.347808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1112/2181] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:00 2022] PUT /identity/v3/projects/c5a600d706504ef0b04cf57c6bce913c/users/7779725522d4409bbd09f3c4fd07df31/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:23:00.359637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56deaf-3344-4384-9558-bd7bebe59bc3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:00.359920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56deaf-3344-4384-9558-bd7bebe59bc3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:00.360201 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc56deaf-3344-4384-9558-bd7bebe59bc3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:00.387832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-bc56deaf-3344-4384-9558-bd7bebe59bc3 None None] MFA Rules not processed for user `7779725522d4409bbd09f3c4fd07df31`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:00.389086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bc56deaf-3344-4384-9558-bd7bebe59bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:00.464315 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1070/2182] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:00 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:00.476259 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5925925-093f-4b11-b243-44b712353691 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:00.479277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b5925925-093f-4b11-b243-44b712353691 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:00.494735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=9,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:00.539697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56deaf-3344-4384-9558-bd7bebe59bc3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:00.541206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bc56deaf-3344-4384-9558-bd7bebe59bc3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:00.549110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5925925-093f-4b11-b243-44b712353691 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:00.553474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd0a6-bb35-4363-a02a-c82ea4802377 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:00.554133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd0a6-bb35-4363-a02a-c82ea4802377 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:00.554415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd0a6-bb35-4363-a02a-c82ea4802377 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:00.554716 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99dd0a6-bb35-4363-a02a-c82ea4802377 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:00.564324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dd0a6-bb35-4363-a02a-c82ea4802377 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:00.566077 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99dd0a6-bb35-4363-a02a-c82ea4802377 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:00.577438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1113/2183] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:00 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:00.623847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc56deaf-3344-4384-9558-bd7bebe59bc3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:00.628757 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:00.629749 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:00.630033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:00.630305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] PATH_INFO: `/v3/projects/2fe9db9ff54140cb9814cf0a18c8fb99` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:00.631474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fe9db9ff54140cb9814cf0a18c8fb99)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:00.633661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:00.681227 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fe9db9ff54140cb9814cf0a18c8fb99', 'request_id': 'req-8e348d0a-410c-44f4-855a-86e830b534fd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.690165 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fe9db9ff54140cb9814cf0a18c8fb99', 'request_id': 'req-8e348d0a-410c-44f4-855a-86e830b534fd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.696380 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fe9db9ff54140cb9814cf0a18c8fb99', 'request_id': 'req-8e348d0a-410c-44f4-855a-86e830b534fd'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.708653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] The token cache is being invalidate because project 2fe9db9ff54140cb9814cf0a18c8fb99 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:00.708962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.709646 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.711248 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1071/2184] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:00 2022] DELETE /identity/v3/projects/2fe9db9ff54140cb9814cf0a18c8fb99 => generated 0 bytes in 172 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:23:00.715328 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd0a6-bb35-4363-a02a-c82ea4802377 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:00.726902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99dd0a6-bb35-4363-a02a-c82ea4802377 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:00.794607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779c06-ee92-4d5f-abd0-9bc9bce91d29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:00.796113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779c06-ee92-4d5f-abd0-9bc9bce91d29 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:00.796424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779c06-ee92-4d5f-abd0-9bc9bce91d29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:00.796673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5779c06-ee92-4d5f-abd0-9bc9bce91d29 admin admin] PATH_INFO: `/v3/users/2fe5454359ec4058aa0540d245eeab5c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:00.799690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5779c06-ee92-4d5f-abd0-9bc9bce91d29 admin admin] RBAC: Authorizing `identity:delete_user(user_id=2fe5454359ec4058aa0540d245eeab5c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:00.800533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5779c06-ee92-4d5f-abd0-9bc9bce91d29 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:00.883152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a5779c06-ee92-4d5f-abd0-9bc9bce91d29 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2fe5454359ec4058aa0540d245eeab5c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.885203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a5779c06-ee92-4d5f-abd0-9bc9bce91d29 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2fe5454359ec4058aa0540d245eeab5c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.900110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a5779c06-ee92-4d5f-abd0-9bc9bce91d29 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2fe5454359ec4058aa0540d245eeab5c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.908481 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a5779c06-ee92-4d5f-abd0-9bc9bce91d29 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2fe5454359ec4058aa0540d245eeab5c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.924211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a5779c06-ee92-4d5f-abd0-9bc9bce91d29 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2fe5454359ec4058aa0540d245eeab5c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:00.943129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1114/2185] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:23:00 2022] DELETE /identity/v3/users/2fe5454359ec4058aa0540d245eeab5c => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:23:01.469783 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:01.471275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:01.485772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e348d0a-410c-44f4-855a-86e830b534fd admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:01.497582 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:01.545651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:01.546511 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:01.546788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:01.547059 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] PATH_INFO: `/v3/projects/015cccbbac1c451c94a1226e3b09d7e6` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:01.548234 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=015cccbbac1c451c94a1226e3b09d7e6)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:01.550184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:01.595090 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '015cccbbac1c451c94a1226e3b09d7e6', 'request_id': 'req-a530bb29-78c3-4de2-ae31-d44322e2dbe6'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:01.601826 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '015cccbbac1c451c94a1226e3b09d7e6', 'request_id': 'req-a530bb29-78c3-4de2-ae31-d44322e2dbe6'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:01.608040 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '015cccbbac1c451c94a1226e3b09d7e6', 'request_id': 'req-a530bb29-78c3-4de2-ae31-d44322e2dbe6'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:01.618547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] The token cache is being invalidate because project 015cccbbac1c451c94a1226e3b09d7e6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:01.618832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:01.619450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:01.620973 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1072/2186] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:01 2022] DELETE /identity/v3/projects/015cccbbac1c451c94a1226e3b09d7e6 => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:01.625796 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779c06-ee92-4d5f-abd0-9bc9bce91d29 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:01.627273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a5779c06-ee92-4d5f-abd0-9bc9bce91d29 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:01.639683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5779c06-ee92-4d5f-abd0-9bc9bce91d29 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:01.672133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:01.703722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a50acbd-f28b-4e08-8d30-77e6c1c1ce09 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:01.704602 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50acbd-f28b-4e08-8d30-77e6c1c1ce09 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:01.704889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50acbd-f28b-4e08-8d30-77e6c1c1ce09 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:01.705195 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a50acbd-f28b-4e08-8d30-77e6c1c1ce09 admin admin] PATH_INFO: `/v3/users/bc2249bfcbd44ee38191940a35aa43cb` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:01.706386 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50acbd-f28b-4e08-8d30-77e6c1c1ce09 admin admin] RBAC: Authorizing `identity:delete_user(user_id=bc2249bfcbd44ee38191940a35aa43cb)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:01.708381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a50acbd-f28b-4e08-8d30-77e6c1c1ce09 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:01.757136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3a50acbd-f28b-4e08-8d30-77e6c1c1ce09 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'bc2249bfcbd44ee38191940a35aa43cb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:01.757710 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3a50acbd-f28b-4e08-8d30-77e6c1c1ce09 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'bc2249bfcbd44ee38191940a35aa43cb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:01.764806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3a50acbd-f28b-4e08-8d30-77e6c1c1ce09 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'bc2249bfcbd44ee38191940a35aa43cb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:01.765586 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3a50acbd-f28b-4e08-8d30-77e6c1c1ce09 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'bc2249bfcbd44ee38191940a35aa43cb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:01.778295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3a50acbd-f28b-4e08-8d30-77e6c1c1ce09 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'bc2249bfcbd44ee38191940a35aa43cb'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:01.791870 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1115/2187] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:23:01 2022] DELETE /identity/v3/users/bc2249bfcbd44ee38191940a35aa43cb => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:02.067403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:02.069768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:02.084264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a530bb29-78c3-4de2-ae31-d44322e2dbe6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:02.167509 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9298e0-746e-425d-8f8d-a20781830e84 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:02.168482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9298e0-746e-425d-8f8d-a20781830e84 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:02.168667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9298e0-746e-425d-8f8d-a20781830e84 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:02.168940 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9298e0-746e-425d-8f8d-a20781830e84 admin admin] PATH_INFO: `/v3/projects/f35dc4716c47471a970389acd6d3a023` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:02.171487 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9298e0-746e-425d-8f8d-a20781830e84 admin admin] RBAC: Authorizing `identity:delete_project(project_id=f35dc4716c47471a970389acd6d3a023)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:02.174649 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9298e0-746e-425d-8f8d-a20781830e84 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:02.236016 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=88,keystone:DELETE=11,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:02.237521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fc9298e0-746e-425d-8f8d-a20781830e84 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'f35dc4716c47471a970389acd6d3a023', 'request_id': 'req-fc9298e0-746e-425d-8f8d-a20781830e84'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:02.245727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fc9298e0-746e-425d-8f8d-a20781830e84 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'f35dc4716c47471a970389acd6d3a023', 'request_id': 'req-fc9298e0-746e-425d-8f8d-a20781830e84'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:02.251834 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fc9298e0-746e-425d-8f8d-a20781830e84 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'f35dc4716c47471a970389acd6d3a023', 'request_id': 'req-fc9298e0-746e-425d-8f8d-a20781830e84'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:02.262942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fc9298e0-746e-425d-8f8d-a20781830e84 admin admin] The token cache is being invalidate because project f35dc4716c47471a970389acd6d3a023 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:02.263305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fc9298e0-746e-425d-8f8d-a20781830e84 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:02.264729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-fc9298e0-746e-425d-8f8d-a20781830e84 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:02.266353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1073/2188] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:02 2022] DELETE /identity/v3/projects/f35dc4716c47471a970389acd6d3a023 => generated 0 bytes in 200 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:02.272243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c467c9-ab08-4c88-a997-90eaa0921793 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:02.272542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c467c9-ab08-4c88-a997-90eaa0921793 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:02.272824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47c467c9-ab08-4c88-a997-90eaa0921793 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:02.292556 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-47c467c9-ab08-4c88-a997-90eaa0921793 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:02.293798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-47c467c9-ab08-4c88-a997-90eaa0921793 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:02.357043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1116/2189] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:02.365205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80de8e0-d7a0-4b51-aa9c-b8a18e26a040 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:02.365566 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80de8e0-d7a0-4b51-aa9c-b8a18e26a040 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:02.365912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80de8e0-d7a0-4b51-aa9c-b8a18e26a040 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:02.384367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a80de8e0-d7a0-4b51-aa9c-b8a18e26a040 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:02.385592 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a80de8e0-d7a0-4b51-aa9c-b8a18e26a040 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:02.394005 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1074/2190] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:02 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:02.398185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c467c9-ab08-4c88-a997-90eaa0921793 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:02.407912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47c467c9-ab08-4c88-a997-90eaa0921793 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:02.420138 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84104c-3621-49f1-ae3c-d1857a31084c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:02.420812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84104c-3621-49f1-ae3c-d1857a31084c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:02.421121 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84104c-3621-49f1-ae3c-d1857a31084c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:02.421400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df84104c-3621-49f1-ae3c-d1857a31084c admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:02.422132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84104c-3621-49f1-ae3c-d1857a31084c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:23:02.422438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84104c-3621-49f1-ae3c-d1857a31084c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:02.424106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df84104c-3621-49f1-ae3c-d1857a31084c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:02.436767 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1117/2191] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:23:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:23:02.441180 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80de8e0-d7a0-4b51-aa9c-b8a18e26a040 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:02.450139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80de8e0-d7a0-4b51-aa9c-b8a18e26a040 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:02.455293 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34319f1a-0226-41f7-8f84-c4edafdce0d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:02.455946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319f1a-0226-41f7-8f84-c4edafdce0d5 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:02.456230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319f1a-0226-41f7-8f84-c4edafdce0d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:02.456504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34319f1a-0226-41f7-8f84-c4edafdce0d5 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:02.457374 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34319f1a-0226-41f7-8f84-c4edafdce0d5 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:02.459292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34319f1a-0226-41f7-8f84-c4edafdce0d5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:02.487345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1075/2192] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:23:02 2022] POST /identity/v3/projects => generated 401 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:02.491147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84104c-3621-49f1-ae3c-d1857a31084c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:02.502064 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df84104c-3621-49f1-ae3c-d1857a31084c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:02.540654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:02.562508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231974e-ff0e-4796-8530-d7ac0e3e8c87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:02.563197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231974e-ff0e-4796-8530-d7ac0e3e8c87 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:02.563484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231974e-ff0e-4796-8530-d7ac0e3e8c87 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:02.563850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b231974e-ff0e-4796-8530-d7ac0e3e8c87 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:02.564550 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231974e-ff0e-4796-8530-d7ac0e3e8c87 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:02.566553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b231974e-ff0e-4796-8530-d7ac0e3e8c87 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:02.593874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1118/2193] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:23:02 2022] POST /identity/v3/users => generated 301 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:02.595216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34319f1a-0226-41f7-8f84-c4edafdce0d5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:02.605938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34319f1a-0226-41f7-8f84-c4edafdce0d5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:02.611522 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9316b-72c1-462e-af5c-5b1b0c8d00e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:02.612186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9316b-72c1-462e-af5c-5b1b0c8d00e6 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:02.612466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9316b-72c1-462e-af5c-5b1b0c8d00e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:02.612767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26b9316b-72c1-462e-af5c-5b1b0c8d00e6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:02.613550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9316b-72c1-462e-af5c-5b1b0c8d00e6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:02.615230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26b9316b-72c1-462e-af5c-5b1b0c8d00e6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:02.626709 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1076/2194] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:02.630755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231974e-ff0e-4796-8530-d7ac0e3e8c87 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:02.641580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b231974e-ff0e-4796-8530-d7ac0e3e8c87 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:02.646244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a09af90-702a-447e-86a0-796ed3159c46 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:02.646896 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09af90-702a-447e-86a0-796ed3159c46 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:02.647173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09af90-702a-447e-86a0-796ed3159c46 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:02.647444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a09af90-702a-447e-86a0-796ed3159c46 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:02.648158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09af90-702a-447e-86a0-796ed3159c46 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:02.649980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a09af90-702a-447e-86a0-796ed3159c46 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:02.662000 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1119/2195] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:02 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:23:02.666258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9316b-72c1-462e-af5c-5b1b0c8d00e6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:02.678395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26b9316b-72c1-462e-af5c-5b1b0c8d00e6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:02.683601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273076c-82ee-4666-a932-2c52f087d89e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:02.684122 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273076c-82ee-4666-a932-2c52f087d89e admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:02.684402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273076c-82ee-4666-a932-2c52f087d89e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:02.684709 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1273076c-82ee-4666-a932-2c52f087d89e admin admin] PATH_INFO: `/v3/projects/502a27c43c3e40598e2200325b388b4c/users/69025ab87839405098604ca903abf0f9/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:02.700557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273076c-82ee-4666-a932-2c52f087d89e admin admin] RBAC: Authorizing `identity:create_grant(project_id=502a27c43c3e40598e2200325b388b4c, user_id=69025ab87839405098604ca903abf0f9, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:02.705372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1273076c-82ee-4666-a932-2c52f087d89e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:02.718136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1077/2196] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:02 2022] PUT /identity/v3/projects/502a27c43c3e40598e2200325b388b4c/users/69025ab87839405098604ca903abf0f9/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:02.729553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b510adb-6e2f-41e2-9afb-61b917817b1d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:02.729909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b510adb-6e2f-41e2-9afb-61b917817b1d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:02.730253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b510adb-6e2f-41e2-9afb-61b917817b1d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:02.758603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9b510adb-6e2f-41e2-9afb-61b917817b1d None None] MFA Rules not processed for user `69025ab87839405098604ca903abf0f9`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:02.759801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9b510adb-6e2f-41e2-9afb-61b917817b1d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:02.824797 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1120/2197] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:02 2022] POST /identity/v3/auth/tokens => generated 3268 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:02.829872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273076c-82ee-4666-a932-2c52f087d89e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:02.900445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1273076c-82ee-4666-a932-2c52f087d89e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:02.905287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa398fe-1cd1-4097-9fac-eec55c20f9b1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:02.905947 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa398fe-1cd1-4097-9fac-eec55c20f9b1 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:02.906227 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa398fe-1cd1-4097-9fac-eec55c20f9b1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:02.906503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa398fe-1cd1-4097-9fac-eec55c20f9b1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:02.907192 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa398fe-1cd1-4097-9fac-eec55c20f9b1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:02.909146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa398fe-1cd1-4097-9fac-eec55c20f9b1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:02.940791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1078/2198] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:23:02 2022] POST /identity/v3/projects => generated 399 bytes in 109 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:02.942019 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b510adb-6e2f-41e2-9afb-61b917817b1d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:02.952897 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b510adb-6e2f-41e2-9afb-61b917817b1d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:03.015176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc459d2a-8389-4eb1-995a-3693dd642547 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:03.015850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc459d2a-8389-4eb1-995a-3693dd642547 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:03.016195 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc459d2a-8389-4eb1-995a-3693dd642547 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:03.016483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc459d2a-8389-4eb1-995a-3693dd642547 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:03.017219 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc459d2a-8389-4eb1-995a-3693dd642547 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:03.019141 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc459d2a-8389-4eb1-995a-3693dd642547 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:03.048130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1121/2199] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:23:02 2022] POST /identity/v3/users => generated 306 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:03.054626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa398fe-1cd1-4097-9fac-eec55c20f9b1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:03.066676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa398fe-1cd1-4097-9fac-eec55c20f9b1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:03.071488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3571865-fd32-4f67-925a-e4d775827f11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:03.072150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3571865-fd32-4f67-925a-e4d775827f11 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:03.072443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3571865-fd32-4f67-925a-e4d775827f11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:03.072725 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3571865-fd32-4f67-925a-e4d775827f11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:03.073494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3571865-fd32-4f67-925a-e4d775827f11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:03.075138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3571865-fd32-4f67-925a-e4d775827f11 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:03.086475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1079/2200] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:03.090936 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc459d2a-8389-4eb1-995a-3693dd642547 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:03.104295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc459d2a-8389-4eb1-995a-3693dd642547 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:03.110618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e89eee-5137-4094-afba-5ebdb3ded118 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:03.111586 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e89eee-5137-4094-afba-5ebdb3ded118 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:03.111923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e89eee-5137-4094-afba-5ebdb3ded118 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:03.112320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e89eee-5137-4094-afba-5ebdb3ded118 admin admin] PATH_INFO: `/v3/projects/79afe6e2d2a7480f91705a1f00a2e90b/users/b3720aa6d28e41dab0e69b80cff6c4ff/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:03.131664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e89eee-5137-4094-afba-5ebdb3ded118 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79afe6e2d2a7480f91705a1f00a2e90b, user_id=b3720aa6d28e41dab0e69b80cff6c4ff, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:03.135050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e89eee-5137-4094-afba-5ebdb3ded118 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:03.156006 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1122/2201] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:03 2022] PUT /identity/v3/projects/79afe6e2d2a7480f91705a1f00a2e90b/users/b3720aa6d28e41dab0e69b80cff6c4ff/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 66 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:23:03.159969 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3571865-fd32-4f67-925a-e4d775827f11 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:03.173155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3571865-fd32-4f67-925a-e4d775827f11 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:03.233282 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:03.250062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-747809b5-e41f-448e-8ba7-1b0e68d7d44b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:03.250809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747809b5-e41f-448e-8ba7-1b0e68d7d44b admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:03.251166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747809b5-e41f-448e-8ba7-1b0e68d7d44b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:03.251515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-747809b5-e41f-448e-8ba7-1b0e68d7d44b admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:03.252318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747809b5-e41f-448e-8ba7-1b0e68d7d44b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:03.254196 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-747809b5-e41f-448e-8ba7-1b0e68d7d44b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:03.266296 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1080/2202] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:03 2022] GET /identity/v3/roles => generated 1420 bytes in 107 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:03.270213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e89eee-5137-4094-afba-5ebdb3ded118 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:03.282122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e89eee-5137-4094-afba-5ebdb3ded118 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:03.288240 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546dd2c-43fc-4985-99b0-49d23380fa36 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:03.289171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546dd2c-43fc-4985-99b0-49d23380fa36 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:03.289455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546dd2c-43fc-4985-99b0-49d23380fa36 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:03.289747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d546dd2c-43fc-4985-99b0-49d23380fa36 admin admin] PATH_INFO: `/v3/projects/79afe6e2d2a7480f91705a1f00a2e90b/users/b3720aa6d28e41dab0e69b80cff6c4ff/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:03.291964 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546dd2c-43fc-4985-99b0-49d23380fa36 admin admin] RBAC: Authorizing `identity:create_grant(project_id=79afe6e2d2a7480f91705a1f00a2e90b, user_id=b3720aa6d28e41dab0e69b80cff6c4ff, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:03.295493 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d546dd2c-43fc-4985-99b0-49d23380fa36 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:03.303408 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:INSERT=8 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:03.320806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1123/2203] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:03 2022] PUT /identity/v3/projects/79afe6e2d2a7480f91705a1f00a2e90b/users/b3720aa6d28e41dab0e69b80cff6c4ff/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 42 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:03.322415 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a5ede-0df5-4161-a576-e74890c94239 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:03.322820 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a5ede-0df5-4161-a576-e74890c94239 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:03.323109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c8a5ede-0df5-4161-a576-e74890c94239 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:03.362912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7c8a5ede-0df5-4161-a576-e74890c94239 None None] MFA Rules not processed for user `b3720aa6d28e41dab0e69b80cff6c4ff`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:03.364291 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7c8a5ede-0df5-4161-a576-e74890c94239 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:03.474645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1081/2204] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:03 2022] POST /identity/v3/auth/tokens => generated 3333 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:23:03.486200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546dd2c-43fc-4985-99b0-49d23380fa36 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:03.488305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d546dd2c-43fc-4985-99b0-49d23380fa36 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:03.548343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d546dd2c-43fc-4985-99b0-49d23380fa36 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:03.552300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13c33-f976-4fd1-8090-cb492135d75e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:03.552814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13c33-f976-4fd1-8090-cb492135d75e service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:03.553094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13c33-f976-4fd1-8090-cb492135d75e service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:03.553371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-faa13c33-f976-4fd1-8090-cb492135d75e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:03.563266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa13c33-f976-4fd1-8090-cb492135d75e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:03.564697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-faa13c33-f976-4fd1-8090-cb492135d75e service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:03.574433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1124/2205] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:03 2022] GET /identity/v3/auth/tokens => generated 3333 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:03.650654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a5ede-0df5-4161-a576-e74890c94239 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:03.660144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c8a5ede-0df5-4161-a576-e74890c94239 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:03.663659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3927affa-4a6d-4d0f-8b72-9c094d4a6a77 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:03.664286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927affa-4a6d-4d0f-8b72-9c094d4a6a77 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:03.664566 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927affa-4a6d-4d0f-8b72-9c094d4a6a77 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:03.664836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3927affa-4a6d-4d0f-8b72-9c094d4a6a77 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:03.723966 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927affa-4a6d-4d0f-8b72-9c094d4a6a77 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:03.725416 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3927affa-4a6d-4d0f-8b72-9c094d4a6a77 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:03.735686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1082/2206] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:03 2022] GET /identity/v3/auth/tokens => generated 3268 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:04.068577 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13c33-f976-4fd1-8090-cb492135d75e service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:04.070153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-faa13c33-f976-4fd1-8090-cb492135d75e service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:04.134683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-faa13c33-f976-4fd1-8090-cb492135d75e service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:04.139516 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df04f4b-b37b-4258-854d-2645f2c0a4b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:04.140392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04f4b-b37b-4258-854d-2645f2c0a4b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:04.140681 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04f4b-b37b-4258-854d-2645f2c0a4b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:04.140967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df04f4b-b37b-4258-854d-2645f2c0a4b5 admin admin] PATH_INFO: `/v3/users/adfac407bac34f7990717651014f0084` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:04.142245 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df04f4b-b37b-4258-854d-2645f2c0a4b5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=adfac407bac34f7990717651014f0084)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:04.144239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df04f4b-b37b-4258-854d-2645f2c0a4b5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:04.192667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2df04f4b-b37b-4258-854d-2645f2c0a4b5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'adfac407bac34f7990717651014f0084'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:04.193350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2df04f4b-b37b-4258-854d-2645f2c0a4b5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'adfac407bac34f7990717651014f0084'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:04.200116 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2df04f4b-b37b-4258-854d-2645f2c0a4b5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'adfac407bac34f7990717651014f0084'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:04.200753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2df04f4b-b37b-4258-854d-2645f2c0a4b5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'adfac407bac34f7990717651014f0084'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:04.212395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2df04f4b-b37b-4258-854d-2645f2c0a4b5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'adfac407bac34f7990717651014f0084'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:04.225400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1125/2207] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:23:04 2022] DELETE /identity/v3/users/adfac407bac34f7990717651014f0084 => generated 0 bytes in 157 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:04.230105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9cb1e-2e7e-4469-8a8f-0069404e8a77 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:04.230393 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9cb1e-2e7e-4469-8a8f-0069404e8a77 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:04.230672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbb9cb1e-2e7e-4469-8a8f-0069404e8a77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:04.247651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-cbb9cb1e-2e7e-4469-8a8f-0069404e8a77 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:04.248867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cbb9cb1e-2e7e-4469-8a8f-0069404e8a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:04.306259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1083/2208] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:04.315744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df04f4b-b37b-4258-854d-2645f2c0a4b5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:04.317187 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2df04f4b-b37b-4258-854d-2645f2c0a4b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:04.343426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:04.375997 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df04f4b-b37b-4258-854d-2645f2c0a4b5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:04.379655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b40421-01a3-4677-a584-178e03dea742 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:04.380316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b40421-01a3-4677-a584-178e03dea742 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:04.380600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b40421-01a3-4677-a584-178e03dea742 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:04.380879 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4b40421-01a3-4677-a584-178e03dea742 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:04.390328 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b40421-01a3-4677-a584-178e03dea742 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:04.391690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4b40421-01a3-4677-a584-178e03dea742 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:04.401027 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1126/2209] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:04.777137 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9cb1e-2e7e-4469-8a8f-0069404e8a77 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:04.779331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cbb9cb1e-2e7e-4469-8a8f-0069404e8a77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:04.791501 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbb9cb1e-2e7e-4469-8a8f-0069404e8a77 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:04.796145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:04.797101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:04.797385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:04.797656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] PATH_INFO: `/v3/projects/39fe49d60f904db895d8327b32cee2ea` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:04.798853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] RBAC: Authorizing `identity:delete_project(project_id=39fe49d60f904db895d8327b32cee2ea)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:04.800921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:04.802556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:04.848868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '39fe49d60f904db895d8327b32cee2ea', 'request_id': 'req-110dabb6-74b3-40a5-ade4-f2c01666573f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:04.856322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '39fe49d60f904db895d8327b32cee2ea', 'request_id': 'req-110dabb6-74b3-40a5-ade4-f2c01666573f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:04.862131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '39fe49d60f904db895d8327b32cee2ea', 'request_id': 'req-110dabb6-74b3-40a5-ade4-f2c01666573f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:04.874383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] The token cache is being invalidate because project 39fe49d60f904db895d8327b32cee2ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:04.874654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:04.875288 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:04.876820 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1084/2210] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:04 2022] DELETE /identity/v3/projects/39fe49d60f904db895d8327b32cee2ea => generated 0 bytes in 100 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:04.880880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b40421-01a3-4677-a584-178e03dea742 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:04.890991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4b40421-01a3-4677-a584-178e03dea742 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:04.955784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfc7872c-1850-456b-b3f3-3db2569a573c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:04.956588 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7872c-1850-456b-b3f3-3db2569a573c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:04.956850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7872c-1850-456b-b3f3-3db2569a573c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:04.957156 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfc7872c-1850-456b-b3f3-3db2569a573c admin admin] PATH_INFO: `/v3/users/e7de802814fc4696987f48b8fe28e408` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:04.958334 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7872c-1850-456b-b3f3-3db2569a573c admin admin] RBAC: Authorizing `identity:delete_user(user_id=e7de802814fc4696987f48b8fe28e408)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:04.960309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfc7872c-1850-456b-b3f3-3db2569a573c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:05.005172 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfc7872c-1850-456b-b3f3-3db2569a573c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'e7de802814fc4696987f48b8fe28e408'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:05.005822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfc7872c-1850-456b-b3f3-3db2569a573c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'e7de802814fc4696987f48b8fe28e408'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:05.014607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfc7872c-1850-456b-b3f3-3db2569a573c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'e7de802814fc4696987f48b8fe28e408'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:05.015322 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfc7872c-1850-456b-b3f3-3db2569a573c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'e7de802814fc4696987f48b8fe28e408'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:05.028412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cfc7872c-1850-456b-b3f3-3db2569a573c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'e7de802814fc4696987f48b8fe28e408'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:05.047040 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1127/2211] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:23:04 2022] DELETE /identity/v3/users/e7de802814fc4696987f48b8fe28e408 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:05.328201 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:05.329914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:05.365437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-110dabb6-74b3-40a5-ade4-f2c01666573f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:05.425376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:05.426244 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:05.426523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:05.426796 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a admin admin] PATH_INFO: `/v3/projects/159e3eeb05374feb9c1ba639f5091d79` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:05.427949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a admin admin] RBAC: Authorizing `identity:delete_project(project_id=159e3eeb05374feb9c1ba639f5091d79)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:05.429903 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:05.475098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '159e3eeb05374feb9c1ba639f5091d79', 'request_id': 'req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:05.482572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '159e3eeb05374feb9c1ba639f5091d79', 'request_id': 'req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:05.488578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '159e3eeb05374feb9c1ba639f5091d79', 'request_id': 'req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:05.499932 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a admin admin] The token cache is being invalidate because project 159e3eeb05374feb9c1ba639f5091d79 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:05.500217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:05.500839 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0ed25a6d-6259-4bf0-8cf2-8182d96bbb6a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:05.502399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1085/2212] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:05 2022] DELETE /identity/v3/projects/159e3eeb05374feb9c1ba639f5091d79 => generated 0 bytes in 175 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:05.507408 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7b130-2a98-4dfb-b0e7-0cd10005c92d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:05.507907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7b130-2a98-4dfb-b0e7-0cd10005c92d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:05.507999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ba7b130-2a98-4dfb-b0e7-0cd10005c92d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:05.524787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4ba7b130-2a98-4dfb-b0e7-0cd10005c92d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:05.525996 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4ba7b130-2a98-4dfb-b0e7-0cd10005c92d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:05.565571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:05.586746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1128/2213] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:05.595148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1025c6-ccd4-4ee0-84d2-dbac2eef6462 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:05.595438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1025c6-ccd4-4ee0-84d2-dbac2eef6462 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:05.595719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1025c6-ccd4-4ee0-84d2-dbac2eef6462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:05.616000 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3c1025c6-ccd4-4ee0-84d2-dbac2eef6462 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:05.617233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3c1025c6-ccd4-4ee0-84d2-dbac2eef6462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:05.625544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1086/2214] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:05.629933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7b130-2a98-4dfb-b0e7-0cd10005c92d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:05.639936 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ba7b130-2a98-4dfb-b0e7-0cd10005c92d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:05.644431 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44924d5-ea50-4e8b-a645-9944ffe70f8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:05.645112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44924d5-ea50-4e8b-a645-9944ffe70f8a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:05.645395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44924d5-ea50-4e8b-a645-9944ffe70f8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:05.645669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b44924d5-ea50-4e8b-a645-9944ffe70f8a admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:05.646385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44924d5-ea50-4e8b-a645-9944ffe70f8a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:23:05.646691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44924d5-ea50-4e8b-a645-9944ffe70f8a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:05.648268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b44924d5-ea50-4e8b-a645-9944ffe70f8a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:05.663743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1129/2215] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:23:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:23:05.664941 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1025c6-ccd4-4ee0-84d2-dbac2eef6462 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:05.675276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1025c6-ccd4-4ee0-84d2-dbac2eef6462 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:05.679904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6cadc-02ea-472b-b45e-94e3fd3b7df3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:05.680552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6cadc-02ea-472b-b45e-94e3fd3b7df3 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:05.680830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6cadc-02ea-472b-b45e-94e3fd3b7df3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:05.681176 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1c6cadc-02ea-472b-b45e-94e3fd3b7df3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:05.681861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6cadc-02ea-472b-b45e-94e3fd3b7df3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:05.683787 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1c6cadc-02ea-472b-b45e-94e3fd3b7df3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:05.695309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:05.722963 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1087/2216] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:23:05 2022] POST /identity/v3/projects => generated 387 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:05.726979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44924d5-ea50-4e8b-a645-9944ffe70f8a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:05.739583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b44924d5-ea50-4e8b-a645-9944ffe70f8a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:05.815844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ae669-5a9e-450b-bf43-f20440eabe33 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:05.817213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ae669-5a9e-450b-bf43-f20440eabe33 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:05.817398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ae669-5a9e-450b-bf43-f20440eabe33 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:05.817795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-359ae669-5a9e-450b-bf43-f20440eabe33 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:05.818517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ae669-5a9e-450b-bf43-f20440eabe33 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:05.821816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-359ae669-5a9e-450b-bf43-f20440eabe33 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:05.854112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1130/2217] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:23:05 2022] POST /identity/v3/users => generated 294 bytes in 128 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:05.859104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6cadc-02ea-472b-b45e-94e3fd3b7df3 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:05.877109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1c6cadc-02ea-472b-b45e-94e3fd3b7df3 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:05.882501 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaba869-6b40-4265-aacc-c0280f7c6d8a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:05.883563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaba869-6b40-4265-aacc-c0280f7c6d8a admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:05.884289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaba869-6b40-4265-aacc-c0280f7c6d8a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:05.884911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdaba869-6b40-4265-aacc-c0280f7c6d8a admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:05.885827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaba869-6b40-4265-aacc-c0280f7c6d8a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:05.889217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdaba869-6b40-4265-aacc-c0280f7c6d8a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:05.901836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1088/2218] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:05.907474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ae669-5a9e-450b-bf43-f20440eabe33 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:05.919918 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-359ae669-5a9e-450b-bf43-f20440eabe33 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:05.929354 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70b26f5d-3621-4720-8e31-224e5d02d522 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:05.930179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26f5d-3621-4720-8e31-224e5d02d522 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:05.930552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26f5d-3621-4720-8e31-224e5d02d522 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:05.931034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70b26f5d-3621-4720-8e31-224e5d02d522 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:05.931824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b26f5d-3621-4720-8e31-224e5d02d522 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:05.933708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70b26f5d-3621-4720-8e31-224e5d02d522 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:05.944871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1131/2219] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:05 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:05.948823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaba869-6b40-4265-aacc-c0280f7c6d8a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:05.959628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdaba869-6b40-4265-aacc-c0280f7c6d8a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:05.964430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dd5cd-aa28-4611-b8ea-7396cf490b67 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:05.965474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dd5cd-aa28-4611-b8ea-7396cf490b67 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:05.965828 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dd5cd-aa28-4611-b8ea-7396cf490b67 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:05.966214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-554dd5cd-aa28-4611-b8ea-7396cf490b67 admin admin] PATH_INFO: `/v3/projects/14bcbf8f2905453097817f9eeccffee9/users/707068403c9948628c96dff00570567a/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:05.985176 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554dd5cd-aa28-4611-b8ea-7396cf490b67 admin admin] RBAC: Authorizing `identity:create_grant(project_id=14bcbf8f2905453097817f9eeccffee9, user_id=707068403c9948628c96dff00570567a, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:05.986220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-554dd5cd-aa28-4611-b8ea-7396cf490b67 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:06.004744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1089/2220] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:05 2022] PUT /identity/v3/projects/14bcbf8f2905453097817f9eeccffee9/users/707068403c9948628c96dff00570567a/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 56 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:06.017744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe6d5b-10b6-4cef-a89b-f536cf5c21b8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:06.018035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe6d5b-10b6-4cef-a89b-f536cf5c21b8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:06.018315 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4fe6d5b-10b6-4cef-a89b-f536cf5c21b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:06.047639 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f4fe6d5b-10b6-4cef-a89b-f536cf5c21b8 None None] MFA Rules not processed for user `707068403c9948628c96dff00570567a`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:06.049018 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f4fe6d5b-10b6-4cef-a89b-f536cf5c21b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:06.130146 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1132/2221] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:23:06.134519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dd5cd-aa28-4611-b8ea-7396cf490b67 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:06.216425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-554dd5cd-aa28-4611-b8ea-7396cf490b67 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:06.225715 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc404a-f0b6-4050-b5e0-95650a179b88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:06.226390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc404a-f0b6-4050-b5e0-95650a179b88 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:06.226680 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc404a-f0b6-4050-b5e0-95650a179b88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:06.226932 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fddc404a-f0b6-4050-b5e0-95650a179b88 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:06.227637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc404a-f0b6-4050-b5e0-95650a179b88 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:06.229862 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fddc404a-f0b6-4050-b5e0-95650a179b88 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:06.258259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1090/2222] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:23:06 2022] POST /identity/v3/projects => generated 387 bytes in 124 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:06.262546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe6d5b-10b6-4cef-a89b-f536cf5c21b8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:06.277847 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4fe6d5b-10b6-4cef-a89b-f536cf5c21b8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:06.323789 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:06.349861 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc25b1-5d6f-4978-a144-ba9b3e69bd4d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:06.350529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc25b1-5d6f-4978-a144-ba9b3e69bd4d admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:06.350814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc25b1-5d6f-4978-a144-ba9b3e69bd4d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:06.351117 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88dc25b1-5d6f-4978-a144-ba9b3e69bd4d admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:06.351785 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc25b1-5d6f-4978-a144-ba9b3e69bd4d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:06.354260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88dc25b1-5d6f-4978-a144-ba9b3e69bd4d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:06.376755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1133/2223] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:23:06 2022] POST /identity/v3/users => generated 300 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:23:06.380820 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc404a-f0b6-4050-b5e0-95650a179b88 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:06.391890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fddc404a-f0b6-4050-b5e0-95650a179b88 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:06.396916 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc34bf-a3d6-4bd4-80e5-824e112290e0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:06.397683 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc34bf-a3d6-4bd4-80e5-824e112290e0 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:06.398028 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc34bf-a3d6-4bd4-80e5-824e112290e0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:06.398405 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfdc34bf-a3d6-4bd4-80e5-824e112290e0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:06.399513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc34bf-a3d6-4bd4-80e5-824e112290e0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:06.400949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfdc34bf-a3d6-4bd4-80e5-824e112290e0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:06.428483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1091/2224] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:06.432955 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc25b1-5d6f-4978-a144-ba9b3e69bd4d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:06.446904 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88dc25b1-5d6f-4978-a144-ba9b3e69bd4d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:06.459903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751bfd4-23f5-4469-987b-38e4598f0f8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:06.460807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751bfd4-23f5-4469-987b-38e4598f0f8c admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:06.461122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751bfd4-23f5-4469-987b-38e4598f0f8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:06.461399 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2751bfd4-23f5-4469-987b-38e4598f0f8c admin admin] PATH_INFO: `/v3/projects/6211164b013d40e6b2d5b983a2a3edc1/users/5b883629095349d38be33c452c5af788/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:06.480911 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751bfd4-23f5-4469-987b-38e4598f0f8c admin admin] RBAC: Authorizing `identity:create_grant(project_id=6211164b013d40e6b2d5b983a2a3edc1, user_id=5b883629095349d38be33c452c5af788, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:06.484368 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2751bfd4-23f5-4469-987b-38e4598f0f8c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:06.509847 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1134/2225] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:06 2022] PUT /identity/v3/projects/6211164b013d40e6b2d5b983a2a3edc1/users/5b883629095349d38be33c452c5af788/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 90 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:23:06.513749 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc34bf-a3d6-4bd4-80e5-824e112290e0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:06.524488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfdc34bf-a3d6-4bd4-80e5-824e112290e0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:06.586333 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3226ec78-f96f-466b-8bb0-7fed4c9505fd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:06.587001 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226ec78-f96f-466b-8bb0-7fed4c9505fd admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:06.587308 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226ec78-f96f-466b-8bb0-7fed4c9505fd admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:06.587579 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3226ec78-f96f-466b-8bb0-7fed4c9505fd admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:06.588297 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226ec78-f96f-466b-8bb0-7fed4c9505fd admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:06.589924 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3226ec78-f96f-466b-8bb0-7fed4c9505fd admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:06.603227 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1092/2226] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:06 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:06.605093 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751bfd4-23f5-4469-987b-38e4598f0f8c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:06.618519 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2751bfd4-23f5-4469-987b-38e4598f0f8c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:06.623226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64453e-361a-4a06-b70e-71c7897dacb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:06.624147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64453e-361a-4a06-b70e-71c7897dacb8 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:06.624440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64453e-361a-4a06-b70e-71c7897dacb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:06.624717 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a64453e-361a-4a06-b70e-71c7897dacb8 admin admin] PATH_INFO: `/v3/projects/6211164b013d40e6b2d5b983a2a3edc1/users/5b883629095349d38be33c452c5af788/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:06.627047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64453e-361a-4a06-b70e-71c7897dacb8 admin admin] RBAC: Authorizing `identity:create_grant(project_id=6211164b013d40e6b2d5b983a2a3edc1, user_id=5b883629095349d38be33c452c5af788, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:06.629757 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a64453e-361a-4a06-b70e-71c7897dacb8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:06.640826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1135/2227] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:06 2022] PUT /identity/v3/projects/6211164b013d40e6b2d5b983a2a3edc1/users/5b883629095349d38be33c452c5af788/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:06.651208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f284de-0649-43e3-96d3-2c97773bc5e8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:06.651502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f284de-0649-43e3-96d3-2c97773bc5e8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:06.651911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62f284de-0649-43e3-96d3-2c97773bc5e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:06.679001 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-62f284de-0649-43e3-96d3-2c97773bc5e8 None None] MFA Rules not processed for user `5b883629095349d38be33c452c5af788`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:06.680342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-62f284de-0649-43e3-96d3-2c97773bc5e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:06.692915 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:06.756645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1093/2228] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:06 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:06.768429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64453e-361a-4a06-b70e-71c7897dacb8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:06.770809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5a64453e-361a-4a06-b70e-71c7897dacb8 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:06.829807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a64453e-361a-4a06-b70e-71c7897dacb8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:06.833634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e4b2d3-866d-424d-86a5-ef9a489a8243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:06.834301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4b2d3-866d-424d-86a5-ef9a489a8243 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:06.834584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4b2d3-866d-424d-86a5-ef9a489a8243 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:06.834882 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e4b2d3-866d-424d-86a5-ef9a489a8243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:06.844496 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4b2d3-866d-424d-86a5-ef9a489a8243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:06.845950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e4b2d3-866d-424d-86a5-ef9a489a8243 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:06.855712 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1136/2229] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:06 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:06.883329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f284de-0649-43e3-96d3-2c97773bc5e8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:06.947105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62f284de-0649-43e3-96d3-2c97773bc5e8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:06.952181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f471fda-9b11-4f55-9895-9b45e8c4313d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:06.953065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f471fda-9b11-4f55-9895-9b45e8c4313d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:06.953350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f471fda-9b11-4f55-9895-9b45e8c4313d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:06.953624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f471fda-9b11-4f55-9895-9b45e8c4313d admin admin] PATH_INFO: `/v3/users/707068403c9948628c96dff00570567a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:06.954818 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f471fda-9b11-4f55-9895-9b45e8c4313d admin admin] RBAC: Authorizing `identity:delete_user(user_id=707068403c9948628c96dff00570567a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:06.956748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f471fda-9b11-4f55-9895-9b45e8c4313d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:07.005790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-7f471fda-9b11-4f55-9895-9b45e8c4313d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '707068403c9948628c96dff00570567a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.015931 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-7f471fda-9b11-4f55-9895-9b45e8c4313d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '707068403c9948628c96dff00570567a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.017144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-7f471fda-9b11-4f55-9895-9b45e8c4313d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '707068403c9948628c96dff00570567a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.042660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-7f471fda-9b11-4f55-9895-9b45e8c4313d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '707068403c9948628c96dff00570567a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.058951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-7f471fda-9b11-4f55-9895-9b45e8c4313d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '707068403c9948628c96dff00570567a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.066582 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1094/2230] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:23:06 2022] DELETE /identity/v3/users/707068403c9948628c96dff00570567a => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:07.071459 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb8790-e5f5-4e97-9b64-19b65228cefe None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:07.071853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb8790-e5f5-4e97-9b64-19b65228cefe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:07.072157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ecb8790-e5f5-4e97-9b64-19b65228cefe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:07.091574 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6ecb8790-e5f5-4e97-9b64-19b65228cefe None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:07.093020 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6ecb8790-e5f5-4e97-9b64-19b65228cefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:07.157254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1137/2231] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:07 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:23:07.166703 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f471fda-9b11-4f55-9895-9b45e8c4313d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:07.168448 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7f471fda-9b11-4f55-9895-9b45e8c4313d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:07.205122 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:07.231825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f471fda-9b11-4f55-9895-9b45e8c4313d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:07.235578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bb7f7-abbe-403f-92a7-24ef35e6a29e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:07.236265 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bb7f7-abbe-403f-92a7-24ef35e6a29e service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:07.236553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bb7f7-abbe-403f-92a7-24ef35e6a29e service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:07.236834 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-014bb7f7-abbe-403f-92a7-24ef35e6a29e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:07.245851 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bb7f7-abbe-403f-92a7-24ef35e6a29e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:07.247283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-014bb7f7-abbe-403f-92a7-24ef35e6a29e service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:07.257217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1095/2232] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:07 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:07.547664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb8790-e5f5-4e97-9b64-19b65228cefe None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:07.550043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6ecb8790-e5f5-4e97-9b64-19b65228cefe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:07.578113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ecb8790-e5f5-4e97-9b64-19b65228cefe None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:07.582722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:07.583614 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:07.583927 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:07.584204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] PATH_INFO: `/v3/projects/14bcbf8f2905453097817f9eeccffee9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:07.585462 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] RBAC: Authorizing `identity:delete_project(project_id=14bcbf8f2905453097817f9eeccffee9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:07.587362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:07.624085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:INSERT=5,keystone:DELETE=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:07.640876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '14bcbf8f2905453097817f9eeccffee9', 'request_id': 'req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.648392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '14bcbf8f2905453097817f9eeccffee9', 'request_id': 'req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.653930 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '14bcbf8f2905453097817f9eeccffee9', 'request_id': 'req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.664767 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] The token cache is being invalidate because project 14bcbf8f2905453097817f9eeccffee9 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:07.665079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.665694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.667259 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1138/2233] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:07 2022] DELETE /identity/v3/projects/14bcbf8f2905453097817f9eeccffee9 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:07.671670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bb7f7-abbe-403f-92a7-24ef35e6a29e service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:07.681024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-014bb7f7-abbe-403f-92a7-24ef35e6a29e service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:07.743788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0514ad-a0ff-40ad-972e-d0acb82fb84f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:07.744758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0514ad-a0ff-40ad-972e-d0acb82fb84f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:07.744965 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0514ad-a0ff-40ad-972e-d0acb82fb84f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:07.745270 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0514ad-a0ff-40ad-972e-d0acb82fb84f admin admin] PATH_INFO: `/v3/users/5b883629095349d38be33c452c5af788` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:07.746438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0514ad-a0ff-40ad-972e-d0acb82fb84f admin admin] RBAC: Authorizing `identity:delete_user(user_id=5b883629095349d38be33c452c5af788)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:07.748939 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0514ad-a0ff-40ad-972e-d0acb82fb84f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:07.797965 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2c0514ad-a0ff-40ad-972e-d0acb82fb84f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5b883629095349d38be33c452c5af788'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.811194 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2c0514ad-a0ff-40ad-972e-d0acb82fb84f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5b883629095349d38be33c452c5af788'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.811930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2c0514ad-a0ff-40ad-972e-d0acb82fb84f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5b883629095349d38be33c452c5af788'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.827584 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2c0514ad-a0ff-40ad-972e-d0acb82fb84f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5b883629095349d38be33c452c5af788'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.835003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2c0514ad-a0ff-40ad-972e-d0acb82fb84f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5b883629095349d38be33c452c5af788'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:07.842006 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1096/2234] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:23:07 2022] DELETE /identity/v3/users/5b883629095349d38be33c452c5af788 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:07.885581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:07.887080 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:07.908309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00edf28f-427d-4dae-8c0a-4ecfe7fe5d10 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:07.967695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e15ed-8ae9-4243-86f2-16b389af19bd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:07.968580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e15ed-8ae9-4243-86f2-16b389af19bd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:07.968866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e15ed-8ae9-4243-86f2-16b389af19bd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:07.969177 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-114e15ed-8ae9-4243-86f2-16b389af19bd admin admin] PATH_INFO: `/v3/users/69025ab87839405098604ca903abf0f9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:07.974035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e15ed-8ae9-4243-86f2-16b389af19bd admin admin] RBAC: Authorizing `identity:delete_user(user_id=69025ab87839405098604ca903abf0f9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:07.976213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-114e15ed-8ae9-4243-86f2-16b389af19bd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:08.035864 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-114e15ed-8ae9-4243-86f2-16b389af19bd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '69025ab87839405098604ca903abf0f9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.036848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-114e15ed-8ae9-4243-86f2-16b389af19bd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '69025ab87839405098604ca903abf0f9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.044245 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-114e15ed-8ae9-4243-86f2-16b389af19bd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '69025ab87839405098604ca903abf0f9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.045483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-114e15ed-8ae9-4243-86f2-16b389af19bd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '69025ab87839405098604ca903abf0f9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.057597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-114e15ed-8ae9-4243-86f2-16b389af19bd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '69025ab87839405098604ca903abf0f9'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.071667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1139/2235] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:23:07 2022] DELETE /identity/v3/users/69025ab87839405098604ca903abf0f9 => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:08.076526 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecef2ca-37cf-452f-9ae7-14f03393251d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.076944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecef2ca-37cf-452f-9ae7-14f03393251d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.077295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ecef2ca-37cf-452f-9ae7-14f03393251d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.096216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9ecef2ca-37cf-452f-9ae7-14f03393251d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:08.097823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9ecef2ca-37cf-452f-9ae7-14f03393251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:08.154754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:08.168086 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e15ed-8ae9-4243-86f2-16b389af19bd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:08.170335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-114e15ed-8ae9-4243-86f2-16b389af19bd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:08.171533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1097/2236] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:08.183277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecef2ca-37cf-452f-9ae7-14f03393251d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:08.184459 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9ecef2ca-37cf-452f-9ae7-14f03393251d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:08.192245 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-114e15ed-8ae9-4243-86f2-16b389af19bd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:08.197584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13750ce0-cb90-41c2-948a-2057aa87b7af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:08.198755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750ce0-cb90-41c2-948a-2057aa87b7af admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.199104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750ce0-cb90-41c2-948a-2057aa87b7af admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.199455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13750ce0-cb90-41c2-948a-2057aa87b7af admin admin] PATH_INFO: `/v3/projects/6211164b013d40e6b2d5b983a2a3edc1` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.201341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13750ce0-cb90-41c2-948a-2057aa87b7af admin admin] RBAC: Authorizing `identity:delete_project(project_id=6211164b013d40e6b2d5b983a2a3edc1)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:08.203681 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13750ce0-cb90-41c2-948a-2057aa87b7af admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:08.252567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ecef2ca-37cf-452f-9ae7-14f03393251d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:08.254273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:08.274095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-13750ce0-cb90-41c2-948a-2057aa87b7af admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '6211164b013d40e6b2d5b983a2a3edc1', 'request_id': 'req-13750ce0-cb90-41c2-948a-2057aa87b7af'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.282952 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-13750ce0-cb90-41c2-948a-2057aa87b7af admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '6211164b013d40e6b2d5b983a2a3edc1', 'request_id': 'req-13750ce0-cb90-41c2-948a-2057aa87b7af'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.291326 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-13750ce0-cb90-41c2-948a-2057aa87b7af admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '6211164b013d40e6b2d5b983a2a3edc1', 'request_id': 'req-13750ce0-cb90-41c2-948a-2057aa87b7af'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.307016 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-13750ce0-cb90-41c2-948a-2057aa87b7af admin admin] The token cache is being invalidate because project 6211164b013d40e6b2d5b983a2a3edc1 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:08.307342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-13750ce0-cb90-41c2-948a-2057aa87b7af admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.307965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-13750ce0-cb90-41c2-948a-2057aa87b7af admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.309796 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1140/2237] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:08 2022] DELETE /identity/v3/projects/6211164b013d40e6b2d5b983a2a3edc1 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:23:08.314220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99e29b-0486-4f0d-8018-ef801ec01bef None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.314413 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb0c4d90-f613-4ae4-815f-7c8f219e31be service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:08.314592 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99e29b-0486-4f0d-8018-ef801ec01bef None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.314868 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d99e29b-0486-4f0d-8018-ef801ec01bef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.315076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c4d90-f613-4ae4-815f-7c8f219e31be service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.315364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c4d90-f613-4ae4-815f-7c8f219e31be service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.315827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb0c4d90-f613-4ae4-815f-7c8f219e31be service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.317859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-fb0c4d90-f613-4ae4-815f-7c8f219e31be service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:08.333169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3d99e29b-0486-4f0d-8018-ef801ec01bef None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:08.334364 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3d99e29b-0486-4f0d-8018-ef801ec01bef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:08.382907 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c4d90-f613-4ae4-815f-7c8f219e31be service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:08.384491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb0c4d90-f613-4ae4-815f-7c8f219e31be service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:08.396286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1098/2238] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 215 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:08.404671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1141/2239] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:23:08.412655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0613-9d2d-4da6-8080-1711c67f3311 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.412949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0613-9d2d-4da6-8080-1711c67f3311 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.413277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d6d0613-9d2d-4da6-8080-1711c67f3311 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.433247 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6d6d0613-9d2d-4da6-8080-1711c67f3311 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:08.434610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6d6d0613-9d2d-4da6-8080-1711c67f3311 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:08.443088 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1099/2240] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:23:08.447439 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99e29b-0486-4f0d-8018-ef801ec01bef None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:08.457607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d99e29b-0486-4f0d-8018-ef801ec01bef None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:08.462563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e595045-a234-4bdb-b534-bbe787a7cc0a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:08.463213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e595045-a234-4bdb-b534-bbe787a7cc0a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.463502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e595045-a234-4bdb-b534-bbe787a7cc0a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.463783 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e595045-a234-4bdb-b534-bbe787a7cc0a admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.464502 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e595045-a234-4bdb-b534-bbe787a7cc0a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:23:08.464813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e595045-a234-4bdb-b534-bbe787a7cc0a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:08.467042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e595045-a234-4bdb-b534-bbe787a7cc0a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:08.484413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1142/2241] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:23:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:23:08.486460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d0613-9d2d-4da6-8080-1711c67f3311 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:08.498083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d6d0613-9d2d-4da6-8080-1711c67f3311 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:08.502878 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd299e-aa00-41ba-bea3-3262be4e9fdc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:08.503491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd299e-aa00-41ba-bea3-3262be4e9fdc admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.503774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd299e-aa00-41ba-bea3-3262be4e9fdc admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.504045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62cd299e-aa00-41ba-bea3-3262be4e9fdc admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.504732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd299e-aa00-41ba-bea3-3262be4e9fdc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:08.506689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62cd299e-aa00-41ba-bea3-3262be4e9fdc admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:08.535620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1100/2242] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:23:08 2022] POST /identity/v3/projects => generated 381 bytes in 50 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:08.539876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e595045-a234-4bdb-b534-bbe787a7cc0a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:08.551206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e595045-a234-4bdb-b534-bbe787a7cc0a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:08.624223 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d8fcd-f0bc-43d3-985e-77edbe06a99d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:08.624535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d8fcd-f0bc-43d3-985e-77edbe06a99d admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.624822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d8fcd-f0bc-43d3-985e-77edbe06a99d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.627131 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d5d8fcd-f0bc-43d3-985e-77edbe06a99d admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.627834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d8fcd-f0bc-43d3-985e-77edbe06a99d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:08.630030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d5d8fcd-f0bc-43d3-985e-77edbe06a99d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:08.662296 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1143/2243] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:23:08 2022] POST /identity/v3/users => generated 291 bytes in 123 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:23:08.666574 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd299e-aa00-41ba-bea3-3262be4e9fdc admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:08.677322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62cd299e-aa00-41ba-bea3-3262be4e9fdc admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:08.683609 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf35977-ab81-4b07-b0d0-57be4c33a7c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:08.684560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf35977-ab81-4b07-b0d0-57be4c33a7c4 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.685608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf35977-ab81-4b07-b0d0-57be4c33a7c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.686082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acf35977-ab81-4b07-b0d0-57be4c33a7c4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.687747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf35977-ab81-4b07-b0d0-57be4c33a7c4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:08.690434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acf35977-ab81-4b07-b0d0-57be4c33a7c4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:08.705014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1101/2244] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:08.708439 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d8fcd-f0bc-43d3-985e-77edbe06a99d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:08.711978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf35977-ab81-4b07-b0d0-57be4c33a7c4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:08.714053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-acf35977-ab81-4b07-b0d0-57be4c33a7c4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:08.718885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d5d8fcd-f0bc-43d3-985e-77edbe06a99d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:08.723648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a831589-2a70-44f1-9d10-19e5a22a1eb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:08.724381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a831589-2a70-44f1-9d10-19e5a22a1eb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.724658 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a831589-2a70-44f1-9d10-19e5a22a1eb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.724941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a831589-2a70-44f1-9d10-19e5a22a1eb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.725817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a831589-2a70-44f1-9d10-19e5a22a1eb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:08.727444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a831589-2a70-44f1-9d10-19e5a22a1eb8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:08.731122 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acf35977-ab81-4b07-b0d0-57be4c33a7c4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:08.737285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:08.738377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.738657 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.738933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] PATH_INFO: `/v3/projects/502a27c43c3e40598e2200325b388b4c` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.740135 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=502a27c43c3e40598e2200325b388b4c)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:08.741056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1144/2245] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:08 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:08.742307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:08.743591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a831589-2a70-44f1-9d10-19e5a22a1eb8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:08.754314 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a831589-2a70-44f1-9d10-19e5a22a1eb8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:08.758802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e62948-69f1-4417-a7db-637650a9a243 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:08.759473 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:08.759671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e62948-69f1-4417-a7db-637650a9a243 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.759951 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e62948-69f1-4417-a7db-637650a9a243 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.760229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e62948-69f1-4417-a7db-637650a9a243 admin admin] PATH_INFO: `/v3/projects/c06dfab2be9d4693ae52f9df5cd9acc3/users/4392533bf2be49b386d57d9d8643f9df/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.778261 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e62948-69f1-4417-a7db-637650a9a243 admin admin] RBAC: Authorizing `identity:create_grant(project_id=c06dfab2be9d4693ae52f9df5cd9acc3, user_id=4392533bf2be49b386d57d9d8643f9df, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:08.780997 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e62948-69f1-4417-a7db-637650a9a243 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:08.792225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '502a27c43c3e40598e2200325b388b4c', 'request_id': 'req-ba868e12-3b4a-43db-ae26-524becb205c5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.794590 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1145/2246] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:08 2022] PUT /identity/v3/projects/c06dfab2be9d4693ae52f9df5cd9acc3/users/4392533bf2be49b386d57d9d8643f9df/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:08.800901 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '502a27c43c3e40598e2200325b388b4c', 'request_id': 'req-ba868e12-3b4a-43db-ae26-524becb205c5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.806191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574dffe-4dc3-4e6e-bb32-e6df5221a3d3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.806482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574dffe-4dc3-4e6e-bb32-e6df5221a3d3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.806792 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a574dffe-4dc3-4e6e-bb32-e6df5221a3d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.806898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '502a27c43c3e40598e2200325b388b4c', 'request_id': 'req-ba868e12-3b4a-43db-ae26-524becb205c5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.813040 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=5,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:08.818984 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] The token cache is being invalidate because project 502a27c43c3e40598e2200325b388b4c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:08.819272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.819927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:08.821519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1102/2247] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:08 2022] DELETE /identity/v3/projects/502a27c43c3e40598e2200325b388b4c => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:23:08.826290 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:08.827639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:08.837847 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a574dffe-4dc3-4e6e-bb32-e6df5221a3d3 None None] MFA Rules not processed for user `4392533bf2be49b386d57d9d8643f9df`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:08.839161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a574dffe-4dc3-4e6e-bb32-e6df5221a3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:08.910492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba868e12-3b4a-43db-ae26-524becb205c5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:08.916115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1146/2248] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:08 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:23:08.920735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574dffe-4dc3-4e6e-bb32-e6df5221a3d3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:08.922028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a574dffe-4dc3-4e6e-bb32-e6df5221a3d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:08.977303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcdc5e-596b-4bd4-af60-febf01bfc71c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:08.978174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcdc5e-596b-4bd4-af60-febf01bfc71c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.978708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcdc5e-596b-4bd4-af60-febf01bfc71c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.978979 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91dcdc5e-596b-4bd4-af60-febf01bfc71c admin admin] PATH_INFO: `/v3/users/b3720aa6d28e41dab0e69b80cff6c4ff` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.980151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcdc5e-596b-4bd4-af60-febf01bfc71c admin admin] RBAC: Authorizing `identity:delete_user(user_id=b3720aa6d28e41dab0e69b80cff6c4ff)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:08.982634 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91dcdc5e-596b-4bd4-af60-febf01bfc71c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:08.988337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a574dffe-4dc3-4e6e-bb32-e6df5221a3d3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:08.993720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e800d-daee-44af-b302-13deca8aa9e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:08.994511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e800d-daee-44af-b302-13deca8aa9e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:08.994806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e800d-daee-44af-b302-13deca8aa9e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:08.995095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92e800d-daee-44af-b302-13deca8aa9e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:08.996344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e800d-daee-44af-b302-13deca8aa9e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:08.998452 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d92e800d-daee-44af-b302-13deca8aa9e1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:09.029104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1147/2249] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:23:08 2022] POST /identity/v3/projects => generated 381 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:23:09.030520 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e800d-daee-44af-b302-13deca8aa9e1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:09.036154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-91dcdc5e-596b-4bd4-af60-febf01bfc71c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b3720aa6d28e41dab0e69b80cff6c4ff'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:09.040807 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:09.045394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-91dcdc5e-596b-4bd4-af60-febf01bfc71c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b3720aa6d28e41dab0e69b80cff6c4ff'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:09.046173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-91dcdc5e-596b-4bd4-af60-febf01bfc71c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b3720aa6d28e41dab0e69b80cff6c4ff'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:09.060634 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-91dcdc5e-596b-4bd4-af60-febf01bfc71c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b3720aa6d28e41dab0e69b80cff6c4ff'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:09.068778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-91dcdc5e-596b-4bd4-af60-febf01bfc71c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b3720aa6d28e41dab0e69b80cff6c4ff'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:09.075213 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1103/2250] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:23:08 2022] DELETE /identity/v3/users/b3720aa6d28e41dab0e69b80cff6c4ff => generated 0 bytes in 250 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:23:09.092940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d92e800d-daee-44af-b302-13deca8aa9e1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:09.114575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:09.157900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29574cdb-ae97-4020-9ac6-6a7f1944e220 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:09.158750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29574cdb-ae97-4020-9ac6-6a7f1944e220 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:09.159038 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29574cdb-ae97-4020-9ac6-6a7f1944e220 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:09.159316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29574cdb-ae97-4020-9ac6-6a7f1944e220 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:09.160046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29574cdb-ae97-4020-9ac6-6a7f1944e220 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:09.162031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29574cdb-ae97-4020-9ac6-6a7f1944e220 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:09.189972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1148/2251] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:23:09 2022] POST /identity/v3/users => generated 297 bytes in 160 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:23:09.193993 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcdc5e-596b-4bd4-af60-febf01bfc71c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:09.195453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-91dcdc5e-596b-4bd4-af60-febf01bfc71c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:09.209275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91dcdc5e-596b-4bd4-af60-febf01bfc71c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:09.214187 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3fd8d-a139-4b6b-a9c8-67f1cca719f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:09.214859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3fd8d-a139-4b6b-a9c8-67f1cca719f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:09.215145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3fd8d-a139-4b6b-a9c8-67f1cca719f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:09.215421 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beb3fd8d-a139-4b6b-a9c8-67f1cca719f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:09.216178 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3fd8d-a139-4b6b-a9c8-67f1cca719f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:09.217826 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beb3fd8d-a139-4b6b-a9c8-67f1cca719f1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:09.249864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1104/2252] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:09.255088 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29574cdb-ae97-4020-9ac6-6a7f1944e220 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:09.266332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29574cdb-ae97-4020-9ac6-6a7f1944e220 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:09.271552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c6ca3-e3fb-45ca-9d6b-2d84b8ea3776 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:09.272555 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c6ca3-e3fb-45ca-9d6b-2d84b8ea3776 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:09.272845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c6ca3-e3fb-45ca-9d6b-2d84b8ea3776 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:09.273159 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86c6ca3-e3fb-45ca-9d6b-2d84b8ea3776 admin admin] PATH_INFO: `/v3/projects/12640430fad847c7baba25226f69234b/users/fbd0c45856e34402bf3ff91f4596ae8c/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:09.289965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c6ca3-e3fb-45ca-9d6b-2d84b8ea3776 admin admin] RBAC: Authorizing `identity:create_grant(project_id=12640430fad847c7baba25226f69234b, user_id=fbd0c45856e34402bf3ff91f4596ae8c, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:09.292365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86c6ca3-e3fb-45ca-9d6b-2d84b8ea3776 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:09.309051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1149/2253] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:09 2022] PUT /identity/v3/projects/12640430fad847c7baba25226f69234b/users/fbd0c45856e34402bf3ff91f4596ae8c/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 54 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:09.313224 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3fd8d-a139-4b6b-a9c8-67f1cca719f1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:09.326651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beb3fd8d-a139-4b6b-a9c8-67f1cca719f1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:09.381167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c6ca3-e3fb-45ca-9d6b-2d84b8ea3776 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:09.382958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a86c6ca3-e3fb-45ca-9d6b-2d84b8ea3776 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:09.397953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56679c51-9f15-4919-b0b5-dee978484a93 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:09.399304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56679c51-9f15-4919-b0b5-dee978484a93 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:09.399598 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56679c51-9f15-4919-b0b5-dee978484a93 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:09.399875 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56679c51-9f15-4919-b0b5-dee978484a93 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:09.400823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56679c51-9f15-4919-b0b5-dee978484a93 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:09.402856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56679c51-9f15-4919-b0b5-dee978484a93 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:09.416177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1105/2254] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 104 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:09.420837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56679c51-9f15-4919-b0b5-dee978484a93 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:09.434000 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56679c51-9f15-4919-b0b5-dee978484a93 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:09.440342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e505c5d-53ec-4f67-909a-7c4fedee13be admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:09.441271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e505c5d-53ec-4f67-909a-7c4fedee13be admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:09.441610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e505c5d-53ec-4f67-909a-7c4fedee13be admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:09.442108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e505c5d-53ec-4f67-909a-7c4fedee13be admin admin] PATH_INFO: `/v3/projects/12640430fad847c7baba25226f69234b/users/fbd0c45856e34402bf3ff91f4596ae8c/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:09.444719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e505c5d-53ec-4f67-909a-7c4fedee13be admin admin] RBAC: Authorizing `identity:create_grant(project_id=12640430fad847c7baba25226f69234b, user_id=fbd0c45856e34402bf3ff91f4596ae8c, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:09.447363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e505c5d-53ec-4f67-909a-7c4fedee13be admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:09.460998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1106/2255] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:09 2022] PUT /identity/v3/projects/12640430fad847c7baba25226f69234b/users/fbd0c45856e34402bf3ff91f4596ae8c/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 41 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:23:09.470828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86c6ca3-e3fb-45ca-9d6b-2d84b8ea3776 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:09.472322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df8473-9a59-4491-876f-de9feb840296 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:09.472619 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df8473-9a59-4491-876f-de9feb840296 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:09.475878 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02df8473-9a59-4491-876f-de9feb840296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:09.507096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-02df8473-9a59-4491-876f-de9feb840296 None None] MFA Rules not processed for user `fbd0c45856e34402bf3ff91f4596ae8c`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:09.508322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-02df8473-9a59-4491-876f-de9feb840296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:09.541977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:09.542798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:09.543082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:09.543362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc admin admin] PATH_INFO: `/v3/projects/79afe6e2d2a7480f91705a1f00a2e90b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:09.545126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc admin admin] RBAC: Authorizing `identity:delete_project(project_id=79afe6e2d2a7480f91705a1f00a2e90b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:09.547039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:09.583374 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1107/2256] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:09 2022] POST /identity/v3/auth/tokens => generated 3315 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:09.587417 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:INSERT=4,keystone:DELETE=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:09.596563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '79afe6e2d2a7480f91705a1f00a2e90b', 'request_id': 'req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:09.596724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df8473-9a59-4491-876f-de9feb840296 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:09.598113 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-02df8473-9a59-4491-876f-de9feb840296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:09.605342 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '79afe6e2d2a7480f91705a1f00a2e90b', 'request_id': 'req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:09.611924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '79afe6e2d2a7480f91705a1f00a2e90b', 'request_id': 'req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:09.623197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc admin admin] The token cache is being invalidate because project 79afe6e2d2a7480f91705a1f00a2e90b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:09.623482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:09.624131 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5a3d5a50-a586-4ee6-9474-cde88f8a8abc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:09.632688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:DELETE=3,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:09.642664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1150/2257] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:09 2022] DELETE /identity/v3/projects/79afe6e2d2a7480f91705a1f00a2e90b => generated 0 bytes in 262 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:23:09.648191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e0897-a465-4174-893e-ea62cdefb795 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:09.648704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e0897-a465-4174-893e-ea62cdefb795 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:09.649173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be5e0897-a465-4174-893e-ea62cdefb795 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:09.668781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-be5e0897-a465-4174-893e-ea62cdefb795 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:09.670070 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-be5e0897-a465-4174-893e-ea62cdefb795 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:09.673045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02df8473-9a59-4491-876f-de9feb840296 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:09.726657 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4b7d8-ee5f-4d7e-a511-c44a62cf78bf service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:09.727656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4b7d8-ee5f-4d7e-a511-c44a62cf78bf service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:09.728185 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4b7d8-ee5f-4d7e-a511-c44a62cf78bf service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:09.728751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13c4b7d8-ee5f-4d7e-a511-c44a62cf78bf service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:09.731601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-13c4b7d8-ee5f-4d7e-a511-c44a62cf78bf service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:09.746638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1151/2258] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:09.754368 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550596e3-c00f-459a-b19d-f7f020b7884d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:09.754671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550596e3-c00f-459a-b19d-f7f020b7884d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:09.754901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-550596e3-c00f-459a-b19d-f7f020b7884d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:09.778409 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-550596e3-c00f-459a-b19d-f7f020b7884d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:09.780557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-550596e3-c00f-459a-b19d-f7f020b7884d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:09.789614 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1152/2259] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:23:09.794364 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550596e3-c00f-459a-b19d-f7f020b7884d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:09.803733 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-550596e3-c00f-459a-b19d-f7f020b7884d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:09.808845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd118bbc-c83a-494c-8bf4-4e86fc0774c6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:09.809538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd118bbc-c83a-494c-8bf4-4e86fc0774c6 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:09.810390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd118bbc-c83a-494c-8bf4-4e86fc0774c6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:09.810770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd118bbc-c83a-494c-8bf4-4e86fc0774c6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:09.811412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd118bbc-c83a-494c-8bf4-4e86fc0774c6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:23:09.811729 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd118bbc-c83a-494c-8bf4-4e86fc0774c6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:09.812618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4b7d8-ee5f-4d7e-a511-c44a62cf78bf service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:09.813378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd118bbc-c83a-494c-8bf4-4e86fc0774c6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:09.814552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13c4b7d8-ee5f-4d7e-a511-c44a62cf78bf service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:09.828495 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1153/2260] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:23:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:23:09.832355 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1108/2261] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:09 2022] GET /identity/v3/auth/tokens => generated 3315 bytes in 234 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:09.833812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd118bbc-c83a-494c-8bf4-4e86fc0774c6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:09.844421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd118bbc-c83a-494c-8bf4-4e86fc0774c6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:09.849324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5315e3e-2ea9-4bbb-b04f-b1e4e530bef7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:09.849984 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5315e3e-2ea9-4bbb-b04f-b1e4e530bef7 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:09.850271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5315e3e-2ea9-4bbb-b04f-b1e4e530bef7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:09.850551 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5315e3e-2ea9-4bbb-b04f-b1e4e530bef7 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:09.851289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5315e3e-2ea9-4bbb-b04f-b1e4e530bef7 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:09.853296 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5315e3e-2ea9-4bbb-b04f-b1e4e530bef7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:09.884736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1154/2262] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:23:09 2022] POST /identity/v3/projects => generated 359 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:23:09.885929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4b7d8-ee5f-4d7e-a511-c44a62cf78bf service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:09.897011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13c4b7d8-ee5f-4d7e-a511-c44a62cf78bf service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:09.964847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c18fa9-aa67-47d8-bea2-da9b3bb77fbd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:09.965549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c18fa9-aa67-47d8-bea2-da9b3bb77fbd admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:09.965827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c18fa9-aa67-47d8-bea2-da9b3bb77fbd admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:09.966102 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06c18fa9-aa67-47d8-bea2-da9b3bb77fbd admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:09.967554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c18fa9-aa67-47d8-bea2-da9b3bb77fbd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:09.969602 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-06c18fa9-aa67-47d8-bea2-da9b3bb77fbd admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:09.992383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1109/2263] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:23:09 2022] POST /identity/v3/users => generated 280 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:09.993625 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5315e3e-2ea9-4bbb-b04f-b1e4e530bef7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:10.005697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5315e3e-2ea9-4bbb-b04f-b1e4e530bef7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:10.012325 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7db9d9-3fd6-482f-924a-de43d5776a26 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:10.013947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7db9d9-3fd6-482f-924a-de43d5776a26 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.014363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7db9d9-3fd6-482f-924a-de43d5776a26 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.014692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db7db9d9-3fd6-482f-924a-de43d5776a26 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.015684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7db9d9-3fd6-482f-924a-de43d5776a26 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:10.017823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db7db9d9-3fd6-482f-924a-de43d5776a26 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:10.030175 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1155/2264] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:09 2022] GET /identity/v3/roles => generated 1420 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:10.034399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c18fa9-aa67-47d8-bea2-da9b3bb77fbd admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:10.047086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06c18fa9-aa67-47d8-bea2-da9b3bb77fbd admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:10.051819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31590187-4b27-4127-90d5-f382ae9430f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:10.052487 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31590187-4b27-4127-90d5-f382ae9430f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.052758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31590187-4b27-4127-90d5-f382ae9430f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.053061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31590187-4b27-4127-90d5-f382ae9430f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.053963 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31590187-4b27-4127-90d5-f382ae9430f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:10.055900 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31590187-4b27-4127-90d5-f382ae9430f1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:10.067911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1110/2265] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:10 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:10.072132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7db9d9-3fd6-482f-924a-de43d5776a26 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:10.084203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db7db9d9-3fd6-482f-924a-de43d5776a26 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:10.089389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ae819-a91f-4761-a26a-a19a73214503 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:10.090339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae819-a91f-4761-a26a-a19a73214503 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.090652 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae819-a91f-4761-a26a-a19a73214503 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.090924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76ae819-a91f-4761-a26a-a19a73214503 admin admin] PATH_INFO: `/v3/projects/983623479e1d445c9f7f83046d69f9ea/users/f1e5bdfe4ccd493c852b11a651fdafa0/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.107733 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ae819-a91f-4761-a26a-a19a73214503 admin admin] RBAC: Authorizing `identity:create_grant(project_id=983623479e1d445c9f7f83046d69f9ea, user_id=f1e5bdfe4ccd493c852b11a651fdafa0, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:10.110544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c76ae819-a91f-4761-a26a-a19a73214503 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:10.127351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1156/2266] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:10 2022] PUT /identity/v3/projects/983623479e1d445c9f7f83046d69f9ea/users/f1e5bdfe4ccd493c852b11a651fdafa0/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:10.134228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3307-0f3f-4914-9c4c-f7d526a93f24 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.134571 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3307-0f3f-4914-9c4c-f7d526a93f24 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.134855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a12d3307-0f3f-4914-9c4c-f7d526a93f24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.163535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:10.169847 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ae819-a91f-4761-a26a-a19a73214503 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:10.173252 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a12d3307-0f3f-4914-9c4c-f7d526a93f24 None None] MFA Rules not processed for user `f1e5bdfe4ccd493c852b11a651fdafa0`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:10.175216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a12d3307-0f3f-4914-9c4c-f7d526a93f24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:10.224018 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:DELETE=4,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:10.237886 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76ae819-a91f-4761-a26a-a19a73214503 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:10.242217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1111/2267] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:10 2022] POST /identity/v3/auth/tokens => generated 3226 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:10.243148 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b74656-6d48-41a4-8df1-a70e41b7d761 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd0c45856e34402bf3ff91f4596ae8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12640430fad847c7baba25226f69234b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:10.243886 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b74656-6d48-41a4-8df1-a70e41b7d761 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.244245 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b74656-6d48-41a4-8df1-a70e41b7d761 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.244598 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b74656-6d48-41a4-8df1-a70e41b7d761 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.245439 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b74656-6d48-41a4-8df1-a70e41b7d761 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:23:10.245832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b74656-6d48-41a4-8df1-a70e41b7d761 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:10.248204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b74656-6d48-41a4-8df1-a70e41b7d761 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:10.265855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1157/2268] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 93 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:23:10.266959 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d3307-0f3f-4914-9c4c-f7d526a93f24 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:10.274892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b74656-6d48-41a4-8df1-a70e41b7d761 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:10.276566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e4b74656-6d48-41a4-8df1-a70e41b7d761 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:10.278118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a12d3307-0f3f-4914-9c4c-f7d526a93f24 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:10.283280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a62a97-0ac7-496d-8ba0-6be939a82a93 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd0c45856e34402bf3ff91f4596ae8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12640430fad847c7baba25226f69234b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:10.283968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a62a97-0ac7-496d-8ba0-6be939a82a93 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.284259 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a62a97-0ac7-496d-8ba0-6be939a82a93 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.284540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55a62a97-0ac7-496d-8ba0-6be939a82a93 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.285294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a62a97-0ac7-496d-8ba0-6be939a82a93 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:10.287220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55a62a97-0ac7-496d-8ba0-6be939a82a93 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:10.318850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1112/2269] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:23:10 2022] POST /identity/v3/projects => generated 352 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:23:10.320031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a62a97-0ac7-496d-8ba0-6be939a82a93 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:10.339629 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b74656-6d48-41a4-8df1-a70e41b7d761 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:10.382634 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55a62a97-0ac7-496d-8ba0-6be939a82a93 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:10.387561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694769ea-9b2f-41c5-8dee-9bca7a801773 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd0c45856e34402bf3ff91f4596ae8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12640430fad847c7baba25226f69234b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:10.388772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694769ea-9b2f-41c5-8dee-9bca7a801773 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.389097 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694769ea-9b2f-41c5-8dee-9bca7a801773 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.389383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-694769ea-9b2f-41c5-8dee-9bca7a801773 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.389554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935eb6d-e2ac-4774-983c-db9980238759 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:10.390136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694769ea-9b2f-41c5-8dee-9bca7a801773 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:23:10.390241 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935eb6d-e2ac-4774-983c-db9980238759 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.390446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935eb6d-e2ac-4774-983c-db9980238759 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.390557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694769ea-9b2f-41c5-8dee-9bca7a801773 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:10.390729 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6935eb6d-e2ac-4774-983c-db9980238759 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.392087 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-694769ea-9b2f-41c5-8dee-9bca7a801773 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:10.403476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1113/2270] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:23:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 84 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:23:10.440053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694769ea-9b2f-41c5-8dee-9bca7a801773 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:10.453965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935eb6d-e2ac-4774-983c-db9980238759 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:10.454378 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-694769ea-9b2f-41c5-8dee-9bca7a801773 tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:10.456320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6935eb6d-e2ac-4774-983c-db9980238759 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:10.459521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99509d3-2455-4958-bdb8-d3db8dc8a38d tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'fbd0c45856e34402bf3ff91f4596ae8c', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '12640430fad847c7baba25226f69234b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:10.460397 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99509d3-2455-4958-bdb8-d3db8dc8a38d tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.460685 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99509d3-2455-4958-bdb8-d3db8dc8a38d tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.460966 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99509d3-2455-4958-bdb8-d3db8dc8a38d tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] PATH_INFO: `/v3/projects/7646e976fd974ac4b3ce59b40dfc341a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.462206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99509d3-2455-4958-bdb8-d3db8dc8a38d tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] RBAC: Authorizing `identity:delete_project(project_id=7646e976fd974ac4b3ce59b40dfc341a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:10.464157 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99509d3-2455-4958-bdb8-d3db8dc8a38d tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:10.466996 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1158/2271] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:10 2022] GET /identity/v3/auth/tokens => generated 3226 bytes in 193 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:23:10.481310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935eb6d-e2ac-4774-983c-db9980238759 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:10.516770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f99509d3-2455-4958-bdb8-d3db8dc8a38d tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7646e976fd974ac4b3ce59b40dfc341a', 'request_id': 'req-f99509d3-2455-4958-bdb8-d3db8dc8a38d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.525781 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f99509d3-2455-4958-bdb8-d3db8dc8a38d tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7646e976fd974ac4b3ce59b40dfc341a', 'request_id': 'req-f99509d3-2455-4958-bdb8-d3db8dc8a38d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.534182 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f99509d3-2455-4958-bdb8-d3db8dc8a38d tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7646e976fd974ac4b3ce59b40dfc341a', 'request_id': 'req-f99509d3-2455-4958-bdb8-d3db8dc8a38d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.540670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:INSERT=2,keystone:DELETE=7 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:10.547379 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:10.550491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f99509d3-2455-4958-bdb8-d3db8dc8a38d tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] The token cache is being invalidate because project 7646e976fd974ac4b3ce59b40dfc341a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:10.550719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f99509d3-2455-4958-bdb8-d3db8dc8a38d tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.551973 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f99509d3-2455-4958-bdb8-d3db8dc8a38d tempest-VolumeQuotaClassesTest-1936858956 tempest-VolumeQuotaClassesTest-1936858956-project-admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.554010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1114/2272] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:10 2022] DELETE /identity/v3/projects/7646e976fd974ac4b3ce59b40dfc341a => generated 0 bytes in 115 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:10.555435 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6935eb6d-e2ac-4774-983c-db9980238759 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:10.617892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c16e8-03e3-4f22-aa89-52a0a20120d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:10.618770 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c16e8-03e3-4f22-aa89-52a0a20120d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.619065 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c16e8-03e3-4f22-aa89-52a0a20120d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.619670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e45c16e8-03e3-4f22-aa89-52a0a20120d0 admin admin] PATH_INFO: `/v3/users/f1e5bdfe4ccd493c852b11a651fdafa0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.620530 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c16e8-03e3-4f22-aa89-52a0a20120d0 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f1e5bdfe4ccd493c852b11a651fdafa0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:10.623079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e45c16e8-03e3-4f22-aa89-52a0a20120d0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:10.677780 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e45c16e8-03e3-4f22-aa89-52a0a20120d0 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f1e5bdfe4ccd493c852b11a651fdafa0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.678463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e45c16e8-03e3-4f22-aa89-52a0a20120d0 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f1e5bdfe4ccd493c852b11a651fdafa0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.686378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e45c16e8-03e3-4f22-aa89-52a0a20120d0 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f1e5bdfe4ccd493c852b11a651fdafa0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.687044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e45c16e8-03e3-4f22-aa89-52a0a20120d0 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f1e5bdfe4ccd493c852b11a651fdafa0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.704947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e45c16e8-03e3-4f22-aa89-52a0a20120d0 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f1e5bdfe4ccd493c852b11a651fdafa0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.719846 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1159/2273] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:23:10 2022] DELETE /identity/v3/users/f1e5bdfe4ccd493c852b11a651fdafa0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:23:10.725001 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a028d2-cab9-451c-b5a8-b49a01f3e1c9 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.725376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a028d2-cab9-451c-b5a8-b49a01f3e1c9 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.725726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6a028d2-cab9-451c-b5a8-b49a01f3e1c9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.749481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f6a028d2-cab9-451c-b5a8-b49a01f3e1c9 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:10.751071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f6a028d2-cab9-451c-b5a8-b49a01f3e1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:10.777681 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c16e8-03e3-4f22-aa89-52a0a20120d0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:10.779746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e45c16e8-03e3-4f22-aa89-52a0a20120d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:10.835277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1115/2274] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:10.842150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a028d2-cab9-451c-b5a8-b49a01f3e1c9 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:10.843496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f6a028d2-cab9-451c-b5a8-b49a01f3e1c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:10.848398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e45c16e8-03e3-4f22-aa89-52a0a20120d0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:10.854203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58c71cab-362d-49f2-abf3-f2d45cd7e852 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:10.855109 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c71cab-362d-49f2-abf3-f2d45cd7e852 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.855393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c71cab-362d-49f2-abf3-f2d45cd7e852 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.855663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58c71cab-362d-49f2-abf3-f2d45cd7e852 admin admin] PATH_INFO: `/v3/users/4392533bf2be49b386d57d9d8643f9df` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.857484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c71cab-362d-49f2-abf3-f2d45cd7e852 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4392533bf2be49b386d57d9d8643f9df)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:10.859424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58c71cab-362d-49f2-abf3-f2d45cd7e852 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:10.882620 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=85,keystone:DELETE=14,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:10.907405 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6a028d2-cab9-451c-b5a8-b49a01f3e1c9 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:10.911228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff0326-47aa-4085-9f92-542b3c045f67 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:10.911871 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff0326-47aa-4085-9f92-542b3c045f67 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.912153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff0326-47aa-4085-9f92-542b3c045f67 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.912254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-58c71cab-362d-49f2-abf3-f2d45cd7e852 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4392533bf2be49b386d57d9d8643f9df'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.912437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2ff0326-47aa-4085-9f92-542b3c045f67 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.913192 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-58c71cab-362d-49f2-abf3-f2d45cd7e852 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4392533bf2be49b386d57d9d8643f9df'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.922522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-58c71cab-362d-49f2-abf3-f2d45cd7e852 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4392533bf2be49b386d57d9d8643f9df'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.922888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff0326-47aa-4085-9f92-542b3c045f67 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:10.923172 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-58c71cab-362d-49f2-abf3-f2d45cd7e852 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4392533bf2be49b386d57d9d8643f9df'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.924394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f2ff0326-47aa-4085-9f92-542b3c045f67 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:10.934246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1116/2275] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:23:10.938262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff0326-47aa-4085-9f92-542b3c045f67 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:10.939350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-58c71cab-362d-49f2-abf3-f2d45cd7e852 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4392533bf2be49b386d57d9d8643f9df'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:10.939785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f2ff0326-47aa-4085-9f92-542b3c045f67 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:10.961752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2ff0326-47aa-4085-9f92-542b3c045f67 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:10.970629 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1160/2276] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:23:10 2022] DELETE /identity/v3/users/4392533bf2be49b386d57d9d8643f9df => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:23:10.970854 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15325e28-a413-4352-be75-a1a2a2960f00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:10.970854 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15325e28-a413-4352-be75-a1a2a2960f00 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.970854 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15325e28-a413-4352-be75-a1a2a2960f00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.970854 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15325e28-a413-4352-be75-a1a2a2960f00 admin admin] PATH_INFO: `/v3/users/7779725522d4409bbd09f3c4fd07df31` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.972035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15325e28-a413-4352-be75-a1a2a2960f00 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7779725522d4409bbd09f3c4fd07df31)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:10.972499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21db3c-5d5b-4dd2-9073-178020761dd9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:10.973182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21db3c-5d5b-4dd2-9073-178020761dd9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:10.973525 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee21db3c-5d5b-4dd2-9073-178020761dd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:10.974248 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15325e28-a413-4352-be75-a1a2a2960f00 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:10.996544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ee21db3c-5d5b-4dd2-9073-178020761dd9 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:10.997236 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ee21db3c-5d5b-4dd2-9073-178020761dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:11.035952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-15325e28-a413-4352-be75-a1a2a2960f00 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7779725522d4409bbd09f3c4fd07df31'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.047153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-15325e28-a413-4352-be75-a1a2a2960f00 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7779725522d4409bbd09f3c4fd07df31'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.048285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-15325e28-a413-4352-be75-a1a2a2960f00 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7779725522d4409bbd09f3c4fd07df31'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.062723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-15325e28-a413-4352-be75-a1a2a2960f00 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7779725522d4409bbd09f3c4fd07df31'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.070161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1161/2277] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:23:11.071236 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-15325e28-a413-4352-be75-a1a2a2960f00 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7779725522d4409bbd09f3c4fd07df31'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.078054 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1117/2278] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:23:10 2022] DELETE /identity/v3/users/7779725522d4409bbd09f3c4fd07df31 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:11.081609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21db3c-5d5b-4dd2-9073-178020761dd9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:11.083372 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ee21db3c-5d5b-4dd2-9073-178020761dd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:11.083509 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058b23c-f6c6-493c-aff3-f8c1a46ca834 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:11.083726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058b23c-f6c6-493c-aff3-f8c1a46ca834 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:11.084108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9058b23c-f6c6-493c-aff3-f8c1a46ca834 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:11.111559 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9058b23c-f6c6-493c-aff3-f8c1a46ca834 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:11.113466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9058b23c-f6c6-493c-aff3-f8c1a46ca834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:11.122010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:11.179364 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee21db3c-5d5b-4dd2-9073-178020761dd9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:11.193070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1118/2279] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:11.203784 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058b23c-f6c6-493c-aff3-f8c1a46ca834 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:11.205183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9058b23c-f6c6-493c-aff3-f8c1a46ca834 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:11.252947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f0a31-5c1f-4042-8d27-087b3aa8c82c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:11.253696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f0a31-5c1f-4042-8d27-087b3aa8c82c service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:11.253981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f0a31-5c1f-4042-8d27-087b3aa8c82c service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:11.254265 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb5f0a31-5c1f-4042-8d27-087b3aa8c82c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:11.258656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bb5f0a31-5c1f-4042-8d27-087b3aa8c82c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:11.272373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f0a31-5c1f-4042-8d27-087b3aa8c82c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:11.274004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb5f0a31-5c1f-4042-8d27-087b3aa8c82c service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:11.282240 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:11.295181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1162/2280] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 214 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:11.296132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f0a31-5c1f-4042-8d27-087b3aa8c82c service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:11.297835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bb5f0a31-5c1f-4042-8d27-087b3aa8c82c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:11.298624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9058b23c-f6c6-493c-aff3-f8c1a46ca834 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:11.304699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba11326d-f9d0-46bf-a67a-b3fdf7dd393c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:11.305679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11326d-f9d0-46bf-a67a-b3fdf7dd393c service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:11.306578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11326d-f9d0-46bf-a67a-b3fdf7dd393c service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:11.306714 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba11326d-f9d0-46bf-a67a-b3fdf7dd393c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:11.310531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb5f0a31-5c1f-4042-8d27-087b3aa8c82c service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:11.317143 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a432a728-fca5-404a-8b2b-709b3f942bda admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:11.318090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a728-fca5-404a-8b2b-709b3f942bda admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:11.318372 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a728-fca5-404a-8b2b-709b3f942bda admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:11.318648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a432a728-fca5-404a-8b2b-709b3f942bda admin admin] PATH_INFO: `/v3/projects/983623479e1d445c9f7f83046d69f9ea` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:11.319832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432a728-fca5-404a-8b2b-709b3f942bda admin admin] RBAC: Authorizing `identity:delete_project(project_id=983623479e1d445c9f7f83046d69f9ea)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:11.321784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a432a728-fca5-404a-8b2b-709b3f942bda admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:11.322006 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11326d-f9d0-46bf-a67a-b3fdf7dd393c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:11.324452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba11326d-f9d0-46bf-a67a-b3fdf7dd393c service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:11.341146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1119/2281] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:23:11.392023 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a432a728-fca5-404a-8b2b-709b3f942bda admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '983623479e1d445c9f7f83046d69f9ea', 'request_id': 'req-a432a728-fca5-404a-8b2b-709b3f942bda'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.403025 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a432a728-fca5-404a-8b2b-709b3f942bda admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '983623479e1d445c9f7f83046d69f9ea', 'request_id': 'req-a432a728-fca5-404a-8b2b-709b3f942bda'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.412625 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a432a728-fca5-404a-8b2b-709b3f942bda admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '983623479e1d445c9f7f83046d69f9ea', 'request_id': 'req-a432a728-fca5-404a-8b2b-709b3f942bda'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.427601 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a432a728-fca5-404a-8b2b-709b3f942bda admin admin] The token cache is being invalidate because project 983623479e1d445c9f7f83046d69f9ea was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:11.428503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a432a728-fca5-404a-8b2b-709b3f942bda admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.429148 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a432a728-fca5-404a-8b2b-709b3f942bda admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.431057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1163/2282] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:11 2022] DELETE /identity/v3/projects/983623479e1d445c9f7f83046d69f9ea => generated 0 bytes in 135 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:11.436790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f579c0-36bf-4e1b-8f28-4d193533f13c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:11.437123 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f579c0-36bf-4e1b-8f28-4d193533f13c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:11.437430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6f579c0-36bf-4e1b-8f28-4d193533f13c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:11.467153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b6f579c0-36bf-4e1b-8f28-4d193533f13c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:11.468543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b6f579c0-36bf-4e1b-8f28-4d193533f13c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:11.551728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1120/2283] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:11.560892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57aa6f-8fdd-43dd-964d-0e62b99bb84e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:11.561211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57aa6f-8fdd-43dd-964d-0e62b99bb84e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:11.561495 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f57aa6f-8fdd-43dd-964d-0e62b99bb84e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:11.580621 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2f57aa6f-8fdd-43dd-964d-0e62b99bb84e None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:11.581917 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2f57aa6f-8fdd-43dd-964d-0e62b99bb84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:11.594866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1164/2284] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:11.597712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f579c0-36bf-4e1b-8f28-4d193533f13c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:11.615692 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6f579c0-36bf-4e1b-8f28-4d193533f13c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:11.624151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca782f-16ac-4e8c-a8ce-ae2e75524b9f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:11.624843 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca782f-16ac-4e8c-a8ce-ae2e75524b9f admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:11.625159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca782f-16ac-4e8c-a8ce-ae2e75524b9f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:11.625482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7ca782f-16ac-4e8c-a8ce-ae2e75524b9f admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:11.626177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca782f-16ac-4e8c-a8ce-ae2e75524b9f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:23:11.626551 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca782f-16ac-4e8c-a8ce-ae2e75524b9f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:11.630514 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7ca782f-16ac-4e8c-a8ce-ae2e75524b9f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:11.631988 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57aa6f-8fdd-43dd-964d-0e62b99bb84e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:11.636102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2f57aa6f-8fdd-43dd-964d-0e62b99bb84e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:11.649450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1121/2285] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:23:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 54 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:23:11.653521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca782f-16ac-4e8c-a8ce-ae2e75524b9f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:11.654224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f57aa6f-8fdd-43dd-964d-0e62b99bb84e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:11.663429 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:11.664559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:11.664959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:11.665376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] PATH_INFO: `/v3/projects/c06dfab2be9d4693ae52f9df5cd9acc3` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:11.666791 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] RBAC: Authorizing `identity:delete_project(project_id=c06dfab2be9d4693ae52f9df5cd9acc3)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:11.668718 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:11.673257 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7ca782f-16ac-4e8c-a8ce-ae2e75524b9f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:11.697960 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8aef6-4091-4b12-b135-5e97604917af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:11.699133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8aef6-4091-4b12-b135-5e97604917af admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:11.699715 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8aef6-4091-4b12-b135-5e97604917af admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:11.700261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29d8aef6-4091-4b12-b135-5e97604917af admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:11.702246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8aef6-4091-4b12-b135-5e97604917af admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:11.706526 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29d8aef6-4091-4b12-b135-5e97604917af admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:11.727053 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c06dfab2be9d4693ae52f9df5cd9acc3', 'request_id': 'req-1a67e582-25e8-409f-b2e4-64a9de27d78f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.736877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c06dfab2be9d4693ae52f9df5cd9acc3', 'request_id': 'req-1a67e582-25e8-409f-b2e4-64a9de27d78f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.751625 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1122/2286] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:23:11 2022] POST /identity/v3/projects => generated 369 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:11.751625 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8aef6-4091-4b12-b135-5e97604917af admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:11.753305 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-29d8aef6-4091-4b12-b135-5e97604917af admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:11.754227 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c06dfab2be9d4693ae52f9df5cd9acc3', 'request_id': 'req-1a67e582-25e8-409f-b2e4-64a9de27d78f'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.771263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] The token cache is being invalidate because project c06dfab2be9d4693ae52f9df5cd9acc3 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:11.771764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.772754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.774980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1165/2287] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:11 2022] DELETE /identity/v3/projects/c06dfab2be9d4693ae52f9df5cd9acc3 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:11.775889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:11.777509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:11.783076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:11.830340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29d8aef6-4091-4b12-b135-5e97604917af admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:11.836953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:11.837930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:11.838287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:11.839112 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] PATH_INFO: `/v3/projects/c5a600d706504ef0b04cf57c6bce913c` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:11.840421 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=c5a600d706504ef0b04cf57c6bce913c)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:11.843534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:11.879384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a67e582-25e8-409f-b2e4-64a9de27d78f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:11.884378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c205c9e-5038-4ec2-873b-b4a269a10f19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:11.885080 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c205c9e-5038-4ec2-873b-b4a269a10f19 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:11.885366 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c205c9e-5038-4ec2-873b-b4a269a10f19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:11.885641 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c205c9e-5038-4ec2-873b-b4a269a10f19 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:11.886449 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c205c9e-5038-4ec2-873b-b4a269a10f19 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:11.888817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c205c9e-5038-4ec2-873b-b4a269a10f19 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:11.895644 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=84,keystone:DELETE=14,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:11.896052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c5a600d706504ef0b04cf57c6bce913c', 'request_id': 'req-c9b55f27-d421-48f0-8393-5612020e15b3'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.903790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c5a600d706504ef0b04cf57c6bce913c', 'request_id': 'req-c9b55f27-d421-48f0-8393-5612020e15b3'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.909786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c5a600d706504ef0b04cf57c6bce913c', 'request_id': 'req-c9b55f27-d421-48f0-8393-5612020e15b3'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.912185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1166/2288] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:23:11 2022] POST /identity/v3/users => generated 285 bytes in 137 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:11.913218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c205c9e-5038-4ec2-873b-b4a269a10f19 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:11.914924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3c205c9e-5038-4ec2-873b-b4a269a10f19 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:11.922646 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] The token cache is being invalidate because project c5a600d706504ef0b04cf57c6bce913c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:11.922930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.923570 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:11.925147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1123/2289] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:11 2022] DELETE /identity/v3/projects/c5a600d706504ef0b04cf57c6bce913c => generated 0 bytes in 176 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:11.927615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c205c9e-5038-4ec2-873b-b4a269a10f19 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:11.932479 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:11.934645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:11.999445 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45c885e7-bd44-441b-bd2a-c10bfb941c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:12.000659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c885e7-bd44-441b-bd2a-c10bfb941c57 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:12.001056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c885e7-bd44-441b-bd2a-c10bfb941c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:12.001395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45c885e7-bd44-441b-bd2a-c10bfb941c57 admin admin] PATH_INFO: `/v3/users/fbd0c45856e34402bf3ff91f4596ae8c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:12.002946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c885e7-bd44-441b-bd2a-c10bfb941c57 admin admin] RBAC: Authorizing `identity:delete_user(user_id=fbd0c45856e34402bf3ff91f4596ae8c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:12.005239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45c885e7-bd44-441b-bd2a-c10bfb941c57 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:12.031751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b55f27-d421-48f0-8393-5612020e15b3 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:12.038983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59534fbc-6e0d-4e05-b5a6-729db2900462 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:12.040012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534fbc-6e0d-4e05-b5a6-729db2900462 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:12.040449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534fbc-6e0d-4e05-b5a6-729db2900462 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:12.040739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59534fbc-6e0d-4e05-b5a6-729db2900462 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:12.041603 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59534fbc-6e0d-4e05-b5a6-729db2900462 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:12.043630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59534fbc-6e0d-4e05-b5a6-729db2900462 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:12.058400 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1124/2290] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:11 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:12.063497 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59534fbc-6e0d-4e05-b5a6-729db2900462 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:12.073500 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-45c885e7-bd44-441b-bd2a-c10bfb941c57 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'fbd0c45856e34402bf3ff91f4596ae8c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:12.074853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-45c885e7-bd44-441b-bd2a-c10bfb941c57 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'fbd0c45856e34402bf3ff91f4596ae8c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:12.075324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59534fbc-6e0d-4e05-b5a6-729db2900462 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:12.080896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1da33-a670-4f30-bd05-db8534d0e970 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:12.081778 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1da33-a670-4f30-bd05-db8534d0e970 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:12.082136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1da33-a670-4f30-bd05-db8534d0e970 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:12.082563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc1da33-a670-4f30-bd05-db8534d0e970 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:12.083104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-45c885e7-bd44-441b-bd2a-c10bfb941c57 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'fbd0c45856e34402bf3ff91f4596ae8c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:12.083361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1da33-a670-4f30-bd05-db8534d0e970 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:12.083937 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-45c885e7-bd44-441b-bd2a-c10bfb941c57 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'fbd0c45856e34402bf3ff91f4596ae8c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:12.085187 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bc1da33-a670-4f30-bd05-db8534d0e970 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:12.099024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1125/2291] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:23:12.100095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-45c885e7-bd44-441b-bd2a-c10bfb941c57 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'fbd0c45856e34402bf3ff91f4596ae8c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:12.100495 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1da33-a670-4f30-bd05-db8534d0e970 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:12.102803 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8bc1da33-a670-4f30-bd05-db8534d0e970 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:12.124329 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc1da33-a670-4f30-bd05-db8534d0e970 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:12.127693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1167/2292] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:23:11 2022] DELETE /identity/v3/users/fbd0c45856e34402bf3ff91f4596ae8c => generated 0 bytes in 215 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:12.130945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bc0c8-6e4d-465e-a583-87dc75c72cf1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:12.130945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bc0c8-6e4d-465e-a583-87dc75c72cf1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:12.130945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bc0c8-6e4d-465e-a583-87dc75c72cf1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:12.130945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-126bc0c8-6e4d-465e-a583-87dc75c72cf1 admin admin] PATH_INFO: `/v3/projects/bbba313ec75946248a81318d42e5d2a7/users/ca557b9e136f44d4838dbf54d27a8be4/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:12.148307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bc0c8-6e4d-465e-a583-87dc75c72cf1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bbba313ec75946248a81318d42e5d2a7, user_id=ca557b9e136f44d4838dbf54d27a8be4, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:12.151246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-126bc0c8-6e4d-465e-a583-87dc75c72cf1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:12.164462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1126/2293] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:12 2022] PUT /identity/v3/projects/bbba313ec75946248a81318d42e5d2a7/users/ca557b9e136f44d4838dbf54d27a8be4/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:12.175148 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e212c6-b1cb-4ea4-84d8-bccf66ed2944 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:12.175444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e212c6-b1cb-4ea4-84d8-bccf66ed2944 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:12.175726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66e212c6-b1cb-4ea4-84d8-bccf66ed2944 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:12.204206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-66e212c6-b1cb-4ea4-84d8-bccf66ed2944 None None] MFA Rules not processed for user `ca557b9e136f44d4838dbf54d27a8be4`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:12.205689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-66e212c6-b1cb-4ea4-84d8-bccf66ed2944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:12.267753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:INSERT=4,keystone:SELECT=86,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:12.275971 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1168/2294] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:12 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:12.290766 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bc0c8-6e4d-465e-a583-87dc75c72cf1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:12.293654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-126bc0c8-6e4d-465e-a583-87dc75c72cf1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:12.309086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:12.355366 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-126bc0c8-6e4d-465e-a583-87dc75c72cf1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:12.359824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4e135e-f7c3-4be0-91fa-0bee26b00447 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbb5beba8a45a5b0a9b0beba0e0d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:12.360469 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e135e-f7c3-4be0-91fa-0bee26b00447 service glance] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:12.360754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e135e-f7c3-4be0-91fa-0bee26b00447 service glance] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:12.361060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4e135e-f7c3-4be0-91fa-0bee26b00447 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:12.369758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e135e-f7c3-4be0-91fa-0bee26b00447 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:12.371201 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4e135e-f7c3-4be0-91fa-0bee26b00447 service glance] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:12.380324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1127/2295] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:12 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:12.416766 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e212c6-b1cb-4ea4-84d8-bccf66ed2944 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:12.418418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-66e212c6-b1cb-4ea4-84d8-bccf66ed2944 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:12.504390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66e212c6-b1cb-4ea4-84d8-bccf66ed2944 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:12.509173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:12.510027 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:12.510303 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:12.510580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59 admin admin] PATH_INFO: `/v3/projects/12640430fad847c7baba25226f69234b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:12.511832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59 admin admin] RBAC: Authorizing `identity:delete_project(project_id=12640430fad847c7baba25226f69234b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:12.513814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:12.560498 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '12640430fad847c7baba25226f69234b', 'request_id': 'req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:12.568793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '12640430fad847c7baba25226f69234b', 'request_id': 'req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:12.574650 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '12640430fad847c7baba25226f69234b', 'request_id': 'req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:12.586250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59 admin admin] The token cache is being invalidate because project 12640430fad847c7baba25226f69234b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:12.586539 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:12.587211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ca14b849-ed9a-48c0-8296-bdbb4c2f3a59 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:12.588749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1169/2296] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:12 2022] DELETE /identity/v3/projects/12640430fad847c7baba25226f69234b => generated 0 bytes in 173 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:12.594226 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8669a-b912-42f1-9190-d67e88a1d5bb None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:12.594591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8669a-b912-42f1-9190-d67e88a1d5bb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:12.594941 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd8669a-b912-42f1-9190-d67e88a1d5bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:12.614575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8fd8669a-b912-42f1-9190-d67e88a1d5bb None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:12.617251 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8fd8669a-b912-42f1-9190-d67e88a1d5bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:12.686844 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1128/2297] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:12.694774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef8a6b-b738-417a-9f7f-42a5a2d14bdf None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:12.695275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef8a6b-b738-417a-9f7f-42a5a2d14bdf None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:12.695538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a1ef8a6b-b738-417a-9f7f-42a5a2d14bdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:12.716066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a1ef8a6b-b738-417a-9f7f-42a5a2d14bdf None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:12.717884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a1ef8a6b-b738-417a-9f7f-42a5a2d14bdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:12.726142 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1170/2298] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:12 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:12.730749 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8669a-b912-42f1-9190-d67e88a1d5bb None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:12.741072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd8669a-b912-42f1-9190-d67e88a1d5bb None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:12.745667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3e277-3395-4749-b095-a2d66dfb1837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:12.746331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3e277-3395-4749-b095-a2d66dfb1837 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:12.746620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3e277-3395-4749-b095-a2d66dfb1837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:12.746898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc3e277-3395-4749-b095-a2d66dfb1837 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:12.747656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3e277-3395-4749-b095-a2d66dfb1837 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:23:12.747975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3e277-3395-4749-b095-a2d66dfb1837 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:12.749651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfc3e277-3395-4749-b095-a2d66dfb1837 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:12.769034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1129/2299] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:23:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:23:12.776656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef8a6b-b738-417a-9f7f-42a5a2d14bdf None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:12.786949 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a1ef8a6b-b738-417a-9f7f-42a5a2d14bdf None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:12.791952 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d852d82-380b-4d49-88ff-a950e5da8104 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:12.792690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d852d82-380b-4d49-88ff-a950e5da8104 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:12.793012 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d852d82-380b-4d49-88ff-a950e5da8104 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:12.793561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d852d82-380b-4d49-88ff-a950e5da8104 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:12.796025 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d852d82-380b-4d49-88ff-a950e5da8104 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:12.805304 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d852d82-380b-4d49-88ff-a950e5da8104 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:12.837150 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1171/2300] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:23:12 2022] POST /identity/v3/projects => generated 373 bytes in 61 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:12.842228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3e277-3395-4749-b095-a2d66dfb1837 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:12.862229 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc3e277-3395-4749-b095-a2d66dfb1837 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:12.944112 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643d092-d6e1-4796-8c5b-2a2e93c0e842 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:12.945401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643d092-d6e1-4796-8c5b-2a2e93c0e842 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:12.945841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643d092-d6e1-4796-8c5b-2a2e93c0e842 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:12.946288 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9643d092-d6e1-4796-8c5b-2a2e93c0e842 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:12.947570 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643d092-d6e1-4796-8c5b-2a2e93c0e842 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:12.949942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9643d092-d6e1-4796-8c5b-2a2e93c0e842 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:12.981819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1130/2301] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:23:12 2022] POST /identity/v3/users => generated 287 bytes in 138 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:12.983050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d852d82-380b-4d49-88ff-a950e5da8104 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:12.996082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d852d82-380b-4d49-88ff-a950e5da8104 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:13.001573 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78251601-2252-4055-a85b-125f63461b29 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:13.002335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251601-2252-4055-a85b-125f63461b29 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:13.002618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251601-2252-4055-a85b-125f63461b29 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:13.003095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78251601-2252-4055-a85b-125f63461b29 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:13.003924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78251601-2252-4055-a85b-125f63461b29 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:13.005582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78251601-2252-4055-a85b-125f63461b29 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:13.022954 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1172/2302] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:12 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:23:13.024286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643d092-d6e1-4796-8c5b-2a2e93c0e842 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:13.035540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9643d092-d6e1-4796-8c5b-2a2e93c0e842 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:13.040335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1dd9c1a9-d743-4186-8eeb-575bd16b9c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:13.041033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9c1a9-d743-4186-8eeb-575bd16b9c2c admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:13.041348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9c1a9-d743-4186-8eeb-575bd16b9c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:13.041625 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1dd9c1a9-d743-4186-8eeb-575bd16b9c2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:13.042492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9c1a9-d743-4186-8eeb-575bd16b9c2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:13.044264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1dd9c1a9-d743-4186-8eeb-575bd16b9c2c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:13.055180 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1131/2303] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:13 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:13.059523 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78251601-2252-4055-a85b-125f63461b29 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:13.071940 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78251601-2252-4055-a85b-125f63461b29 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:13.078204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6af14-1f9b-4dbc-aaad-d398bbddfb20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:13.079235 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6af14-1f9b-4dbc-aaad-d398bbddfb20 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:13.079525 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6af14-1f9b-4dbc-aaad-d398bbddfb20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:13.079808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15f6af14-1f9b-4dbc-aaad-d398bbddfb20 admin admin] PATH_INFO: `/v3/projects/2c606169df5f44e9b19ffc19be8d2728/users/3a40757d21a24b3992710ce8c003ace0/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:13.096884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6af14-1f9b-4dbc-aaad-d398bbddfb20 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2c606169df5f44e9b19ffc19be8d2728, user_id=3a40757d21a24b3992710ce8c003ace0, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:13.099563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15f6af14-1f9b-4dbc-aaad-d398bbddfb20 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:13.115781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1173/2304] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:13 2022] PUT /identity/v3/projects/2c606169df5f44e9b19ffc19be8d2728/users/3a40757d21a24b3992710ce8c003ace0/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:23:13.121188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7549405-2a29-425e-ae18-70dba3dfd8b2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:13.121644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7549405-2a29-425e-ae18-70dba3dfd8b2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:13.121943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7549405-2a29-425e-ae18-70dba3dfd8b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:13.148328 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b7549405-2a29-425e-ae18-70dba3dfd8b2 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:13.149996 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b7549405-2a29-425e-ae18-70dba3dfd8b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:13.163127 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:13.210281 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1132/2305] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:13.221536 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6af14-1f9b-4dbc-aaad-d398bbddfb20 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:13.223218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-15f6af14-1f9b-4dbc-aaad-d398bbddfb20 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:13.252094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:13.293627 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15f6af14-1f9b-4dbc-aaad-d398bbddfb20 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:13.298026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52442e-d7a9-48c0-af84-4b8177341020 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:13.298679 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52442e-d7a9-48c0-af84-4b8177341020 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:13.298961 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52442e-d7a9-48c0-af84-4b8177341020 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:13.299235 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b52442e-d7a9-48c0-af84-4b8177341020 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:13.308709 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52442e-d7a9-48c0-af84-4b8177341020 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:13.310233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b52442e-d7a9-48c0-af84-4b8177341020 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:13.320004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1174/2306] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:13.967626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab6070-21bc-4953-959d-c37232a832d6 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:13.968145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab6070-21bc-4953-959d-c37232a832d6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:13.968145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3ab6070-21bc-4953-959d-c37232a832d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:13.997909 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b3ab6070-21bc-4953-959d-c37232a832d6 None None] MFA Rules not processed for user `3a40757d21a24b3992710ce8c003ace0`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:13.999133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b3ab6070-21bc-4953-959d-c37232a832d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:14.069515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1133/2307] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:13 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:14.074028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52442e-d7a9-48c0-af84-4b8177341020 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:14.083822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b52442e-d7a9-48c0-af84-4b8177341020 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:14.088444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73473526-502b-4929-bd5b-3749bbfe3276 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:14.089140 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73473526-502b-4929-bd5b-3749bbfe3276 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:14.089424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73473526-502b-4929-bd5b-3749bbfe3276 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:14.089700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73473526-502b-4929-bd5b-3749bbfe3276 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:14.090392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73473526-502b-4929-bd5b-3749bbfe3276 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:14.092861 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73473526-502b-4929-bd5b-3749bbfe3276 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:14.121028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1175/2308] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:23:14 2022] POST /identity/v3/projects => generated 371 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:14.127001 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab6070-21bc-4953-959d-c37232a832d6 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:14.143934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3ab6070-21bc-4953-959d-c37232a832d6 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:14.210622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a60cf-dcdd-48bd-8018-0865407c6ac1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:14.211299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a60cf-dcdd-48bd-8018-0865407c6ac1 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:14.211583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a60cf-dcdd-48bd-8018-0865407c6ac1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:14.211860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a86a60cf-dcdd-48bd-8018-0865407c6ac1 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:14.212543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a60cf-dcdd-48bd-8018-0865407c6ac1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:14.214501 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a86a60cf-dcdd-48bd-8018-0865407c6ac1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:14.237747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1134/2309] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:23:14 2022] POST /identity/v3/users => generated 292 bytes in 111 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:23:14.242592 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73473526-502b-4929-bd5b-3749bbfe3276 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:14.253260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73473526-502b-4929-bd5b-3749bbfe3276 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:14.258271 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f991-b83c-4ce1-b367-d308c4dc8ce8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:14.259020 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f991-b83c-4ce1-b367-d308c4dc8ce8 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:14.259248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f991-b83c-4ce1-b367-d308c4dc8ce8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:14.259719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb31f991-b83c-4ce1-b367-d308c4dc8ce8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:14.260506 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31f991-b83c-4ce1-b367-d308c4dc8ce8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:14.262124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb31f991-b83c-4ce1-b367-d308c4dc8ce8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:14.273956 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1176/2310] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:14.277997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a60cf-dcdd-48bd-8018-0865407c6ac1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:14.288823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a86a60cf-dcdd-48bd-8018-0865407c6ac1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:14.293653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ace6c7-e95b-4c6f-aaf5-07947426b61d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:14.294532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace6c7-e95b-4c6f-aaf5-07947426b61d admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:14.294816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace6c7-e95b-4c6f-aaf5-07947426b61d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:14.295096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7ace6c7-e95b-4c6f-aaf5-07947426b61d admin admin] PATH_INFO: `/v3/projects/d63e75218bbc412dadc70478d0fcc509/users/536837bb5fd1468e903d16a2ce2dc9c8/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:14.309484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ace6c7-e95b-4c6f-aaf5-07947426b61d admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63e75218bbc412dadc70478d0fcc509, user_id=536837bb5fd1468e903d16a2ce2dc9c8, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:14.312152 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7ace6c7-e95b-4c6f-aaf5-07947426b61d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:14.326418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1135/2311] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:14 2022] PUT /identity/v3/projects/d63e75218bbc412dadc70478d0fcc509/users/536837bb5fd1468e903d16a2ce2dc9c8/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:14.330458 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f991-b83c-4ce1-b367-d308c4dc8ce8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:14.341809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb31f991-b83c-4ce1-b367-d308c4dc8ce8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:14.401057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f891a461-b7b8-4e07-b87e-43f25a36c9b3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:14.401738 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891a461-b7b8-4e07-b87e-43f25a36c9b3 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:14.402022 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891a461-b7b8-4e07-b87e-43f25a36c9b3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:14.402299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f891a461-b7b8-4e07-b87e-43f25a36c9b3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:14.403124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891a461-b7b8-4e07-b87e-43f25a36c9b3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:14.405808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f891a461-b7b8-4e07-b87e-43f25a36c9b3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:14.416440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1177/2312] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:23:14 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:23:14.420672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ace6c7-e95b-4c6f-aaf5-07947426b61d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:14.431166 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7ace6c7-e95b-4c6f-aaf5-07947426b61d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:14.435829 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40e9aaef-4fcd-46b7-be0f-55dbfcd82d74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:14.436705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9aaef-4fcd-46b7-be0f-55dbfcd82d74 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:14.437009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9aaef-4fcd-46b7-be0f-55dbfcd82d74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:14.437293 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40e9aaef-4fcd-46b7-be0f-55dbfcd82d74 admin admin] PATH_INFO: `/v3/projects/d63e75218bbc412dadc70478d0fcc509/users/536837bb5fd1468e903d16a2ce2dc9c8/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:14.439257 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9aaef-4fcd-46b7-be0f-55dbfcd82d74 admin admin] RBAC: Authorizing `identity:create_grant(project_id=d63e75218bbc412dadc70478d0fcc509, user_id=536837bb5fd1468e903d16a2ce2dc9c8, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:14.441972 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40e9aaef-4fcd-46b7-be0f-55dbfcd82d74 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:14.452500 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1136/2313] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:23:14 2022] PUT /identity/v3/projects/d63e75218bbc412dadc70478d0fcc509/users/536837bb5fd1468e903d16a2ce2dc9c8/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:15.086459 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac34be-b91a-4034-a634-ff30e927a296 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:15.086991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac34be-b91a-4034-a634-ff30e927a296 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:15.086991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59ac34be-b91a-4034-a634-ff30e927a296 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:15.115046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-59ac34be-b91a-4034-a634-ff30e927a296 None None] MFA Rules not processed for user `536837bb5fd1468e903d16a2ce2dc9c8`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:15.116956 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-59ac34be-b91a-4034-a634-ff30e927a296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:15.195211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1178/2314] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:15 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:15.206648 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb15730-72e3-454b-84f0-55e6745b3614 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:15.207175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb15730-72e3-454b-84f0-55e6745b3614 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:15.207175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdb15730-72e3-454b-84f0-55e6745b3614 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:15.213085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:15.227006 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-bdb15730-72e3-454b-84f0-55e6745b3614 None None] MFA Rules not processed for user `3a40757d21a24b3992710ce8c003ace0`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:15.228221 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bdb15730-72e3-454b-84f0-55e6745b3614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:15.302249 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1137/2315] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:15 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:15.313722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac34be-b91a-4034-a634-ff30e927a296 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:15.315278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-59ac34be-b91a-4034-a634-ff30e927a296 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:15.333531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:15.396642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59ac34be-b91a-4034-a634-ff30e927a296 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:15.402507 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17ac26e8-d130-4f03-8697-a0754a962cb1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:15.403279 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac26e8-d130-4f03-8697-a0754a962cb1 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:15.403571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac26e8-d130-4f03-8697-a0754a962cb1 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:15.403878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17ac26e8-d130-4f03-8697-a0754a962cb1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:15.419164 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac26e8-d130-4f03-8697-a0754a962cb1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:15.420954 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17ac26e8-d130-4f03-8697-a0754a962cb1 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:15.431229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1179/2316] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:15 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:25.296312 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=24 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:25.426562 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=27 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:38.863856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb15730-72e3-454b-84f0-55e6745b3614 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:38.865563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bdb15730-72e3-454b-84f0-55e6745b3614 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:38.956462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdb15730-72e3-454b-84f0-55e6745b3614 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:38.960242 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea2222-b29f-45cb-a2b0-ce588e9c1007 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:38.961086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea2222-b29f-45cb-a2b0-ce588e9c1007 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:38.961401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea2222-b29f-45cb-a2b0-ce588e9c1007 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:38.961705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5ea2222-b29f-45cb-a2b0-ce588e9c1007 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:38.994764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea2222-b29f-45cb-a2b0-ce588e9c1007 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:38.996237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5ea2222-b29f-45cb-a2b0-ce588e9c1007 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:39.006569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1138/2317] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:38 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 143 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:42.370699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff73aae-14fb-40ac-9990-b125b2737470 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:42.371205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff73aae-14fb-40ac-9990-b125b2737470 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:42.371301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff73aae-14fb-40ac-9990-b125b2737470 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:42.438248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9ff73aae-14fb-40ac-9990-b125b2737470 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:42.439441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9ff73aae-14fb-40ac-9990-b125b2737470 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:42.513768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1180/2318] 10.222.0.74 () {58 vars in 1016 bytes} [Thu May 26 18:23:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:42.545946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea2222-b29f-45cb-a2b0-ce588e9c1007 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:42.558206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5ea2222-b29f-45cb-a2b0-ce588e9c1007 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:42.564903 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4dc1fa5-ae6a-4277-8677-b6b105a3497a service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:42.565567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc1fa5-ae6a-4277-8677-b6b105a3497a service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:42.565847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc1fa5-ae6a-4277-8677-b6b105a3497a service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:42.566120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4dc1fa5-ae6a-4277-8677-b6b105a3497a service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:42.574226 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc1fa5-ae6a-4277-8677-b6b105a3497a service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:42.575798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4dc1fa5-ae6a-4277-8677-b6b105a3497a service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:42.585780 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1139/2319] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:48.939120 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc6a1c-09d9-4e24-b6c0-c3feff4f4d04 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:48.939608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc6a1c-09d9-4e24-b6c0-c3feff4f4d04 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:48.939702 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95cc6a1c-09d9-4e24-b6c0-c3feff4f4d04 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:48.958400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-95cc6a1c-09d9-4e24-b6c0-c3feff4f4d04 None None] MFA Rules not processed for user `301f5bb1404040d2b7e5c9b55312d515`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:48.959592 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-95cc6a1c-09d9-4e24-b6c0-c3feff4f4d04 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:49.016656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1181/2320] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:48 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:49.017095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120d34c-99bb-43ed-a977-b4b5dd54b1af None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:49.017589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120d34c-99bb-43ed-a977-b4b5dd54b1af None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:49.017682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6120d34c-99bb-43ed-a977-b4b5dd54b1af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:49.036539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6120d34c-99bb-43ed-a977-b4b5dd54b1af None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:49.037776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6120d34c-99bb-43ed-a977-b4b5dd54b1af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:49.045659 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1140/2321] 10.222.0.74 () {58 vars in 1016 bytes} [Thu May 26 18:23:49 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:49.081513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc6a1c-09d9-4e24-b6c0-c3feff4f4d04 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:49.116915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95cc6a1c-09d9-4e24-b6c0-c3feff4f4d04 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:49.122680 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a891f93-4c11-4dc2-b341-0e5328d88400 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:49.123400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a891f93-4c11-4dc2-b341-0e5328d88400 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:49.123688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a891f93-4c11-4dc2-b341-0e5328d88400 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:49.123967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a891f93-4c11-4dc2-b341-0e5328d88400 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:49.133300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a891f93-4c11-4dc2-b341-0e5328d88400 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:49.134336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a891f93-4c11-4dc2-b341-0e5328d88400 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:49.145873 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1182/2322] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:49 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:52.888268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08395c-2ccf-4512-b292-fd0944b18006 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:52.888753 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08395c-2ccf-4512-b292-fd0944b18006 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:52.890545 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c08395c-2ccf-4512-b292-fd0944b18006 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:52.913594 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4c08395c-2ccf-4512-b292-fd0944b18006 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:52.914836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4c08395c-2ccf-4512-b292-fd0944b18006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:52.931871 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1141/2323] 10.222.0.74 () {58 vars in 1016 bytes} [Thu May 26 18:23:52 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:52.954919 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a891f93-4c11-4dc2-b341-0e5328d88400 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:52.956320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6a891f93-4c11-4dc2-b341-0e5328d88400 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:53.013588 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a891f93-4c11-4dc2-b341-0e5328d88400 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:53.022234 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803674c9-db2d-419f-b067-04b338bb3734 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:53.022945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803674c9-db2d-419f-b067-04b338bb3734 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:53.023241 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803674c9-db2d-419f-b067-04b338bb3734 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:53.023934 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803674c9-db2d-419f-b067-04b338bb3734 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:53.039470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:53.049806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803674c9-db2d-419f-b067-04b338bb3734 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:53.055458 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-803674c9-db2d-419f-b067-04b338bb3734 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:53.098122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1183/2324] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:52 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:57.476548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08395c-2ccf-4512-b292-fd0944b18006 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:57.478211 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4c08395c-2ccf-4512-b292-fd0944b18006 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:57.490204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c08395c-2ccf-4512-b292-fd0944b18006 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:57.495136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02f611-b647-4e30-a230-f55a3492974e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:57.496009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02f611-b647-4e30-a230-f55a3492974e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:57.496295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02f611-b647-4e30-a230-f55a3492974e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:57.496568 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f02f611-b647-4e30-a230-f55a3492974e admin admin] PATH_INFO: `/v3/users/ca557b9e136f44d4838dbf54d27a8be4` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:57.497772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02f611-b647-4e30-a230-f55a3492974e admin admin] RBAC: Authorizing `identity:delete_user(user_id=ca557b9e136f44d4838dbf54d27a8be4)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:57.499740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f02f611-b647-4e30-a230-f55a3492974e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:57.545190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0f02f611-b647-4e30-a230-f55a3492974e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ca557b9e136f44d4838dbf54d27a8be4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:57.553114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0f02f611-b647-4e30-a230-f55a3492974e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ca557b9e136f44d4838dbf54d27a8be4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:57.553850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0f02f611-b647-4e30-a230-f55a3492974e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ca557b9e136f44d4838dbf54d27a8be4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:57.566176 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0f02f611-b647-4e30-a230-f55a3492974e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ca557b9e136f44d4838dbf54d27a8be4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:57.574254 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0f02f611-b647-4e30-a230-f55a3492974e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ca557b9e136f44d4838dbf54d27a8be4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:57.576562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:23:57.581652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1142/2325] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:23:57 2022] DELETE /identity/v3/users/ca557b9e136f44d4838dbf54d27a8be4 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:57.586409 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194688e-c8c0-4bc8-b0f3-d204983d551a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:57.586862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194688e-c8c0-4bc8-b0f3-d204983d551a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:57.586965 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c194688e-c8c0-4bc8-b0f3-d204983d551a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:57.604721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c194688e-c8c0-4bc8-b0f3-d204983d551a None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:57.605945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c194688e-c8c0-4bc8-b0f3-d204983d551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:57.663603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1184/2326] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:23:57 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:57.673657 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02f611-b647-4e30-a230-f55a3492974e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:57.675081 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0f02f611-b647-4e30-a230-f55a3492974e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:57.755378 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f02f611-b647-4e30-a230-f55a3492974e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:57.759084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c5312fe-46b9-47d1-9def-90ea5c88d160 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:57.759732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5312fe-46b9-47d1-9def-90ea5c88d160 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:57.760009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5312fe-46b9-47d1-9def-90ea5c88d160 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:57.760282 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c5312fe-46b9-47d1-9def-90ea5c88d160 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:57.769727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5312fe-46b9-47d1-9def-90ea5c88d160 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:57.771200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c5312fe-46b9-47d1-9def-90ea5c88d160 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:57.782307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1143/2327] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:57 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:23:58.055229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194688e-c8c0-4bc8-b0f3-d204983d551a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:58.056709 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c194688e-c8c0-4bc8-b0f3-d204983d551a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:58.068707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c194688e-c8c0-4bc8-b0f3-d204983d551a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:58.073727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:58.074604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:58.074894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:58.075201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] PATH_INFO: `/v3/projects/bbba313ec75946248a81318d42e5d2a7` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:58.076417 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] RBAC: Authorizing `identity:delete_project(project_id=bbba313ec75946248a81318d42e5d2a7)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:58.078857 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:58.129600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bbba313ec75946248a81318d42e5d2a7', 'request_id': 'req-e620fe81-e71d-4c53-a275-5e00b9bffdbc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:58.136793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bbba313ec75946248a81318d42e5d2a7', 'request_id': 'req-e620fe81-e71d-4c53-a275-5e00b9bffdbc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:58.143474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bbba313ec75946248a81318d42e5d2a7', 'request_id': 'req-e620fe81-e71d-4c53-a275-5e00b9bffdbc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:58.156183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] The token cache is being invalidate because project bbba313ec75946248a81318d42e5d2a7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:23:58.157068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:58.157722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:23:58.159247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1185/2328] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:23:58 2022] DELETE /identity/v3/projects/bbba313ec75946248a81318d42e5d2a7 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:23:59.054594 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b651fb-307f-429a-aace-5f901115c012 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:59.055067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b651fb-307f-429a-aace-5f901115c012 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:59.055175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b651fb-307f-429a-aace-5f901115c012 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:59.073325 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-07b651fb-307f-429a-aace-5f901115c012 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:23:59.074519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-07b651fb-307f-429a-aace-5f901115c012 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:59.133055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1144/2329] 10.222.0.74 () {58 vars in 1016 bytes} [Thu May 26 18:23:59 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:23:59.154233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:23:59.155724 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:23:59.231299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e620fe81-e71d-4c53-a275-5e00b9bffdbc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:23:59.237434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67140ff-bd22-4137-aaf8-2629928de870 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:23:59.238084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67140ff-bd22-4137-aaf8-2629928de870 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:23:59.238368 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67140ff-bd22-4137-aaf8-2629928de870 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:23:59.238643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67140ff-bd22-4137-aaf8-2629928de870 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:23:59.246980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67140ff-bd22-4137-aaf8-2629928de870 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:23:59.248626 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67140ff-bd22-4137-aaf8-2629928de870 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:23:59.260521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1186/2330] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:23:59 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:24:03.254832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223fff3-dd06-4fb3-b3b8-d310af52f3c3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:03.255342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223fff3-dd06-4fb3-b3b8-d310af52f3c3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:03.255435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2223fff3-dd06-4fb3-b3b8-d310af52f3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:03.273682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2223fff3-dd06-4fb3-b3b8-d310af52f3c3 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:03.274888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2223fff3-dd06-4fb3-b3b8-d310af52f3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:03.283298 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1145/2331] 10.222.0.74 () {58 vars in 1016 bytes} [Thu May 26 18:24:03 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:24:03.305113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67140ff-bd22-4137-aaf8-2629928de870 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:03.306526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f67140ff-bd22-4137-aaf8-2629928de870 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:03.315991 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:03.322530 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67140ff-bd22-4137-aaf8-2629928de870 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:03.329616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28716a8-8d96-4c02-a299-3450b178c5f8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:03.330381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28716a8-8d96-4c02-a299-3450b178c5f8 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:03.330760 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28716a8-8d96-4c02-a299-3450b178c5f8 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:03.331135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f28716a8-8d96-4c02-a299-3450b178c5f8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:03.339504 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28716a8-8d96-4c02-a299-3450b178c5f8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:03.341206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f28716a8-8d96-4c02-a299-3450b178c5f8 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:03.351282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1187/2332] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:24:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:24:03.535697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223fff3-dd06-4fb3-b3b8-d310af52f3c3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:03.537204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2223fff3-dd06-4fb3-b3b8-d310af52f3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:03.549831 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2223fff3-dd06-4fb3-b3b8-d310af52f3c3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:03.554607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64478c9b-2f99-4700-b56e-a7dcef7ad0f6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:03.555478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64478c9b-2f99-4700-b56e-a7dcef7ad0f6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:03.555760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64478c9b-2f99-4700-b56e-a7dcef7ad0f6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:03.556037 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64478c9b-2f99-4700-b56e-a7dcef7ad0f6 admin admin] PATH_INFO: `/v3/users/3a40757d21a24b3992710ce8c003ace0` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:03.557230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64478c9b-2f99-4700-b56e-a7dcef7ad0f6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=3a40757d21a24b3992710ce8c003ace0)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:03.559149 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64478c9b-2f99-4700-b56e-a7dcef7ad0f6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:03.605748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-64478c9b-2f99-4700-b56e-a7dcef7ad0f6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3a40757d21a24b3992710ce8c003ace0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:03.613432 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-64478c9b-2f99-4700-b56e-a7dcef7ad0f6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3a40757d21a24b3992710ce8c003ace0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:03.614112 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-64478c9b-2f99-4700-b56e-a7dcef7ad0f6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3a40757d21a24b3992710ce8c003ace0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:03.625150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:03.626654 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-64478c9b-2f99-4700-b56e-a7dcef7ad0f6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3a40757d21a24b3992710ce8c003ace0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:03.634841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-64478c9b-2f99-4700-b56e-a7dcef7ad0f6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3a40757d21a24b3992710ce8c003ace0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:03.641043 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1146/2333] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:24:03 2022] DELETE /identity/v3/users/3a40757d21a24b3992710ce8c003ace0 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:24:03.848107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28716a8-8d96-4c02-a299-3450b178c5f8 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:03.859482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f28716a8-8d96-4c02-a299-3450b178c5f8 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:03.916458 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:03.917335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:03.917617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:03.917891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] PATH_INFO: `/v3/projects/2c606169df5f44e9b19ffc19be8d2728` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:03.919040 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] RBAC: Authorizing `identity:delete_project(project_id=2c606169df5f44e9b19ffc19be8d2728)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:03.920921 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:03.964130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2c606169df5f44e9b19ffc19be8d2728', 'request_id': 'req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:03.971207 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2c606169df5f44e9b19ffc19be8d2728', 'request_id': 'req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:03.976938 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2c606169df5f44e9b19ffc19be8d2728', 'request_id': 'req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:03.987688 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] The token cache is being invalidate because project 2c606169df5f44e9b19ffc19be8d2728 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:24:03.987969 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:03.988584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:03.990148 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1188/2334] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:24:03 2022] DELETE /identity/v3/projects/2c606169df5f44e9b19ffc19be8d2728 => generated 0 bytes in 143 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:24:03.994118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64478c9b-2f99-4700-b56e-a7dcef7ad0f6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:03.995517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-64478c9b-2f99-4700-b56e-a7dcef7ad0f6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:04.008465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64478c9b-2f99-4700-b56e-a7dcef7ad0f6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:04.065013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c2cc35d-b5cf-4d32-b0c9-839dd8ae54bb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:04.065906 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cc35d-b5cf-4d32-b0c9-839dd8ae54bb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:04.066190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cc35d-b5cf-4d32-b0c9-839dd8ae54bb admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:04.066464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c2cc35d-b5cf-4d32-b0c9-839dd8ae54bb admin admin] PATH_INFO: `/v3/users/536837bb5fd1468e903d16a2ce2dc9c8` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:04.067646 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cc35d-b5cf-4d32-b0c9-839dd8ae54bb admin admin] RBAC: Authorizing `identity:delete_user(user_id=536837bb5fd1468e903d16a2ce2dc9c8)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:04.069647 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c2cc35d-b5cf-4d32-b0c9-839dd8ae54bb admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:04.114334 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5c2cc35d-b5cf-4d32-b0c9-839dd8ae54bb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '536837bb5fd1468e903d16a2ce2dc9c8'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:04.121005 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5c2cc35d-b5cf-4d32-b0c9-839dd8ae54bb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '536837bb5fd1468e903d16a2ce2dc9c8'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:04.121671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5c2cc35d-b5cf-4d32-b0c9-839dd8ae54bb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '536837bb5fd1468e903d16a2ce2dc9c8'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:04.133289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5c2cc35d-b5cf-4d32-b0c9-839dd8ae54bb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '536837bb5fd1468e903d16a2ce2dc9c8'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:04.140456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5c2cc35d-b5cf-4d32-b0c9-839dd8ae54bb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '536837bb5fd1468e903d16a2ce2dc9c8'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:04.146988 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1147/2335] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:24:03 2022] DELETE /identity/v3/users/536837bb5fd1468e903d16a2ce2dc9c8 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:24:04.314021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:04.315471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:04.332238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf50ce98-2439-40ec-8c69-fdb9caa6eeac admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:04.386913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-283c3b20-2434-4ca9-8e35-297939e05b4c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:04.387774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3b20-2434-4ca9-8e35-297939e05b4c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:04.388056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3b20-2434-4ca9-8e35-297939e05b4c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:04.388330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-283c3b20-2434-4ca9-8e35-297939e05b4c admin admin] PATH_INFO: `/v3/projects/d63e75218bbc412dadc70478d0fcc509` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:04.389541 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c3b20-2434-4ca9-8e35-297939e05b4c admin admin] RBAC: Authorizing `identity:delete_project(project_id=d63e75218bbc412dadc70478d0fcc509)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:04.392082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-283c3b20-2434-4ca9-8e35-297939e05b4c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:04.413978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:04.437530 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-283c3b20-2434-4ca9-8e35-297939e05b4c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd63e75218bbc412dadc70478d0fcc509', 'request_id': 'req-283c3b20-2434-4ca9-8e35-297939e05b4c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:04.444825 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-283c3b20-2434-4ca9-8e35-297939e05b4c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd63e75218bbc412dadc70478d0fcc509', 'request_id': 'req-283c3b20-2434-4ca9-8e35-297939e05b4c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:04.450273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-283c3b20-2434-4ca9-8e35-297939e05b4c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd63e75218bbc412dadc70478d0fcc509', 'request_id': 'req-283c3b20-2434-4ca9-8e35-297939e05b4c'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:04.461064 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-283c3b20-2434-4ca9-8e35-297939e05b4c admin admin] The token cache is being invalidate because project d63e75218bbc412dadc70478d0fcc509 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:24:04.461353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-283c3b20-2434-4ca9-8e35-297939e05b4c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:04.461981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-283c3b20-2434-4ca9-8e35-297939e05b4c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:04.463509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1189/2336] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:24:04 2022] DELETE /identity/v3/projects/d63e75218bbc412dadc70478d0fcc509 => generated 0 bytes in 151 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:24:04.468368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70595d67-810c-4e22-a955-1fd05be017c1 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:04.468850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70595d67-810c-4e22-a955-1fd05be017c1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:04.468942 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70595d67-810c-4e22-a955-1fd05be017c1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:04.487724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-70595d67-810c-4e22-a955-1fd05be017c1 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:04.488936 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-70595d67-810c-4e22-a955-1fd05be017c1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:04.547511 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1148/2337] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:24:04.556097 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a913b-4267-4228-90bc-67f368054c8c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:04.556388 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a913b-4267-4228-90bc-67f368054c8c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:04.556681 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-849a913b-4267-4228-90bc-67f368054c8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:04.575510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-849a913b-4267-4228-90bc-67f368054c8c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:04.576707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-849a913b-4267-4228-90bc-67f368054c8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:04.588897 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1190/2338] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:24:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:24:04.596318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70595d67-810c-4e22-a955-1fd05be017c1 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:04.606446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70595d67-810c-4e22-a955-1fd05be017c1 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:04.611514 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929feb4-07fd-422c-9e9b-ce15598669fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:04.612164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929feb4-07fd-422c-9e9b-ce15598669fe admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:04.612445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929feb4-07fd-422c-9e9b-ce15598669fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:04.612724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7929feb4-07fd-422c-9e9b-ce15598669fe admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:04.613471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929feb4-07fd-422c-9e9b-ce15598669fe admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:24:04.613777 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929feb4-07fd-422c-9e9b-ce15598669fe admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:04.615399 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7929feb4-07fd-422c-9e9b-ce15598669fe admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:04.617795 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=87,keystone:INSERT=2,keystone:DELETE=11 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:04.629587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1149/2339] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:24:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:24:04.633580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a913b-4267-4228-90bc-67f368054c8c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:04.643194 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-849a913b-4267-4228-90bc-67f368054c8c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:04.647800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ce465-47d6-433a-a37c-7d49a99c3a7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:04.648445 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ce465-47d6-433a-a37c-7d49a99c3a7a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:04.648729 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ce465-47d6-433a-a37c-7d49a99c3a7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:04.649036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc7ce465-47d6-433a-a37c-7d49a99c3a7a admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:04.649841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ce465-47d6-433a-a37c-7d49a99c3a7a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:04.651737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc7ce465-47d6-433a-a37c-7d49a99c3a7a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:04.677046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1191/2340] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:24:04 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:24:04.681068 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929feb4-07fd-422c-9e9b-ce15598669fe admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:04.691073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7929feb4-07fd-422c-9e9b-ce15598669fe admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:04.748499 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fabc29-422c-4bcb-8272-a33c7f8d6672 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:04.749181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fabc29-422c-4bcb-8272-a33c7f8d6672 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:04.749475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fabc29-422c-4bcb-8272-a33c7f8d6672 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:04.749758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8fabc29-422c-4bcb-8272-a33c7f8d6672 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:04.750450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fabc29-422c-4bcb-8272-a33c7f8d6672 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:04.752440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8fabc29-422c-4bcb-8272-a33c7f8d6672 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:04.771222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1150/2341] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:24:04 2022] POST /identity/v3/users => generated 288 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:24:04.775275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ce465-47d6-433a-a37c-7d49a99c3a7a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:04.786215 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc7ce465-47d6-433a-a37c-7d49a99c3a7a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:04.792298 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91d7af-ba70-47a8-85d4-648a2cb68584 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:04.792964 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91d7af-ba70-47a8-85d4-648a2cb68584 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:04.793266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91d7af-ba70-47a8-85d4-648a2cb68584 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:04.793540 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b91d7af-ba70-47a8-85d4-648a2cb68584 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:04.794259 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91d7af-ba70-47a8-85d4-648a2cb68584 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:04.795843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b91d7af-ba70-47a8-85d4-648a2cb68584 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:04.807107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1192/2342] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:24:04.810966 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fabc29-422c-4bcb-8272-a33c7f8d6672 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:04.821356 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8fabc29-422c-4bcb-8272-a33c7f8d6672 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:04.826080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c350799d-f7f1-4528-b274-13d7c6c28315 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:04.826823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350799d-f7f1-4528-b274-13d7c6c28315 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:04.827109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350799d-f7f1-4528-b274-13d7c6c28315 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:04.827388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c350799d-f7f1-4528-b274-13d7c6c28315 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:04.828144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350799d-f7f1-4528-b274-13d7c6c28315 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:04.830267 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c350799d-f7f1-4528-b274-13d7c6c28315 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:04.840364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1151/2343] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:24:04 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:24:04.844406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91d7af-ba70-47a8-85d4-648a2cb68584 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:04.855381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b91d7af-ba70-47a8-85d4-648a2cb68584 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:04.860064 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997fac4-c29d-4d1d-aba6-e83cfa4f1c3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:04.860945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997fac4-c29d-4d1d-aba6-e83cfa4f1c3d admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:04.861255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997fac4-c29d-4d1d-aba6-e83cfa4f1c3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:04.861535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d997fac4-c29d-4d1d-aba6-e83cfa4f1c3d admin admin] PATH_INFO: `/v3/projects/eeed7ad9ceb0476f8e893ed8fb666280/users/b356f9143a554a82a17a9334b1852ba0/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:04.876407 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997fac4-c29d-4d1d-aba6-e83cfa4f1c3d admin admin] RBAC: Authorizing `identity:create_grant(project_id=eeed7ad9ceb0476f8e893ed8fb666280, user_id=b356f9143a554a82a17a9334b1852ba0, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:04.880491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d997fac4-c29d-4d1d-aba6-e83cfa4f1c3d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:04.895722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1193/2344] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:24:04 2022] PUT /identity/v3/projects/eeed7ad9ceb0476f8e893ed8fb666280/users/b356f9143a554a82a17a9334b1852ba0/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:24:04.907930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60398498-606d-4743-ab52-c3237bb5653b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:04.908337 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60398498-606d-4743-ab52-c3237bb5653b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:04.908619 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60398498-606d-4743-ab52-c3237bb5653b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:04.935110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-60398498-606d-4743-ab52-c3237bb5653b None None] MFA Rules not processed for user `b356f9143a554a82a17a9334b1852ba0`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:04.936304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-60398498-606d-4743-ab52-c3237bb5653b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:05.001612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1152/2345] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:24:04 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:24:05.012437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997fac4-c29d-4d1d-aba6-e83cfa4f1c3d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:05.015357 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d997fac4-c29d-4d1d-aba6-e83cfa4f1c3d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:05.110766 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d997fac4-c29d-4d1d-aba6-e83cfa4f1c3d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:05.115180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0efcdef-3678-4379-891e-dad64c68eee0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:05.115838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efcdef-3678-4379-891e-dad64c68eee0 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:05.116127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efcdef-3678-4379-891e-dad64c68eee0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:05.116413 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0efcdef-3678-4379-891e-dad64c68eee0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:05.126662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efcdef-3678-4379-891e-dad64c68eee0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:05.128105 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0efcdef-3678-4379-891e-dad64c68eee0 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:05.137576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1194/2346] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:24:05 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 126 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:24:08.338482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60398498-606d-4743-ab52-c3237bb5653b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:08.405251 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60398498-606d-4743-ab52-c3237bb5653b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:08.409689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6555e-41b9-44e0-924c-847dc86dc06f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:08.410584 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6555e-41b9-44e0-924c-847dc86dc06f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:08.410895 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6555e-41b9-44e0-924c-847dc86dc06f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:08.411463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf6555e-41b9-44e0-924c-847dc86dc06f admin admin] PATH_INFO: `/v3/users/b356f9143a554a82a17a9334b1852ba0` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:08.413018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6555e-41b9-44e0-924c-847dc86dc06f admin admin] RBAC: Authorizing `identity:delete_user(user_id=b356f9143a554a82a17a9334b1852ba0)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:08.415261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cf6555e-41b9-44e0-924c-847dc86dc06f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:08.420475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:08.464246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6e82-5dc7-40dc-a7cc-80c894e21a15 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:08.464775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6e82-5dc7-40dc-a7cc-80c894e21a15 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:08.464895 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a75e6e82-5dc7-40dc-a7cc-80c894e21a15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:08.469686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5cf6555e-41b9-44e0-924c-847dc86dc06f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b356f9143a554a82a17a9334b1852ba0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:08.476543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5cf6555e-41b9-44e0-924c-847dc86dc06f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b356f9143a554a82a17a9334b1852ba0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:08.477471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5cf6555e-41b9-44e0-924c-847dc86dc06f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b356f9143a554a82a17a9334b1852ba0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:08.483575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a75e6e82-5dc7-40dc-a7cc-80c894e21a15 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:08.484767 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a75e6e82-5dc7-40dc-a7cc-80c894e21a15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:08.490033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5cf6555e-41b9-44e0-924c-847dc86dc06f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b356f9143a554a82a17a9334b1852ba0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:08.492948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1195/2347] 10.222.0.74 () {58 vars in 1016 bytes} [Thu May 26 18:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:24:08.497446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-5cf6555e-41b9-44e0-924c-847dc86dc06f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b356f9143a554a82a17a9334b1852ba0'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:08.504027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1153/2348] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:24:08 2022] DELETE /identity/v3/users/b356f9143a554a82a17a9334b1852ba0 => generated 0 bytes in 166 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:24:08.508531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ab16b-c99e-4f2d-8c21-d766fff02e53 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:08.508822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ab16b-c99e-4f2d-8c21-d766fff02e53 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:08.509138 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-785ab16b-c99e-4f2d-8c21-d766fff02e53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:08.521411 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6555e-41b9-44e0-924c-847dc86dc06f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:08.522859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-5cf6555e-41b9-44e0-924c-847dc86dc06f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:08.526745 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-785ab16b-c99e-4f2d-8c21-d766fff02e53 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:08.528004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-785ab16b-c99e-4f2d-8c21-d766fff02e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:08.544864 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=7,keystone:SELECT=90,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:08.588559 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1196/2349] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:24:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:24:08.598361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf6555e-41b9-44e0-924c-847dc86dc06f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:08.598540 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ab16b-c99e-4f2d-8c21-d766fff02e53 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:08.599690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-785ab16b-c99e-4f2d-8c21-d766fff02e53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:08.604444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7ca78-fe1d-44f1-9d64-f3cb83a02e59 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:08.605260 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7ca78-fe1d-44f1-9d64-f3cb83a02e59 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:08.605548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7ca78-fe1d-44f1-9d64-f3cb83a02e59 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:08.605884 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b7ca78-fe1d-44f1-9d64-f3cb83a02e59 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:08.607688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c0b7ca78-fe1d-44f1-9d64-f3cb83a02e59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:08.619295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7ca78-fe1d-44f1-9d64-f3cb83a02e59 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:08.620892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b7ca78-fe1d-44f1-9d64-f3cb83a02e59 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:08.631103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1154/2350] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 111 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:24:08.657211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-785ab16b-c99e-4f2d-8c21-d766fff02e53 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:08.661857 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed85bdc-f6ad-4ca9-9ca1-b3a3787dca6d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:08.662514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed85bdc-f6ad-4ca9-9ca1-b3a3787dca6d service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:08.662800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed85bdc-f6ad-4ca9-9ca1-b3a3787dca6d service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:08.663080 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed85bdc-f6ad-4ca9-9ca1-b3a3787dca6d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:08.672211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed85bdc-f6ad-4ca9-9ca1-b3a3787dca6d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:08.674162 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eed85bdc-f6ad-4ca9-9ca1-b3a3787dca6d service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:08.683548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1197/2351] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:24:08 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:24:08.950015 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7ca78-fe1d-44f1-9d64-f3cb83a02e59 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:08.951466 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c0b7ca78-fe1d-44f1-9d64-f3cb83a02e59 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:08.964749 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b7ca78-fe1d-44f1-9d64-f3cb83a02e59 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:08.969937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aa663a-e775-4b06-9480-f26d47aca7b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:08.971339 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa663a-e775-4b06-9480-f26d47aca7b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:08.971799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa663a-e775-4b06-9480-f26d47aca7b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:08.972085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aa663a-e775-4b06-9480-f26d47aca7b5 admin admin] PATH_INFO: `/v3/projects/eeed7ad9ceb0476f8e893ed8fb666280` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:08.973301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa663a-e775-4b06-9480-f26d47aca7b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=eeed7ad9ceb0476f8e893ed8fb666280)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:08.975332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aa663a-e775-4b06-9480-f26d47aca7b5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:09.022314 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-22aa663a-e775-4b06-9480-f26d47aca7b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'eeed7ad9ceb0476f8e893ed8fb666280', 'request_id': 'req-22aa663a-e775-4b06-9480-f26d47aca7b5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:09.029198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-22aa663a-e775-4b06-9480-f26d47aca7b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'eeed7ad9ceb0476f8e893ed8fb666280', 'request_id': 'req-22aa663a-e775-4b06-9480-f26d47aca7b5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:09.034361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:09.035604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-22aa663a-e775-4b06-9480-f26d47aca7b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'eeed7ad9ceb0476f8e893ed8fb666280', 'request_id': 'req-22aa663a-e775-4b06-9480-f26d47aca7b5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:09.048858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-22aa663a-e775-4b06-9480-f26d47aca7b5 admin admin] The token cache is being invalidate because project eeed7ad9ceb0476f8e893ed8fb666280 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:24:09.049197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-22aa663a-e775-4b06-9480-f26d47aca7b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:09.049830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-22aa663a-e775-4b06-9480-f26d47aca7b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:24:09.056513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1155/2352] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:24:08 2022] DELETE /identity/v3/projects/eeed7ad9ceb0476f8e893ed8fb666280 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:24:09.061397 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3effe1-c3e7-400e-aed8-841658a109f6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:09.061717 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3effe1-c3e7-400e-aed8-841658a109f6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:09.061998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a3effe1-c3e7-400e-aed8-841658a109f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:09.079652 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-1a3effe1-c3e7-400e-aed8-841658a109f6 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:09.080842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1a3effe1-c3e7-400e-aed8-841658a109f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:09.140512 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1198/2353] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:24:09.148756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f6e16-bd2c-4831-ac14-8b466578b7cf None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:09.149511 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f6e16-bd2c-4831-ac14-8b466578b7cf None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:09.149511 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b97f6e16-bd2c-4831-ac14-8b466578b7cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:09.168085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b97f6e16-bd2c-4831-ac14-8b466578b7cf None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:09.169364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b97f6e16-bd2c-4831-ac14-8b466578b7cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:09.177529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1156/2354] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:24:09.181323 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3effe1-c3e7-400e-aed8-841658a109f6 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:09.191114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a3effe1-c3e7-400e-aed8-841658a109f6 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:09.195678 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaed2fe-a279-4b7c-b725-deedb448d8b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:09.196277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed2fe-a279-4b7c-b725-deedb448d8b6 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:09.196563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed2fe-a279-4b7c-b725-deedb448d8b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:09.196843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaaed2fe-a279-4b7c-b725-deedb448d8b6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:09.197604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaed2fe-a279-4b7c-b725-deedb448d8b6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:24:09.197917 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaed2fe-a279-4b7c-b725-deedb448d8b6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:09.199511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaaed2fe-a279-4b7c-b725-deedb448d8b6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:09.211508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1199/2355] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:24:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:24:09.215670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f6e16-bd2c-4831-ac14-8b466578b7cf None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:09.225402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b97f6e16-bd2c-4831-ac14-8b466578b7cf None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:09.230437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881292f-df13-42d9-ba6e-1022726f862b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:09.231089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881292f-df13-42d9-ba6e-1022726f862b admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:09.231371 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881292f-df13-42d9-ba6e-1022726f862b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:09.231647 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5881292f-df13-42d9-ba6e-1022726f862b admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:09.232340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881292f-df13-42d9-ba6e-1022726f862b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:09.234299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5881292f-df13-42d9-ba6e-1022726f862b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:09.266896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1157/2356] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:24:09 2022] POST /identity/v3/projects => generated 371 bytes in 48 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:24:09.268273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaed2fe-a279-4b7c-b725-deedb448d8b6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:09.278199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaaed2fe-a279-4b7c-b725-deedb448d8b6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:09.324549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:09.334071 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3b11e-7f64-41f9-955a-ae1f46ad0e66 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:09.334733 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3b11e-7f64-41f9-955a-ae1f46ad0e66 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:09.335017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3b11e-7f64-41f9-955a-ae1f46ad0e66 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:09.335297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dee3b11e-7f64-41f9-955a-ae1f46ad0e66 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:09.335992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3b11e-7f64-41f9-955a-ae1f46ad0e66 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:09.337947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dee3b11e-7f64-41f9-955a-ae1f46ad0e66 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:09.357344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1200/2357] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:24:09 2022] POST /identity/v3/users => generated 286 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:24:09.361477 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881292f-df13-42d9-ba6e-1022726f862b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:09.371526 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5881292f-df13-42d9-ba6e-1022726f862b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:09.376099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492f310-f88d-4642-b43a-0aa336b57f42 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:09.376754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492f310-f88d-4642-b43a-0aa336b57f42 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:09.377077 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492f310-f88d-4642-b43a-0aa336b57f42 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:09.377360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b492f310-f88d-4642-b43a-0aa336b57f42 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:09.378080 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492f310-f88d-4642-b43a-0aa336b57f42 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:09.379685 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b492f310-f88d-4642-b43a-0aa336b57f42 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:09.389819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1158/2358] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:24:09.394001 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3b11e-7f64-41f9-955a-ae1f46ad0e66 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:09.403682 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dee3b11e-7f64-41f9-955a-ae1f46ad0e66 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:09.408800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-39ebaffa-988e-4434-8c9a-39ffd0efc014 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:09.409478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebaffa-988e-4434-8c9a-39ffd0efc014 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:09.409761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebaffa-988e-4434-8c9a-39ffd0efc014 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:09.410031 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39ebaffa-988e-4434-8c9a-39ffd0efc014 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:09.410751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebaffa-988e-4434-8c9a-39ffd0efc014 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:09.412311 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-39ebaffa-988e-4434-8c9a-39ffd0efc014 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:09.421914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1201/2359] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:24:09 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:24:09.426418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492f310-f88d-4642-b43a-0aa336b57f42 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:09.436090 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b492f310-f88d-4642-b43a-0aa336b57f42 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:09.441250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0313d4-75e9-4be3-aac2-030fdf629067 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:09.442114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0313d4-75e9-4be3-aac2-030fdf629067 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:09.442398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0313d4-75e9-4be3-aac2-030fdf629067 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:09.442675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b0313d4-75e9-4be3-aac2-030fdf629067 admin admin] PATH_INFO: `/v3/projects/8212241a69fa47699fbac35a9fe8389d/users/4b590aa6ec524687895924abf24524b5/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:09.456973 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0313d4-75e9-4be3-aac2-030fdf629067 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8212241a69fa47699fbac35a9fe8389d, user_id=4b590aa6ec524687895924abf24524b5, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:09.459663 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b0313d4-75e9-4be3-aac2-030fdf629067 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:09.472605 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1159/2360] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:24:09 2022] PUT /identity/v3/projects/8212241a69fa47699fbac35a9fe8389d/users/4b590aa6ec524687895924abf24524b5/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:24:09.478293 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5c82d-deb6-418c-bc4a-16125975919c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:09.478778 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5c82d-deb6-418c-bc4a-16125975919c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:09.478943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3e5c82d-deb6-418c-bc4a-16125975919c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:09.498127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e3e5c82d-deb6-418c-bc4a-16125975919c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:09.499324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e3e5c82d-deb6-418c-bc4a-16125975919c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:09.557415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1202/2361] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:24:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:24:09.566967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0313d4-75e9-4be3-aac2-030fdf629067 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:09.568620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1b0313d4-75e9-4be3-aac2-030fdf629067 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:09.624624 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b0313d4-75e9-4be3-aac2-030fdf629067 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:09.628225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d15429-b001-4943-b28b-1061d7ba2b4f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:09.628865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d15429-b001-4943-b28b-1061d7ba2b4f service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:09.629182 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d15429-b001-4943-b28b-1061d7ba2b4f service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:09.629459 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2d15429-b001-4943-b28b-1061d7ba2b4f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:09.638905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d15429-b001-4943-b28b-1061d7ba2b4f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:09.640528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2d15429-b001-4943-b28b-1061d7ba2b4f service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:09.651000 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1160/2362] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:24:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:24:10.219124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cf4c2-50f0-4878-aadb-c10b63aadb02 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:10.219989 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cf4c2-50f0-4878-aadb-c10b63aadb02 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:10.220309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77cf4c2-50f0-4878-aadb-c10b63aadb02 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:10.246430 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a77cf4c2-50f0-4878-aadb-c10b63aadb02 None None] MFA Rules not processed for user `4b590aa6ec524687895924abf24524b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:10.247642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a77cf4c2-50f0-4878-aadb-c10b63aadb02 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:10.315860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1203/2363] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:24:10 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:24:10.326732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d15429-b001-4943-b28b-1061d7ba2b4f service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:10.328101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e2d15429-b001-4943-b28b-1061d7ba2b4f service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:10.385521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2d15429-b001-4943-b28b-1061d7ba2b4f service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:10.389289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c82ddcb0-51e1-4433-a28f-1894cda2f957 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:10.389941 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ddcb0-51e1-4433-a28f-1894cda2f957 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:10.390229 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ddcb0-51e1-4433-a28f-1894cda2f957 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:10.390510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c82ddcb0-51e1-4433-a28f-1894cda2f957 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:10.399680 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ddcb0-51e1-4433-a28f-1894cda2f957 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:10.401159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c82ddcb0-51e1-4433-a28f-1894cda2f957 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:10.409878 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1161/2364] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:24:10 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 84 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:24:11.747865 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2bfe2-e519-4cb0-87c3-fcd924c5fef6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:11.748379 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2bfe2-e519-4cb0-87c3-fcd924c5fef6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:11.748481 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ebc2bfe2-e519-4cb0-87c3-fcd924c5fef6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:11.766327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ebc2bfe2-e519-4cb0-87c3-fcd924c5fef6 None None] MFA Rules not processed for user `4b590aa6ec524687895924abf24524b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:11.767457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ebc2bfe2-e519-4cb0-87c3-fcd924c5fef6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:11.774588 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1204/2365] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:24:11 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:24:20.405897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=83,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:21.760978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=72,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:28.054296 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc740fca-c030-4893-b5c6-0dfd6f7445b5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:28.054819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc740fca-c030-4893-b5c6-0dfd6f7445b5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:28.054996 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc740fca-c030-4893-b5c6-0dfd6f7445b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:28.072177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-bc740fca-c030-4893-b5c6-0dfd6f7445b5 None None] MFA Rules not processed for user `4f1948e8724647bd893015835a50d8db`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:28.073424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bc740fca-c030-4893-b5c6-0dfd6f7445b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:28.126738 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1162/2366] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:24:28 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 74 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:24:29.061655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e0bb-f558-4426-8cee-892a699039b2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:29.062166 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e0bb-f558-4426-8cee-892a699039b2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:29.062278 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81a9e0bb-f558-4426-8cee-892a699039b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:29.079299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-81a9e0bb-f558-4426-8cee-892a699039b2 None None] MFA Rules not processed for user `3cab4b811e944bc6af6d73927de3bd27`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:29.080517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-81a9e0bb-f558-4426-8cee-892a699039b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:29.135209 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1205/2367] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:24:29 2022] POST /identity/v3/auth/tokens => generated 3248 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:24:35.727101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f0f9b-bc05-4195-9837-74ca67eecf4c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:35.728022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f0f9b-bc05-4195-9837-74ca67eecf4c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:35.728307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a85f0f9b-bc05-4195-9837-74ca67eecf4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:35.755651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a85f0f9b-bc05-4195-9837-74ca67eecf4c None None] MFA Rules not processed for user `4b590aa6ec524687895924abf24524b5`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:35.757142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a85f0f9b-bc05-4195-9837-74ca67eecf4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:35.765447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1163/2368] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:24:35 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:24:39.128139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=25 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:39.421611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9e0bb-f558-4426-8cee-892a699039b2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:39.423793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-81a9e0bb-f558-4426-8cee-892a699039b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:39.558362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81a9e0bb-f558-4426-8cee-892a699039b2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:39.564534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77172ba2-1bf0-4d49-93a2-497be75a157c service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab4efe6f79d4b3ca5618c089c5f3d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:39.565802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77172ba2-1bf0-4d49-93a2-497be75a157c service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:39.566094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77172ba2-1bf0-4d49-93a2-497be75a157c service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:39.566761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77172ba2-1bf0-4d49-93a2-497be75a157c service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:39.568426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-77172ba2-1bf0-4d49-93a2-497be75a157c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:39.581665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77172ba2-1bf0-4d49-93a2-497be75a157c service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:39.583461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77172ba2-1bf0-4d49-93a2-497be75a157c service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:39.598132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1206/2369] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:24:39 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:24:45.748517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=28 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:49.590646 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=41 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:24:54.281391 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98bdb4-63b5-4429-8790-785201d76e12 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:54.281946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98bdb4-63b5-4429-8790-785201d76e12 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:54.281946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d98bdb4-63b5-4429-8790-785201d76e12 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:54.300507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4d98bdb4-63b5-4429-8790-785201d76e12 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:24:54.301744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4d98bdb4-63b5-4429-8790-785201d76e12 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:54.309591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1164/2370] 10.222.0.74 () {58 vars in 1016 bytes} [Thu May 26 18:24:54 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:24:54.337521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77172ba2-1bf0-4d49-93a2-497be75a157c service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:24:54.338980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-77172ba2-1bf0-4d49-93a2-497be75a157c service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:24:54.413254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77172ba2-1bf0-4d49-93a2-497be75a157c service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:24:54.418732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc1134-dc7b-492e-b84e-300d773f1cd9 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:24:54.419385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc1134-dc7b-492e-b84e-300d773f1cd9 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:24:54.419701 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc1134-dc7b-492e-b84e-300d773f1cd9 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:24:54.419982 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bdc1134-dc7b-492e-b84e-300d773f1cd9 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:24:54.428966 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc1134-dc7b-492e-b84e-300d773f1cd9 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:24:54.430562 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bdc1134-dc7b-492e-b84e-300d773f1cd9 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:24:54.441039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1207/2371] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:24:54 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:25:00.632927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754d6f6-592b-4ea4-b93a-29bef38251d3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:00.633444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754d6f6-592b-4ea4-b93a-29bef38251d3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:00.633573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b754d6f6-592b-4ea4-b93a-29bef38251d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:00.652798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-b754d6f6-592b-4ea4-b93a-29bef38251d3 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:25:00.654069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-b754d6f6-592b-4ea4-b93a-29bef38251d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:00.661706 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1165/2372] 10.222.0.74 () {58 vars in 1016 bytes} [Thu May 26 18:25:00 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:25:00.698519 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc1134-dc7b-492e-b84e-300d773f1cd9 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:00.699977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8bdc1134-dc7b-492e-b84e-300d773f1cd9 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:00.714988 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bdc1134-dc7b-492e-b84e-300d773f1cd9 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:00.720671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd036f3b-054a-41c8-940f-fea3ca615451 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:00.721438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd036f3b-054a-41c8-940f-fea3ca615451 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:00.721748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd036f3b-054a-41c8-940f-fea3ca615451 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:00.722020 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd036f3b-054a-41c8-940f-fea3ca615451 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:00.730458 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd036f3b-054a-41c8-940f-fea3ca615451 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:00.732015 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd036f3b-054a-41c8-940f-fea3ca615451 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:00.741337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1208/2373] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:25:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:25:04.724245 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6524b-8e2a-4eda-a01b-80607a6ab48d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:04.724727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6524b-8e2a-4eda-a01b-80607a6ab48d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:04.724841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54c6524b-8e2a-4eda-a01b-80607a6ab48d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:04.742509 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-54c6524b-8e2a-4eda-a01b-80607a6ab48d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:25:04.743689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-54c6524b-8e2a-4eda-a01b-80607a6ab48d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:04.751370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1166/2374] 10.222.0.74 () {58 vars in 1016 bytes} [Thu May 26 18:25:04 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:25:04.817277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd036f3b-054a-41c8-940f-fea3ca615451 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:04.828501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd036f3b-054a-41c8-940f-fea3ca615451 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:04.835068 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cfba9-a9d6-480b-93b8-35876ae33210 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:04.835719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cfba9-a9d6-480b-93b8-35876ae33210 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:04.836005 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cfba9-a9d6-480b-93b8-35876ae33210 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:04.836286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c35cfba9-a9d6-480b-93b8-35876ae33210 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:04.844941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cfba9-a9d6-480b-93b8-35876ae33210 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:04.846759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c35cfba9-a9d6-480b-93b8-35876ae33210 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:04.856894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1209/2375] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:25:04 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:25:06.741532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c4a96-7368-46d5-b06d-2bd3bd5497b3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:06.741997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c4a96-7368-46d5-b06d-2bd3bd5497b3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:06.742098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f2c4a96-7368-46d5-b06d-2bd3bd5497b3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:06.801847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8f2c4a96-7368-46d5-b06d-2bd3bd5497b3 None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:25:06.803074 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8f2c4a96-7368-46d5-b06d-2bd3bd5497b3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:06.866139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1167/2376] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:25:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:25:06.913183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cfba9-a9d6-480b-93b8-35876ae33210 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:06.914591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c35cfba9-a9d6-480b-93b8-35876ae33210 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:07.005582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c35cfba9-a9d6-480b-93b8-35876ae33210 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:07.010643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19952f2-129f-4a0d-a21a-b1f4623f57d8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:07.011284 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19952f2-129f-4a0d-a21a-b1f4623f57d8 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:07.011568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19952f2-129f-4a0d-a21a-b1f4623f57d8 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:07.011864 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f19952f2-129f-4a0d-a21a-b1f4623f57d8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:07.020756 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19952f2-129f-4a0d-a21a-b1f4623f57d8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:07.022599 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f19952f2-129f-4a0d-a21a-b1f4623f57d8 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:07.030604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1210/2377] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:25:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 118 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:25:08.952391 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f3d08-a166-4f0f-bddd-176fa9f42056 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:08.953048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f3d08-a166-4f0f-bddd-176fa9f42056 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:08.953048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148f3d08-a166-4f0f-bddd-176fa9f42056 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:08.974811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-148f3d08-a166-4f0f-bddd-176fa9f42056 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:25:08.977027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-148f3d08-a166-4f0f-bddd-176fa9f42056 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:08.985616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1168/2378] 10.222.0.74 () {58 vars in 1016 bytes} [Thu May 26 18:25:08 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:25:09.012180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19952f2-129f-4a0d-a21a-b1f4623f57d8 service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:09.028735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f19952f2-129f-4a0d-a21a-b1f4623f57d8 service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:09.035045 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12011d-9a98-457f-9499-8a62295aabcf service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:09.035846 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12011d-9a98-457f-9499-8a62295aabcf service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:09.036264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12011d-9a98-457f-9499-8a62295aabcf service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:09.036581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee12011d-9a98-457f-9499-8a62295aabcf service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:09.045530 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12011d-9a98-457f-9499-8a62295aabcf service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:09.047185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee12011d-9a98-457f-9499-8a62295aabcf service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:09.059060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1211/2379] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:25:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:25:13.162288 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563edf9b-5c72-4109-b45f-6a55b5efabaf None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:13.162990 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563edf9b-5c72-4109-b45f-6a55b5efabaf None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:13.163555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-563edf9b-5c72-4109-b45f-6a55b5efabaf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:13.195216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-563edf9b-5c72-4109-b45f-6a55b5efabaf None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:25:13.197493 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-563edf9b-5c72-4109-b45f-6a55b5efabaf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:13.207967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1169/2380] 10.222.0.74 () {58 vars in 1016 bytes} [Thu May 26 18:25:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 48 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:25:13.237026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12011d-9a98-457f-9499-8a62295aabcf service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:13.249387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee12011d-9a98-457f-9499-8a62295aabcf service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:13.257716 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c468d3d-6602-422f-89c4-27e1c748d236 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:13.258396 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c468d3d-6602-422f-89c4-27e1c748d236 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:13.258682 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c468d3d-6602-422f-89c4-27e1c748d236 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:13.258963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c468d3d-6602-422f-89c4-27e1c748d236 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:13.268387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c468d3d-6602-422f-89c4-27e1c748d236 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:13.270029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c468d3d-6602-422f-89c4-27e1c748d236 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:13.281764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1212/2381] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:25:13 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:25:22.257089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23793ec2-140d-4c4d-99b1-77caaa232a8f None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:22.257576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23793ec2-140d-4c4d-99b1-77caaa232a8f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:22.257666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23793ec2-140d-4c4d-99b1-77caaa232a8f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:22.263579 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=60 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:22.276745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-23793ec2-140d-4c4d-99b1-77caaa232a8f None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:25:22.277971 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-23793ec2-140d-4c4d-99b1-77caaa232a8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:22.284927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1170/2382] 10.222.0.64 () {58 vars in 967 bytes} [Thu May 26 18:25:22 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:25:22.296924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c468d3d-6602-422f-89c4-27e1c748d236 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:22.302992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:22.310216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c468d3d-6602-422f-89c4-27e1c748d236 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:22.315057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115790e6-a7a4-48d4-8677-fe23c83d4892 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:22.316201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115790e6-a7a4-48d4-8677-fe23c83d4892 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:22.316475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115790e6-a7a4-48d4-8677-fe23c83d4892 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:22.316748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-115790e6-a7a4-48d4-8677-fe23c83d4892 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:22.324841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115790e6-a7a4-48d4-8677-fe23c83d4892 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:22.326440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-115790e6-a7a4-48d4-8677-fe23c83d4892 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:22.335087 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1213/2383] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:25:22 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:25:24.386546 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23793ec2-140d-4c4d-99b1-77caaa232a8f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:24.398517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23793ec2-140d-4c4d-99b1-77caaa232a8f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:24.403088 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58811a36-996d-4469-bdf7-42b973f4d1f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:24.403977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58811a36-996d-4469-bdf7-42b973f4d1f9 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:24.404262 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58811a36-996d-4469-bdf7-42b973f4d1f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:24.404536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58811a36-996d-4469-bdf7-42b973f4d1f9 admin admin] PATH_INFO: `/v3/users/4b590aa6ec524687895924abf24524b5` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:24.405967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58811a36-996d-4469-bdf7-42b973f4d1f9 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4b590aa6ec524687895924abf24524b5)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:24.408128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58811a36-996d-4469-bdf7-42b973f4d1f9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:24.455114 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-58811a36-996d-4469-bdf7-42b973f4d1f9 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4b590aa6ec524687895924abf24524b5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:24.462762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-58811a36-996d-4469-bdf7-42b973f4d1f9 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4b590aa6ec524687895924abf24524b5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:24.463461 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-58811a36-996d-4469-bdf7-42b973f4d1f9 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4b590aa6ec524687895924abf24524b5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:24.475861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-58811a36-996d-4469-bdf7-42b973f4d1f9 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4b590aa6ec524687895924abf24524b5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:24.483467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-58811a36-996d-4469-bdf7-42b973f4d1f9 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4b590aa6ec524687895924abf24524b5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:24.489537 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1171/2384] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:25:24 2022] DELETE /identity/v3/users/4b590aa6ec524687895924abf24524b5 => generated 0 bytes in 104 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:25:24.678067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115790e6-a7a4-48d4-8677-fe23c83d4892 service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:24.703120 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-115790e6-a7a4-48d4-8677-fe23c83d4892 service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:24.774050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf87604-f472-43ab-b491-9392f1c3220d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:24.774963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf87604-f472-43ab-b491-9392f1c3220d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:24.775253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf87604-f472-43ab-b491-9392f1c3220d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:24.775533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf87604-f472-43ab-b491-9392f1c3220d admin admin] PATH_INFO: `/v3/projects/8212241a69fa47699fbac35a9fe8389d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:24.776748 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf87604-f472-43ab-b491-9392f1c3220d admin admin] RBAC: Authorizing `identity:delete_project(project_id=8212241a69fa47699fbac35a9fe8389d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:24.778698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf87604-f472-43ab-b491-9392f1c3220d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:24.827877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9bf87604-f472-43ab-b491-9392f1c3220d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8212241a69fa47699fbac35a9fe8389d', 'request_id': 'req-9bf87604-f472-43ab-b491-9392f1c3220d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:24.835310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9bf87604-f472-43ab-b491-9392f1c3220d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8212241a69fa47699fbac35a9fe8389d', 'request_id': 'req-9bf87604-f472-43ab-b491-9392f1c3220d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:24.840672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9bf87604-f472-43ab-b491-9392f1c3220d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8212241a69fa47699fbac35a9fe8389d', 'request_id': 'req-9bf87604-f472-43ab-b491-9392f1c3220d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:24.851856 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9bf87604-f472-43ab-b491-9392f1c3220d admin admin] The token cache is being invalidate because project 8212241a69fa47699fbac35a9fe8389d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:25:24.852142 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9bf87604-f472-43ab-b491-9392f1c3220d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:24.852768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9bf87604-f472-43ab-b491-9392f1c3220d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:24.854332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1214/2385] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:25:24 2022] DELETE /identity/v3/projects/8212241a69fa47699fbac35a9fe8389d => generated 0 bytes in 177 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:25:24.859139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab056a-43d7-4f2f-af18-8277c1751eae None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:24.859435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab056a-43d7-4f2f-af18-8277c1751eae None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:24.859718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daab056a-43d7-4f2f-af18-8277c1751eae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:24.877797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-daab056a-43d7-4f2f-af18-8277c1751eae None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:25:24.879544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-daab056a-43d7-4f2f-af18-8277c1751eae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:24.935902 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1172/2386] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:25:24.944513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05846e-e1e7-4ba8-9916-846b66d51c50 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:24.944801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05846e-e1e7-4ba8-9916-846b66d51c50 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:24.945117 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee05846e-e1e7-4ba8-9916-846b66d51c50 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:24.962693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ee05846e-e1e7-4ba8-9916-846b66d51c50 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:25:24.963871 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ee05846e-e1e7-4ba8-9916-846b66d51c50 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:24.971731 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1215/2387] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:25:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:25:24.975824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab056a-43d7-4f2f-af18-8277c1751eae None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:24.985363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daab056a-43d7-4f2f-af18-8277c1751eae None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:24.990464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51aea-35a8-4f44-9257-bf19dfa725ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:24.991108 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51aea-35a8-4f44-9257-bf19dfa725ee admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:24.991393 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51aea-35a8-4f44-9257-bf19dfa725ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:24.991671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77f51aea-35a8-4f44-9257-bf19dfa725ee admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:24.992391 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f51aea-35a8-4f44-9257-bf19dfa725ee admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:25:24.992703 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f51aea-35a8-4f44-9257-bf19dfa725ee admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:24.994356 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77f51aea-35a8-4f44-9257-bf19dfa725ee admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:25.006326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1173/2388] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:25:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:25:25.010272 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05846e-e1e7-4ba8-9916-846b66d51c50 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:25.019303 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee05846e-e1e7-4ba8-9916-846b66d51c50 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:25.025505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56253d3b-a97d-4e0f-a14b-44cc19a614f2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:25.026243 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56253d3b-a97d-4e0f-a14b-44cc19a614f2 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:25.026641 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56253d3b-a97d-4e0f-a14b-44cc19a614f2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:25.026994 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56253d3b-a97d-4e0f-a14b-44cc19a614f2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:25.027772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56253d3b-a97d-4e0f-a14b-44cc19a614f2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:25.029723 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56253d3b-a97d-4e0f-a14b-44cc19a614f2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:25.054863 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1216/2389] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:25:25 2022] POST /identity/v3/projects => generated 385 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:25:25.058776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51aea-35a8-4f44-9257-bf19dfa725ee admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:25.068944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77f51aea-35a8-4f44-9257-bf19dfa725ee admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:25.121331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:25.127246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685c223-a3d8-4144-bce4-943cbd015d94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:25.128480 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685c223-a3d8-4144-bce4-943cbd015d94 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:25.129766 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685c223-a3d8-4144-bce4-943cbd015d94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:25.130516 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0685c223-a3d8-4144-bce4-943cbd015d94 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:25.131246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685c223-a3d8-4144-bce4-943cbd015d94 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:25.133560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0685c223-a3d8-4144-bce4-943cbd015d94 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:25.154701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1174/2390] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:25:25 2022] POST /identity/v3/users => generated 293 bytes in 96 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:25:25.158698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56253d3b-a97d-4e0f-a14b-44cc19a614f2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:25.169350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56253d3b-a97d-4e0f-a14b-44cc19a614f2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:25.173885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9811d5-39c4-4795-a2b9-d451b26b6d7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:25.174536 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9811d5-39c4-4795-a2b9-d451b26b6d7c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:25.175568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9811d5-39c4-4795-a2b9-d451b26b6d7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:25.175855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb9811d5-39c4-4795-a2b9-d451b26b6d7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:25.176575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9811d5-39c4-4795-a2b9-d451b26b6d7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:25.178208 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb9811d5-39c4-4795-a2b9-d451b26b6d7c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:25.188578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1217/2391] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:25:25.193146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685c223-a3d8-4144-bce4-943cbd015d94 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:25.204851 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0685c223-a3d8-4144-bce4-943cbd015d94 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:25.209677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e15742-9b1e-48ae-aac2-3afd1f8a0978 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:25.210339 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e15742-9b1e-48ae-aac2-3afd1f8a0978 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:25.210618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e15742-9b1e-48ae-aac2-3afd1f8a0978 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:25.210892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e15742-9b1e-48ae-aac2-3afd1f8a0978 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:25.211607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e15742-9b1e-48ae-aac2-3afd1f8a0978 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:25.213241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19e15742-9b1e-48ae-aac2-3afd1f8a0978 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:25.225785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1175/2392] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:25:25 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:25:25.229894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9811d5-39c4-4795-a2b9-d451b26b6d7c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:25.241311 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb9811d5-39c4-4795-a2b9-d451b26b6d7c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:25.245978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9110030-e2c6-412c-a375-2a7191b9adf2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:25.246973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9110030-e2c6-412c-a375-2a7191b9adf2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:25.247375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9110030-e2c6-412c-a375-2a7191b9adf2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:25.247745 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9110030-e2c6-412c-a375-2a7191b9adf2 admin admin] PATH_INFO: `/v3/projects/71af3c4b3fa2490485c7cc360a08f1d0/users/8dbaa8f67762494f974d747330faecc5/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:25.262895 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9110030-e2c6-412c-a375-2a7191b9adf2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=71af3c4b3fa2490485c7cc360a08f1d0, user_id=8dbaa8f67762494f974d747330faecc5, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:25.265619 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9110030-e2c6-412c-a375-2a7191b9adf2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:25.278558 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1218/2393] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:25:25 2022] PUT /identity/v3/projects/71af3c4b3fa2490485c7cc360a08f1d0/users/8dbaa8f67762494f974d747330faecc5/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:25:25.283492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55612ddd-1ffc-43af-8c31-ad00d29fabd0 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:25.283781 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55612ddd-1ffc-43af-8c31-ad00d29fabd0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:25.284641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55612ddd-1ffc-43af-8c31-ad00d29fabd0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:25.303549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-55612ddd-1ffc-43af-8c31-ad00d29fabd0 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:25:25.304881 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-55612ddd-1ffc-43af-8c31-ad00d29fabd0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:25.362976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1176/2394] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:25:25 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:25:25.372322 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9110030-e2c6-412c-a375-2a7191b9adf2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:25.374032 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d9110030-e2c6-412c-a375-2a7191b9adf2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:25.391804 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:25.432367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9110030-e2c6-412c-a375-2a7191b9adf2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:25.435892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec90dd-febd-4619-91d1-f630cd4049ae service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:25.436529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec90dd-febd-4619-91d1-f630cd4049ae service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:25.436809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec90dd-febd-4619-91d1-f630cd4049ae service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:25.437127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ec90dd-febd-4619-91d1-f630cd4049ae service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:25.445945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec90dd-febd-4619-91d1-f630cd4049ae service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:25.447360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9ec90dd-febd-4619-91d1-f630cd4049ae service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:25.457086 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1219/2395] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:25:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:25:29.548644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bc126-3845-44b8-9210-5f4e277c6393 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:29.549183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bc126-3845-44b8-9210-5f4e277c6393 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:29.549280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-800bc126-3845-44b8-9210-5f4e277c6393 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:29.591662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-800bc126-3845-44b8-9210-5f4e277c6393 None None] MFA Rules not processed for user `8dbaa8f67762494f974d747330faecc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:25:29.593159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-800bc126-3845-44b8-9210-5f4e277c6393 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:29.690137 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1177/2396] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:25:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:25:29.694808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec90dd-febd-4619-91d1-f630cd4049ae service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:29.706354 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ec90dd-febd-4619-91d1-f630cd4049ae service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:29.711254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fc4a7-9188-4151-a031-b92b3e8dc24a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:29.712039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fc4a7-9188-4151-a031-b92b3e8dc24a admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:29.712407 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fc4a7-9188-4151-a031-b92b3e8dc24a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:29.712754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-679fc4a7-9188-4151-a031-b92b3e8dc24a admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:29.713562 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fc4a7-9188-4151-a031-b92b3e8dc24a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:29.715572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-679fc4a7-9188-4151-a031-b92b3e8dc24a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:29.752293 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1220/2397] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:25:29 2022] POST /identity/v3/projects => generated 383 bytes in 58 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:25:29.756526 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bc126-3845-44b8-9210-5f4e277c6393 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:29.768961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-800bc126-3845-44b8-9210-5f4e277c6393 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:29.842761 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb11b1-81e9-4c7d-8d87-e27cd3ec8fe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:29.843662 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb11b1-81e9-4c7d-8d87-e27cd3ec8fe0 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:29.844018 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb11b1-81e9-4c7d-8d87-e27cd3ec8fe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:29.844366 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94bb11b1-81e9-4c7d-8d87-e27cd3ec8fe0 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:29.845318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb11b1-81e9-4c7d-8d87-e27cd3ec8fe0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:29.847406 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94bb11b1-81e9-4c7d-8d87-e27cd3ec8fe0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:29.857856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:29.871529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1178/2398] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:25:29 2022] POST /identity/v3/users => generated 298 bytes in 115 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:25:29.875969 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fc4a7-9188-4151-a031-b92b3e8dc24a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:29.888410 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-679fc4a7-9188-4151-a031-b92b3e8dc24a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:29.899720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbbc3c-115e-4511-afa6-6e9f17bfed4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:29.900491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbbc3c-115e-4511-afa6-6e9f17bfed4a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:29.900838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbbc3c-115e-4511-afa6-6e9f17bfed4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:29.901229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bbbc3c-115e-4511-afa6-6e9f17bfed4a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:29.902023 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbbc3c-115e-4511-afa6-6e9f17bfed4a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:29.903708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bbbc3c-115e-4511-afa6-6e9f17bfed4a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:29.917040 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1221/2399] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:25:29.920320 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb11b1-81e9-4c7d-8d87-e27cd3ec8fe0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:29.930847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94bb11b1-81e9-4c7d-8d87-e27cd3ec8fe0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:29.935876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50663a-b4a0-4859-afb5-cec11eaf3c12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:29.936769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50663a-b4a0-4859-afb5-cec11eaf3c12 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:29.937076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50663a-b4a0-4859-afb5-cec11eaf3c12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:29.937352 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d50663a-b4a0-4859-afb5-cec11eaf3c12 admin admin] PATH_INFO: `/v3/projects/266d9fe8adee4fef95b6a3de7e394c87/users/83f149f9145b4b25ac9875d1e9c23e61/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:29.954095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50663a-b4a0-4859-afb5-cec11eaf3c12 admin admin] RBAC: Authorizing `identity:create_grant(project_id=266d9fe8adee4fef95b6a3de7e394c87, user_id=83f149f9145b4b25ac9875d1e9c23e61, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:29.957206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d50663a-b4a0-4859-afb5-cec11eaf3c12 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:29.975570 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1179/2400] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:25:29 2022] PUT /identity/v3/projects/266d9fe8adee4fef95b6a3de7e394c87/users/83f149f9145b4b25ac9875d1e9c23e61/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 55 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:25:29.979308 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbbc3c-115e-4511-afa6-6e9f17bfed4a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:29.990664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bbbc3c-115e-4511-afa6-6e9f17bfed4a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:30.067277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db49e640-2573-4806-860a-0dd89df5699b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:30.067951 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49e640-2573-4806-860a-0dd89df5699b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:30.068232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49e640-2573-4806-860a-0dd89df5699b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:30.068506 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db49e640-2573-4806-860a-0dd89df5699b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:30.069260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49e640-2573-4806-860a-0dd89df5699b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:30.070844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db49e640-2573-4806-860a-0dd89df5699b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:30.080736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1222/2401] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:25:29 2022] GET /identity/v3/roles => generated 1420 bytes in 102 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:25:30.084811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50663a-b4a0-4859-afb5-cec11eaf3c12 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:30.094838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d50663a-b4a0-4859-afb5-cec11eaf3c12 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:30.099311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308a4c4-7409-40e8-8d7f-fc6a2b32d569 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:30.100430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308a4c4-7409-40e8-8d7f-fc6a2b32d569 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:30.100705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308a4c4-7409-40e8-8d7f-fc6a2b32d569 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:30.100974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1308a4c4-7409-40e8-8d7f-fc6a2b32d569 admin admin] PATH_INFO: `/v3/projects/266d9fe8adee4fef95b6a3de7e394c87/users/83f149f9145b4b25ac9875d1e9c23e61/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:30.102907 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308a4c4-7409-40e8-8d7f-fc6a2b32d569 admin admin] RBAC: Authorizing `identity:create_grant(project_id=266d9fe8adee4fef95b6a3de7e394c87, user_id=83f149f9145b4b25ac9875d1e9c23e61, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:30.105578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1308a4c4-7409-40e8-8d7f-fc6a2b32d569 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:30.115918 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1180/2402] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:25:30 2022] PUT /identity/v3/projects/266d9fe8adee4fef95b6a3de7e394c87/users/83f149f9145b4b25ac9875d1e9c23e61/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 32 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:25:34.808941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e91509-3a06-47e3-a55c-ef45293dab7c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:34.809467 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e91509-3a06-47e3-a55c-ef45293dab7c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:34.809704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91e91509-3a06-47e3-a55c-ef45293dab7c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:34.850905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-91e91509-3a06-47e3-a55c-ef45293dab7c None None] MFA Rules not processed for user `83f149f9145b4b25ac9875d1e9c23e61`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:25:34.852637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-91e91509-3a06-47e3-a55c-ef45293dab7c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:34.961622 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1223/2403] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:25:34 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:25:34.979745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308a4c4-7409-40e8-8d7f-fc6a2b32d569 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:34.981705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1308a4c4-7409-40e8-8d7f-fc6a2b32d569 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:35.146964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1308a4c4-7409-40e8-8d7f-fc6a2b32d569 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:35.146964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44165e-110e-4779-99b1-1ec4fe77f38b service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbb5beba8a45a5b0a9b0beba0e0d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:35.148008 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44165e-110e-4779-99b1-1ec4fe77f38b service glance] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:35.148450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44165e-110e-4779-99b1-1ec4fe77f38b service glance] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:35.148850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa44165e-110e-4779-99b1-1ec4fe77f38b service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:35.250288 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44165e-110e-4779-99b1-1ec4fe77f38b service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:35.252382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa44165e-110e-4779-99b1-1ec4fe77f38b service glance] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:35.264475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1181/2404] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:25:34 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 285 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:25:35.390447 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784197c2-6e50-4582-8084-282a519f45bb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:35.390999 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784197c2-6e50-4582-8084-282a519f45bb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:35.391597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784197c2-6e50-4582-8084-282a519f45bb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:35.405651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:35.413327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-784197c2-6e50-4582-8084-282a519f45bb None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:25:35.415016 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-784197c2-6e50-4582-8084-282a519f45bb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:35.479283 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1224/2405] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:25:35 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:25:35.491508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44165e-110e-4779-99b1-1ec4fe77f38b service glance] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:35.493244 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-aa44165e-110e-4779-99b1-1ec4fe77f38b service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:35.553167 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:INSERT=3,keystone:SELECT=97 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:35.573891 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa44165e-110e-4779-99b1-1ec4fe77f38b service glance] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:35.583125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcb596-0e9b-4eb7-bd50-5be3c7065c26 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:35.583898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcb596-0e9b-4eb7-bd50-5be3c7065c26 service swift] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:35.584252 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcb596-0e9b-4eb7-bd50-5be3c7065c26 service swift] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:35.584537 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbfcb596-0e9b-4eb7-bd50-5be3c7065c26 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:35.593641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcb596-0e9b-4eb7-bd50-5be3c7065c26 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:35.595776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbfcb596-0e9b-4eb7-bd50-5be3c7065c26 service swift] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:35.604716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1182/2406] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:25:35 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 114 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:25:45.157013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d06930-7193-49bd-8cf9-4e7c9071fd27 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:45.157566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d06930-7193-49bd-8cf9-4e7c9071fd27 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:45.157683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41d06930-7193-49bd-8cf9-4e7c9071fd27 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:45.177367 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-41d06930-7193-49bd-8cf9-4e7c9071fd27 None None] MFA Rules not processed for user `8dbaa8f67762494f974d747330faecc5`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:25:45.178767 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-41d06930-7193-49bd-8cf9-4e7c9071fd27 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:45.186894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1225/2407] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:25:45 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:25:45.600758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=9 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:46.701782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcb596-0e9b-4eb7-bd50-5be3c7065c26 service swift] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:46.703492 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cbfcb596-0e9b-4eb7-bd50-5be3c7065c26 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:46.799292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbfcb596-0e9b-4eb7-bd50-5be3c7065c26 service swift] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:46.803974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f7331-2871-4f0d-901f-6590bfddcbba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:46.804845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f7331-2871-4f0d-901f-6590bfddcbba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:46.805156 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f7331-2871-4f0d-901f-6590bfddcbba admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:46.805434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-378f7331-2871-4f0d-901f-6590bfddcbba admin admin] PATH_INFO: `/v3/users/3cab4b811e944bc6af6d73927de3bd27` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:46.806750 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f7331-2871-4f0d-901f-6590bfddcbba admin admin] RBAC: Authorizing `identity:delete_user(user_id=3cab4b811e944bc6af6d73927de3bd27)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:46.808994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-378f7331-2871-4f0d-901f-6590bfddcbba admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:46.881543 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-378f7331-2871-4f0d-901f-6590bfddcbba admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '3cab4b811e944bc6af6d73927de3bd27'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.889369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-378f7331-2871-4f0d-901f-6590bfddcbba admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '3cab4b811e944bc6af6d73927de3bd27'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.890067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-378f7331-2871-4f0d-901f-6590bfddcbba admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '3cab4b811e944bc6af6d73927de3bd27'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.904051 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-378f7331-2871-4f0d-901f-6590bfddcbba admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '3cab4b811e944bc6af6d73927de3bd27'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.911642 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-378f7331-2871-4f0d-901f-6590bfddcbba admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '3cab4b811e944bc6af6d73927de3bd27'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:46.917898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1183/2408] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:25:46 2022] DELETE /identity/v3/users/3cab4b811e944bc6af6d73927de3bd27 => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:25:47.027447 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab818a07-80d0-4001-8e47-a9f0cad24973 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:47.028070 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab818a07-80d0-4001-8e47-a9f0cad24973 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:47.028252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab818a07-80d0-4001-8e47-a9f0cad24973 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:47.051321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ab818a07-80d0-4001-8e47-a9f0cad24973 None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:25:47.052546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ab818a07-80d0-4001-8e47-a9f0cad24973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:47.113125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1226/2409] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:25:47 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 87 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:25:47.125116 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f7331-2871-4f0d-901f-6590bfddcbba admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:47.127156 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-378f7331-2871-4f0d-901f-6590bfddcbba admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:47.203405 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-378f7331-2871-4f0d-901f-6590bfddcbba admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:47.209607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d55c6a9-3b71-44eb-99d5-b1089c4b6b7b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:47.209963 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55c6a9-3b71-44eb-99d5-b1089c4b6b7b service swift] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:47.210330 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55c6a9-3b71-44eb-99d5-b1089c4b6b7b service swift] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:47.210593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d55c6a9-3b71-44eb-99d5-b1089c4b6b7b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:47.220090 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55c6a9-3b71-44eb-99d5-b1089c4b6b7b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:47.221984 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d55c6a9-3b71-44eb-99d5-b1089c4b6b7b service swift] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:47.232424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1184/2410] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:25:47 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:25:47.247217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab818a07-80d0-4001-8e47-a9f0cad24973 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:25:47.249455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ab818a07-80d0-4001-8e47-a9f0cad24973 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:25:47.357325 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab818a07-80d0-4001-8e47-a9f0cad24973 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:25:47.362966 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:25:47.363849 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:25:47.364755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:25:47.364755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] PATH_INFO: `/v3/projects/d2a0d8b760fc467ca80e4d5460ef6700` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:25:47.366783 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] RBAC: Authorizing `identity:delete_project(project_id=d2a0d8b760fc467ca80e4d5460ef6700)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:25:47.369335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:25:47.459210 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'd2a0d8b760fc467ca80e4d5460ef6700', 'request_id': 'req-b3688895-88c3-4cc8-97e8-f6870ae4160d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:47.462511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:DELETE=4,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:47.471440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'd2a0d8b760fc467ca80e4d5460ef6700', 'request_id': 'req-b3688895-88c3-4cc8-97e8-f6870ae4160d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:47.487901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'd2a0d8b760fc467ca80e4d5460ef6700', 'request_id': 'req-b3688895-88c3-4cc8-97e8-f6870ae4160d'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:47.508249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] The token cache is being invalidate because project d2a0d8b760fc467ca80e4d5460ef6700 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:25:47.508483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:47.511117 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:25:47.514192 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1227/2411] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:25:47 2022] DELETE /identity/v3/projects/d2a0d8b760fc467ca80e4d5460ef6700 => generated 0 bytes in 268 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:25:57.228559 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=85,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:25:57.503558 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=3,keystone:SELECT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:06.569083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53980c00-1f3f-471c-a4b7-aeca497931fb None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:26:06.569634 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53980c00-1f3f-471c-a4b7-aeca497931fb None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:26:06.569634 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53980c00-1f3f-471c-a4b7-aeca497931fb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:26:06.588395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-53980c00-1f3f-471c-a4b7-aeca497931fb None None] MFA Rules not processed for user `301f5bb1404040d2b7e5c9b55312d515`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:26:06.589643 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-53980c00-1f3f-471c-a4b7-aeca497931fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:26:06.648070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1185/2412] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:26:06 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:26:16.640748 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=25 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:21.598830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:26:21.600338 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:26:21.661459 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3688895-88c3-4cc8-97e8-f6870ae4160d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:26:21.665296 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c41e4e-2b45-4f14-89da-5567e3114ca6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:26:21.666086 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c41e4e-2b45-4f14-89da-5567e3114ca6 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:26:21.666475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c41e4e-2b45-4f14-89da-5567e3114ca6 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:26:21.666822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7c41e4e-2b45-4f14-89da-5567e3114ca6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:26:21.668852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a7c41e4e-2b45-4f14-89da-5567e3114ca6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:26:21.734552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c41e4e-2b45-4f14-89da-5567e3114ca6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:26:21.736149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7c41e4e-2b45-4f14-89da-5567e3114ca6 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:26:21.747166 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1228/2413] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:26:21 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:26:31.742150 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=50 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:33.580065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae56a3-6751-4c90-bc40-284326629b7e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:26:33.581183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae56a3-6751-4c90-bc40-284326629b7e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:26:33.581377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86ae56a3-6751-4c90-bc40-284326629b7e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:26:33.603468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-86ae56a3-6751-4c90-bc40-284326629b7e None None] MFA Rules not processed for user `4f1948e8724647bd893015835a50d8db`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:26:33.604683 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-86ae56a3-6751-4c90-bc40-284326629b7e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:26:33.664303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1186/2414] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:26:33 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:26:41.190614 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c41e4e-2b45-4f14-89da-5567e3114ca6 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:26:41.199219 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7c41e4e-2b45-4f14-89da-5567e3114ca6 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:26:41.202813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfac2ec-17ae-4223-adc7-94b7a6dafd37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:26:41.203449 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfac2ec-17ae-4223-adc7-94b7a6dafd37 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:26:41.203734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfac2ec-17ae-4223-adc7-94b7a6dafd37 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:26:41.204013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bfac2ec-17ae-4223-adc7-94b7a6dafd37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:26:41.205824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1bfac2ec-17ae-4223-adc7-94b7a6dafd37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:26:41.275285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfac2ec-17ae-4223-adc7-94b7a6dafd37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:26:41.276631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bfac2ec-17ae-4223-adc7-94b7a6dafd37 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:26:41.287411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1229/2415] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:26:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:26:42.455523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae56a3-6751-4c90-bc40-284326629b7e None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:26:42.465632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86ae56a3-6751-4c90-bc40-284326629b7e None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:26:42.469248 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03b205-d837-473a-ad2a-a4ed4fd0832d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:26:42.469896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03b205-d837-473a-ad2a-a4ed4fd0832d service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:26:42.470180 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03b205-d837-473a-ad2a-a4ed4fd0832d service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:26:42.470605 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d03b205-d837-473a-ad2a-a4ed4fd0832d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:26:42.472887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1d03b205-d837-473a-ad2a-a4ed4fd0832d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:26:42.486628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03b205-d837-473a-ad2a-a4ed4fd0832d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:26:42.488364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d03b205-d837-473a-ad2a-a4ed4fd0832d service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:26:42.502336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1187/2416] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:26:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:26:51.282690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=34 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:26:52.496622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=31 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:27:21.307756 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfac2ec-17ae-4223-adc7-94b7a6dafd37 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:21.309192 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1bfac2ec-17ae-4223-adc7-94b7a6dafd37 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:21.365331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bfac2ec-17ae-4223-adc7-94b7a6dafd37 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:21.368742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ce988-8fef-4a4d-98bc-d176d567bff6 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:21.369403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ce988-8fef-4a4d-98bc-d176d567bff6 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:21.369683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ce988-8fef-4a4d-98bc-d176d567bff6 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:21.369955 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-655ce988-8fef-4a4d-98bc-d176d567bff6 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:21.371671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-655ce988-8fef-4a4d-98bc-d176d567bff6 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:21.382935 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ce988-8fef-4a4d-98bc-d176d567bff6 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:21.384324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-655ce988-8fef-4a4d-98bc-d176d567bff6 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:21.393043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1230/2417] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:27:21 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:27:27.615102 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03b205-d837-473a-ad2a-a4ed4fd0832d service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:27.629116 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1d03b205-d837-473a-ad2a-a4ed4fd0832d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:27.650852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d03b205-d837-473a-ad2a-a4ed4fd0832d service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:27.657480 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb26ec9-e10d-4974-886e-1fca1d850d39 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:27.658159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb26ec9-e10d-4974-886e-1fca1d850d39 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:27.658436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb26ec9-e10d-4974-886e-1fca1d850d39 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:27.658710 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fb26ec9-e10d-4974-886e-1fca1d850d39 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:27.660575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7fb26ec9-e10d-4974-886e-1fca1d850d39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:27.679720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb26ec9-e10d-4974-886e-1fca1d850d39 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:27.681361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7fb26ec9-e10d-4974-886e-1fca1d850d39 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:27.695732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1188/2418] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:27:27 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:27:31.388916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=26 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:27:37.688379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=6 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:27:40.037444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ce988-8fef-4a4d-98bc-d176d567bff6 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:40.049465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-655ce988-8fef-4a4d-98bc-d176d567bff6 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:40.053076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24580dfc-1dd7-4e77-9b49-be81ba3dd671 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:40.053720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24580dfc-1dd7-4e77-9b49-be81ba3dd671 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:40.054002 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24580dfc-1dd7-4e77-9b49-be81ba3dd671 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:40.054275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24580dfc-1dd7-4e77-9b49-be81ba3dd671 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:40.056306 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-24580dfc-1dd7-4e77-9b49-be81ba3dd671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:40.118289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24580dfc-1dd7-4e77-9b49-be81ba3dd671 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:40.119711 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-24580dfc-1dd7-4e77-9b49-be81ba3dd671 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:40.129969 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1231/2419] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:27:40 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:27:40.524708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb26ec9-e10d-4974-886e-1fca1d850d39 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:40.526218 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7fb26ec9-e10d-4974-886e-1fca1d850d39 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:40.538653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7fb26ec9-e10d-4974-886e-1fca1d850d39 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:40.542319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2dec0-e1bf-417f-9ebf-4bf4f60c2b77 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:40.543002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2dec0-e1bf-417f-9ebf-4bf4f60c2b77 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:40.543289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2dec0-e1bf-417f-9ebf-4bf4f60c2b77 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:40.543565 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23e2dec0-e1bf-417f-9ebf-4bf4f60c2b77 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:40.545701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-23e2dec0-e1bf-417f-9ebf-4bf4f60c2b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:40.556350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2dec0-e1bf-417f-9ebf-4bf4f60c2b77 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:40.557816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23e2dec0-e1bf-417f-9ebf-4bf4f60c2b77 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:40.567586 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1189/2420] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:27:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:27:40.958949 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24580dfc-1dd7-4e77-9b49-be81ba3dd671 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:40.965792 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-24580dfc-1dd7-4e77-9b49-be81ba3dd671 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:40.979575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24580dfc-1dd7-4e77-9b49-be81ba3dd671 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:40.983274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd7619-c299-4821-8c8a-ab4b1851ed2b service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:40.983958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd7619-c299-4821-8c8a-ab4b1851ed2b service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:40.984647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd7619-c299-4821-8c8a-ab4b1851ed2b service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:40.984647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cdd7619-c299-4821-8c8a-ab4b1851ed2b service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:40.986396 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0cdd7619-c299-4821-8c8a-ab4b1851ed2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:41.054319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd7619-c299-4821-8c8a-ab4b1851ed2b service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:41.055756 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cdd7619-c299-4821-8c8a-ab4b1851ed2b service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:41.066135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1232/2421] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:27:40 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:27:44.362352 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2dec0-e1bf-417f-9ebf-4bf4f60c2b77 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:44.363769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-23e2dec0-e1bf-417f-9ebf-4bf4f60c2b77 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:44.432695 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23e2dec0-e1bf-417f-9ebf-4bf4f60c2b77 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:44.438105 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af05985-868a-4be8-8651-a457ecc43b78 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab4efe6f79d4b3ca5618c089c5f3d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:44.439145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af05985-868a-4be8-8651-a457ecc43b78 service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:44.439145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af05985-868a-4be8-8651-a457ecc43b78 service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:44.439369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6af05985-868a-4be8-8651-a457ecc43b78 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:44.441240 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6af05985-868a-4be8-8651-a457ecc43b78 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:44.453794 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd7619-c299-4821-8c8a-ab4b1851ed2b service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:44.455763 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0cdd7619-c299-4821-8c8a-ab4b1851ed2b service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:44.458371 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af05985-868a-4be8-8651-a457ecc43b78 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:44.459966 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6af05985-868a-4be8-8651-a457ecc43b78 service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:44.472399 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cdd7619-c299-4821-8c8a-ab4b1851ed2b service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:44.477768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea49c9c8-c02e-4cc4-855e-9da6789edd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:44.480030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c9c8-c02e-4cc4-855e-9da6789edd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:44.480030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c9c8-c02e-4cc4-855e-9da6789edd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:44.480030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea49c9c8-c02e-4cc4-855e-9da6789edd0c admin admin] PATH_INFO: `/v3/users/301f5bb1404040d2b7e5c9b55312d515` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:44.480941 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1190/2422] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:27:44 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:27:44.482985 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49c9c8-c02e-4cc4-855e-9da6789edd0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=301f5bb1404040d2b7e5c9b55312d515)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:44.484949 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea49c9c8-c02e-4cc4-855e-9da6789edd0c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:44.540118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ea49c9c8-c02e-4cc4-855e-9da6789edd0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '301f5bb1404040d2b7e5c9b55312d515'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:27:44.540978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ea49c9c8-c02e-4cc4-855e-9da6789edd0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '301f5bb1404040d2b7e5c9b55312d515'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:27:44.548820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ea49c9c8-c02e-4cc4-855e-9da6789edd0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '301f5bb1404040d2b7e5c9b55312d515'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:27:44.549615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ea49c9c8-c02e-4cc4-855e-9da6789edd0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '301f5bb1404040d2b7e5c9b55312d515'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:27:44.563199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ea49c9c8-c02e-4cc4-855e-9da6789edd0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '301f5bb1404040d2b7e5c9b55312d515'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:27:44.581610 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1233/2423] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:27:44 2022] DELETE /identity/v3/users/301f5bb1404040d2b7e5c9b55312d515 => generated 0 bytes in 129 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:27:44.852846 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af05985-868a-4be8-8651-a457ecc43b78 service placement] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:44.874630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6af05985-868a-4be8-8651-a457ecc43b78 service placement] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:44.955936 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e14dd4-b053-472a-9ff2-84375b277c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:44.956992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e14dd4-b053-472a-9ff2-84375b277c19 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:44.957296 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e14dd4-b053-472a-9ff2-84375b277c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:44.957726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e14dd4-b053-472a-9ff2-84375b277c19 admin admin] PATH_INFO: `/v3/projects/965c959e78ab4d17ad6b86d20a9e7b0e` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:44.958957 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e14dd4-b053-472a-9ff2-84375b277c19 admin admin] RBAC: Authorizing `identity:delete_project(project_id=965c959e78ab4d17ad6b86d20a9e7b0e)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:44.961338 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e14dd4-b053-472a-9ff2-84375b277c19 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:45.010923 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d5e14dd4-b053-472a-9ff2-84375b277c19 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '965c959e78ab4d17ad6b86d20a9e7b0e', 'request_id': 'req-d5e14dd4-b053-472a-9ff2-84375b277c19'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:27:45.019003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d5e14dd4-b053-472a-9ff2-84375b277c19 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '965c959e78ab4d17ad6b86d20a9e7b0e', 'request_id': 'req-d5e14dd4-b053-472a-9ff2-84375b277c19'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:27:45.024721 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d5e14dd4-b053-472a-9ff2-84375b277c19 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '965c959e78ab4d17ad6b86d20a9e7b0e', 'request_id': 'req-d5e14dd4-b053-472a-9ff2-84375b277c19'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:27:45.036183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d5e14dd4-b053-472a-9ff2-84375b277c19 admin admin] The token cache is being invalidate because project 965c959e78ab4d17ad6b86d20a9e7b0e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:27:45.036465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d5e14dd4-b053-472a-9ff2-84375b277c19 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:27:45.037309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d5e14dd4-b053-472a-9ff2-84375b277c19 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:27:45.039175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1191/2424] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:27:44 2022] DELETE /identity/v3/projects/965c959e78ab4d17ad6b86d20a9e7b0e => generated 0 bytes in 187 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:27:45.044514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90445d4-0b3b-4158-b85c-66018492bd99 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:45.044807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90445d4-0b3b-4158-b85c-66018492bd99 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:45.045121 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a90445d4-0b3b-4158-b85c-66018492bd99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:45.053206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:27:45.065002 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a90445d4-0b3b-4158-b85c-66018492bd99 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:27:45.066480 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a90445d4-0b3b-4158-b85c-66018492bd99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:45.137972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1234/2425] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:27:45.141542 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a77a18-7bad-487b-9e7f-a0f53ad72132 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:45.142170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a77a18-7bad-487b-9e7f-a0f53ad72132 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:45.143127 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3a77a18-7bad-487b-9e7f-a0f53ad72132 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:45.163890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:27:45.172681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f3a77a18-7bad-487b-9e7f-a0f53ad72132 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:27:45.180734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f3a77a18-7bad-487b-9e7f-a0f53ad72132 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:45.196086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1192/2426] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 57 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:27:45.200168 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90445d4-0b3b-4158-b85c-66018492bd99 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:45.211165 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a90445d4-0b3b-4158-b85c-66018492bd99 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:45.216924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc31001-7efa-4011-ac73-c9ad32a40d2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:45.217891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc31001-7efa-4011-ac73-c9ad32a40d2a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:45.218380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc31001-7efa-4011-ac73-c9ad32a40d2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:45.219469 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc31001-7efa-4011-ac73-c9ad32a40d2a admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:45.220665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc31001-7efa-4011-ac73-c9ad32a40d2a admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:27:45.221218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc31001-7efa-4011-ac73-c9ad32a40d2a admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:45.223066 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc31001-7efa-4011-ac73-c9ad32a40d2a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:45.236516 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1235/2427] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:27:45 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 37 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:27:45.240566 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a77a18-7bad-487b-9e7f-a0f53ad72132 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:45.253315 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3a77a18-7bad-487b-9e7f-a0f53ad72132 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:45.263279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9888c1e-dcef-4088-9f89-6b2f5eeb3c2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:45.263868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888c1e-dcef-4088-9f89-6b2f5eeb3c2c admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:45.264152 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888c1e-dcef-4088-9f89-6b2f5eeb3c2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:45.264877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9888c1e-dcef-4088-9f89-6b2f5eeb3c2c admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:45.265162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9888c1e-dcef-4088-9f89-6b2f5eeb3c2c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:45.267636 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9888c1e-dcef-4088-9f89-6b2f5eeb3c2c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:45.311381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1193/2428] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:27:45 2022] POST /identity/v3/projects => generated 387 bytes in 71 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:27:45.315804 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc31001-7efa-4011-ac73-c9ad32a40d2a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:45.325774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc31001-7efa-4011-ac73-c9ad32a40d2a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:45.384219 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecda36-20fe-451c-9dba-917ab8e72a20 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:45.384885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecda36-20fe-451c-9dba-917ab8e72a20 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:45.385207 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecda36-20fe-451c-9dba-917ab8e72a20 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:45.385483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5ecda36-20fe-451c-9dba-917ab8e72a20 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:45.386169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecda36-20fe-451c-9dba-917ab8e72a20 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:45.388060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e5ecda36-20fe-451c-9dba-917ab8e72a20 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:45.408974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1236/2429] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:27:45 2022] POST /identity/v3/users => generated 294 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:27:45.413206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9888c1e-dcef-4088-9f89-6b2f5eeb3c2c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:45.423495 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9888c1e-dcef-4088-9f89-6b2f5eeb3c2c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:45.429139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50a0a8-3902-46f0-85fb-a9d128f8851d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:45.430058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a0a8-3902-46f0-85fb-a9d128f8851d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:45.430411 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a0a8-3902-46f0-85fb-a9d128f8851d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:45.430808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff50a0a8-3902-46f0-85fb-a9d128f8851d admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:45.431758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50a0a8-3902-46f0-85fb-a9d128f8851d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:45.433467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff50a0a8-3902-46f0-85fb-a9d128f8851d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:45.445025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1194/2430] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:27:45.448513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecda36-20fe-451c-9dba-917ab8e72a20 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:45.459349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e5ecda36-20fe-451c-9dba-917ab8e72a20 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:45.464062 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0651a1f-03b6-4514-a919-b32f2ef6cc54 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:45.464744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651a1f-03b6-4514-a919-b32f2ef6cc54 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:45.465061 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651a1f-03b6-4514-a919-b32f2ef6cc54 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:45.465341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0651a1f-03b6-4514-a919-b32f2ef6cc54 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:45.466071 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0651a1f-03b6-4514-a919-b32f2ef6cc54 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:45.467682 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0651a1f-03b6-4514-a919-b32f2ef6cc54 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:45.479587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1237/2431] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:27:45 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:27:45.483923 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50a0a8-3902-46f0-85fb-a9d128f8851d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:45.494413 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff50a0a8-3902-46f0-85fb-a9d128f8851d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:45.499243 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfee204-2ba1-43d2-adcb-8008e416839a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:45.500246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfee204-2ba1-43d2-adcb-8008e416839a admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:45.500531 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfee204-2ba1-43d2-adcb-8008e416839a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:45.500878 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cfee204-2ba1-43d2-adcb-8008e416839a admin admin] PATH_INFO: `/v3/projects/80d75b673c6547b1876cc7820d24c05a/users/555fa6f76d2d4b2b98c1322046f56bc0/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:45.516704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfee204-2ba1-43d2-adcb-8008e416839a admin admin] RBAC: Authorizing `identity:create_grant(project_id=80d75b673c6547b1876cc7820d24c05a, user_id=555fa6f76d2d4b2b98c1322046f56bc0, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:45.519349 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cfee204-2ba1-43d2-adcb-8008e416839a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:45.533057 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1195/2432] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:27:45 2022] PUT /identity/v3/projects/80d75b673c6547b1876cc7820d24c05a/users/555fa6f76d2d4b2b98c1322046f56bc0/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:27:45.538437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b477822-1819-4d61-9273-6126a2510836 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:45.538941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b477822-1819-4d61-9273-6126a2510836 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:45.539223 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b477822-1819-4d61-9273-6126a2510836 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:45.558229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2b477822-1819-4d61-9273-6126a2510836 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:27:45.559445 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2b477822-1819-4d61-9273-6126a2510836 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:45.620290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1238/2433] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:27:45 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:27:45.631320 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfee204-2ba1-43d2-adcb-8008e416839a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:45.642031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7cfee204-2ba1-43d2-adcb-8008e416839a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:45.700125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cfee204-2ba1-43d2-adcb-8008e416839a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:45.704372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10fed6-bef2-4037-ba41-c318ade68343 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:45.705128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10fed6-bef2-4037-ba41-c318ade68343 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:45.705412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10fed6-bef2-4037-ba41-c318ade68343 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:45.705688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b10fed6-bef2-4037-ba41-c318ade68343 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:45.720561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10fed6-bef2-4037-ba41-c318ade68343 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:45.722247 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b10fed6-bef2-4037-ba41-c318ade68343 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:45.739212 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1196/2434] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:27:45 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 109 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:27:50.000546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedba31-3f5a-402b-98a9-03d1f4f93cb3 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:50.001130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedba31-3f5a-402b-98a9-03d1f4f93cb3 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:50.001130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0aedba31-3f5a-402b-98a9-03d1f4f93cb3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:50.021255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0aedba31-3f5a-402b-98a9-03d1f4f93cb3 None None] MFA Rules not processed for user `b2d13c401ad84870a8d76d49a8054056`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:27:50.022880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0aedba31-3f5a-402b-98a9-03d1f4f93cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:50.029273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:27:50.095845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1239/2435] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:27:49 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:27:50.481944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10fed6-bef2-4037-ba41-c318ade68343 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:50.483363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2b10fed6-bef2-4037-ba41-c318ade68343 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:50.502640 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b10fed6-bef2-4037-ba41-c318ade68343 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:50.507004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504eaef0-56af-4e38-b8e6-38e9e2b83f1a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:50.507949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eaef0-56af-4e38-b8e6-38e9e2b83f1a service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:50.508053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eaef0-56af-4e38-b8e6-38e9e2b83f1a service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:50.508325 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504eaef0-56af-4e38-b8e6-38e9e2b83f1a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:50.511100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-504eaef0-56af-4e38-b8e6-38e9e2b83f1a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:50.523764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504eaef0-56af-4e38-b8e6-38e9e2b83f1a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:50.525424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504eaef0-56af-4e38-b8e6-38e9e2b83f1a service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:50.535063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1197/2436] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:27:50 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:27:50.914267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedba31-3f5a-402b-98a9-03d1f4f93cb3 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:50.915968 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0aedba31-3f5a-402b-98a9-03d1f4f93cb3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:51.030041 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0aedba31-3f5a-402b-98a9-03d1f4f93cb3 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:51.037638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80486ff6-087f-41f1-8e8d-ea3047b17f29 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab4efe6f79d4b3ca5618c089c5f3d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:51.038669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80486ff6-087f-41f1-8e8d-ea3047b17f29 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:51.039969 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80486ff6-087f-41f1-8e8d-ea3047b17f29 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:51.040695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80486ff6-087f-41f1-8e8d-ea3047b17f29 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:51.044781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-80486ff6-087f-41f1-8e8d-ea3047b17f29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:51.064780 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80486ff6-087f-41f1-8e8d-ea3047b17f29 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:51.066903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80486ff6-087f-41f1-8e8d-ea3047b17f29 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:51.080265 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1240/2437] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:27:50 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 166 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:27:51.399856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fbd53-4987-49eb-8379-5a455d26391e None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:51.400155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fbd53-4987-49eb-8379-5a455d26391e None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:51.400502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0fbd53-4987-49eb-8379-5a455d26391e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:51.437825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6e0fbd53-4987-49eb-8379-5a455d26391e None None] MFA Rules not processed for user `555fa6f76d2d4b2b98c1322046f56bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:27:51.439131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6e0fbd53-4987-49eb-8379-5a455d26391e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:51.507542 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1198/2438] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:27:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:27:51.521585 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80486ff6-087f-41f1-8e8d-ea3047b17f29 service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:27:51.523182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-80486ff6-087f-41f1-8e8d-ea3047b17f29 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:51.603327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80486ff6-087f-41f1-8e8d-ea3047b17f29 service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:27:51.608604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f973a5-6f39-4d26-ab51-e9b6a38651cb service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:27:51.609925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f973a5-6f39-4d26-ab51-e9b6a38651cb service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:51.610208 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f973a5-6f39-4d26-ab51-e9b6a38651cb service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:51.610500 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4f973a5-6f39-4d26-ab51-e9b6a38651cb service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:51.618071 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f973a5-6f39-4d26-ab51-e9b6a38651cb service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:27:51.619635 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b4f973a5-6f39-4d26-ab51-e9b6a38651cb service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:27:51.628248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1241/2439] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:27:51 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:27:53.008504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f38e-20d4-44a0-b0e5-dac00566199b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:27:53.009204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f38e-20d4-44a0-b0e5-dac00566199b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:27:53.009374 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e20f38e-20d4-44a0-b0e5-dac00566199b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:27:53.028577 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7e20f38e-20d4-44a0-b0e5-dac00566199b None None] MFA Rules not processed for user `555fa6f76d2d4b2b98c1322046f56bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:27:53.029845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7e20f38e-20d4-44a0-b0e5-dac00566199b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:27:53.039776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1199/2440] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:27:53 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:28:01.624273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=86 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:28:02.136656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f973a5-6f39-4d26-ab51-e9b6a38651cb service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:28:02.150771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4f973a5-6f39-4d26-ab51-e9b6a38651cb service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:28:02.156781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f8539-144f-4dad-84d2-f5e78e690e9e service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:28:02.157567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8539-144f-4dad-84d2-f5e78e690e9e service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:28:02.157907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8539-144f-4dad-84d2-f5e78e690e9e service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:28:02.158258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d7f8539-144f-4dad-84d2-f5e78e690e9e service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:28:02.160301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0d7f8539-144f-4dad-84d2-f5e78e690e9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:28:02.237044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f8539-144f-4dad-84d2-f5e78e690e9e service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:28:02.238654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d7f8539-144f-4dad-84d2-f5e78e690e9e service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:28:02.248098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1242/2441] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:28:02 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:28:02.933159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f38e-20d4-44a0-b0e5-dac00566199b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:28:02.948584 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e20f38e-20d4-44a0-b0e5-dac00566199b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:28:02.954729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ca52e1f-00a2-498c-8a96-9af2d8bed537 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:28:02.955376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52e1f-00a2-498c-8a96-9af2d8bed537 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:28:02.955658 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52e1f-00a2-498c-8a96-9af2d8bed537 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:28:02.955936 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ca52e1f-00a2-498c-8a96-9af2d8bed537 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:28:02.957753 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1ca52e1f-00a2-498c-8a96-9af2d8bed537 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:28:02.967219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:28:02.972421 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca52e1f-00a2-498c-8a96-9af2d8bed537 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:28:02.974616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ca52e1f-00a2-498c-8a96-9af2d8bed537 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:28:02.986402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1200/2442] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:28:02 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 54 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:28:06.381870 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f8539-144f-4dad-84d2-f5e78e690e9e service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:28:06.383532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0d7f8539-144f-4dad-84d2-f5e78e690e9e service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:28:06.399460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d7f8539-144f-4dad-84d2-f5e78e690e9e service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:28:06.408364 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8fe45b7-1e40-4252-b6ba-de36c29aaee1 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:28:06.409135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe45b7-1e40-4252-b6ba-de36c29aaee1 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:28:06.409453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe45b7-1e40-4252-b6ba-de36c29aaee1 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:28:06.409782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8fe45b7-1e40-4252-b6ba-de36c29aaee1 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:28:06.411645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b8fe45b7-1e40-4252-b6ba-de36c29aaee1 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:28:06.425576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe45b7-1e40-4252-b6ba-de36c29aaee1 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:28:06.427485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8fe45b7-1e40-4252-b6ba-de36c29aaee1 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:28:06.439689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1243/2443] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:28:06 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 58 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:28:12.981944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:28:15.934100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b84aba-df86-4068-9888-e1c8e28f057c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:28:15.934681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b84aba-df86-4068-9888-e1c8e28f057c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:28:15.934681 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07b84aba-df86-4068-9888-e1c8e28f057c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:28:15.951476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-07b84aba-df86-4068-9888-e1c8e28f057c None None] MFA Rules not processed for user `4f1948e8724647bd893015835a50d8db`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:28:15.953260 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-07b84aba-df86-4068-9888-e1c8e28f057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:28:15.959908 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1201/2444] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:28:15 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:28:16.434222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=34 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:28:25.946485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:29:05.455535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d714c-c25a-457f-90ef-88e769bcf2a8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:29:05.456018 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d714c-c25a-457f-90ef-88e769bcf2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:29:05.456116 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4d714c-c25a-457f-90ef-88e769bcf2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:29:05.475168 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cb4d714c-c25a-457f-90ef-88e769bcf2a8 None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:29:05.476360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cb4d714c-c25a-457f-90ef-88e769bcf2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:29:05.530026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1244/2445] 10.222.0.64 () {58 vars in 967 bytes} [Thu May 26 18:29:05 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:29:05.569849 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b84aba-df86-4068-9888-e1c8e28f057c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:29:05.571250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-07b84aba-df86-4068-9888-e1c8e28f057c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:29:05.638380 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07b84aba-df86-4068-9888-e1c8e28f057c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:29:05.643202 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b2182-3e94-40ad-a18e-aba201dc0abf service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:29:05.643838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b2182-3e94-40ad-a18e-aba201dc0abf service swift] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:29:05.644117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b2182-3e94-40ad-a18e-aba201dc0abf service swift] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:29:05.644407 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1b2182-3e94-40ad-a18e-aba201dc0abf service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:29:05.652146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b2182-3e94-40ad-a18e-aba201dc0abf service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:29:05.653739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1b2182-3e94-40ad-a18e-aba201dc0abf service swift] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:29:05.662118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1202/2446] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:29:05 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 93 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:29:12.171090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d714c-c25a-457f-90ef-88e769bcf2a8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:29:12.172686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cb4d714c-c25a-457f-90ef-88e769bcf2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:29:12.190201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4d714c-c25a-457f-90ef-88e769bcf2a8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:29:12.195649 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1a904-4572-4764-862e-f5bde0394e51 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab4efe6f79d4b3ca5618c089c5f3d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:29:12.196761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1a904-4572-4764-862e-f5bde0394e51 service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:29:12.197385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1a904-4572-4764-862e-f5bde0394e51 service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:29:12.197952 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80e1a904-4572-4764-862e-f5bde0394e51 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:29:12.201145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-80e1a904-4572-4764-862e-f5bde0394e51 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:29:12.216701 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1a904-4572-4764-862e-f5bde0394e51 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:29:12.218461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80e1a904-4572-4764-862e-f5bde0394e51 service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:29:12.231499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1245/2447] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:29:12 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 61 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:29:12.252460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b2182-3e94-40ad-a18e-aba201dc0abf service swift] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:29:12.254364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6d1b2182-3e94-40ad-a18e-aba201dc0abf service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:29:12.274419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1b2182-3e94-40ad-a18e-aba201dc0abf service swift] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:29:12.279312 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455a546-7bfa-4d8d-9f5b-4d9174d9c616 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:29:12.280487 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455a546-7bfa-4d8d-9f5b-4d9174d9c616 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:29:12.281812 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455a546-7bfa-4d8d-9f5b-4d9174d9c616 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:29:12.283140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e455a546-7bfa-4d8d-9f5b-4d9174d9c616 admin admin] PATH_INFO: `/v3/users/8dbaa8f67762494f974d747330faecc5` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:29:12.284578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455a546-7bfa-4d8d-9f5b-4d9174d9c616 admin admin] RBAC: Authorizing `identity:delete_user(user_id=8dbaa8f67762494f974d747330faecc5)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:29:12.286706 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e455a546-7bfa-4d8d-9f5b-4d9174d9c616 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:29:12.336436 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e455a546-7bfa-4d8d-9f5b-4d9174d9c616 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8dbaa8f67762494f974d747330faecc5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.344845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e455a546-7bfa-4d8d-9f5b-4d9174d9c616 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8dbaa8f67762494f974d747330faecc5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.346888 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e455a546-7bfa-4d8d-9f5b-4d9174d9c616 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8dbaa8f67762494f974d747330faecc5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.359220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e455a546-7bfa-4d8d-9f5b-4d9174d9c616 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8dbaa8f67762494f974d747330faecc5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.366415 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e455a546-7bfa-4d8d-9f5b-4d9174d9c616 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8dbaa8f67762494f974d747330faecc5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.372422 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1203/2448] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:29:12 2022] DELETE /identity/v3/users/8dbaa8f67762494f974d747330faecc5 => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:29:12.540182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1a904-4572-4764-862e-f5bde0394e51 service placement] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:29:12.550566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80e1a904-4572-4764-862e-f5bde0394e51 service placement] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:29:12.607465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:29:12.608264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:29:12.608548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:29:12.608828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] PATH_INFO: `/v3/projects/71af3c4b3fa2490485c7cc360a08f1d0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:29:12.610060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] RBAC: Authorizing `identity:delete_project(project_id=71af3c4b3fa2490485c7cc360a08f1d0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:29:12.611960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:29:12.657982 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '71af3c4b3fa2490485c7cc360a08f1d0', 'request_id': 'req-621550f7-7e21-4d31-abe3-072573caf4d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.664690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '71af3c4b3fa2490485c7cc360a08f1d0', 'request_id': 'req-621550f7-7e21-4d31-abe3-072573caf4d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.670170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '71af3c4b3fa2490485c7cc360a08f1d0', 'request_id': 'req-621550f7-7e21-4d31-abe3-072573caf4d0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.680820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] The token cache is being invalidate because project 71af3c4b3fa2490485c7cc360a08f1d0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:29:12.681142 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.681768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.683287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1246/2449] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:29:12 2022] DELETE /identity/v3/projects/71af3c4b3fa2490485c7cc360a08f1d0 => generated 0 bytes in 144 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:29:12.687914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455a546-7bfa-4d8d-9f5b-4d9174d9c616 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:29:12.689325 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e455a546-7bfa-4d8d-9f5b-4d9174d9c616 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:29:12.702163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e455a546-7bfa-4d8d-9f5b-4d9174d9c616 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:29:12.756815 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630adfb-d5d7-47d4-becd-241d66f9f041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:29:12.757727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630adfb-d5d7-47d4-becd-241d66f9f041 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:29:12.758004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630adfb-d5d7-47d4-becd-241d66f9f041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:29:12.758275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6630adfb-d5d7-47d4-becd-241d66f9f041 admin admin] PATH_INFO: `/v3/users/83f149f9145b4b25ac9875d1e9c23e61` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:29:12.759431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630adfb-d5d7-47d4-becd-241d66f9f041 admin admin] RBAC: Authorizing `identity:delete_user(user_id=83f149f9145b4b25ac9875d1e9c23e61)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:29:12.761382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6630adfb-d5d7-47d4-becd-241d66f9f041 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:29:12.763664 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:29:12.808133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6630adfb-d5d7-47d4-becd-241d66f9f041 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '83f149f9145b4b25ac9875d1e9c23e61'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.815452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6630adfb-d5d7-47d4-becd-241d66f9f041 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '83f149f9145b4b25ac9875d1e9c23e61'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.816094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6630adfb-d5d7-47d4-becd-241d66f9f041 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '83f149f9145b4b25ac9875d1e9c23e61'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.827689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6630adfb-d5d7-47d4-becd-241d66f9f041 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '83f149f9145b4b25ac9875d1e9c23e61'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.834717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6630adfb-d5d7-47d4-becd-241d66f9f041 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '83f149f9145b4b25ac9875d1e9c23e61'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:12.840612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1204/2450] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:29:12 2022] DELETE /identity/v3/users/83f149f9145b4b25ac9875d1e9c23e61 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:29:13.009521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:29:13.010911 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:29:13.023787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-621550f7-7e21-4d31-abe3-072573caf4d0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:29:13.041914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:29:13.082593 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c20d5833-0ee3-479a-87d1-27974ad51b5e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:29:13.083453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d5833-0ee3-479a-87d1-27974ad51b5e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:29:13.083737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d5833-0ee3-479a-87d1-27974ad51b5e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:29:13.084028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c20d5833-0ee3-479a-87d1-27974ad51b5e admin admin] PATH_INFO: `/v3/projects/266d9fe8adee4fef95b6a3de7e394c87` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:29:13.085214 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d5833-0ee3-479a-87d1-27974ad51b5e admin admin] RBAC: Authorizing `identity:delete_project(project_id=266d9fe8adee4fef95b6a3de7e394c87)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:29:13.087121 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c20d5833-0ee3-479a-87d1-27974ad51b5e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:29:13.135280 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c20d5833-0ee3-479a-87d1-27974ad51b5e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '266d9fe8adee4fef95b6a3de7e394c87', 'request_id': 'req-c20d5833-0ee3-479a-87d1-27974ad51b5e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:13.142654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c20d5833-0ee3-479a-87d1-27974ad51b5e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '266d9fe8adee4fef95b6a3de7e394c87', 'request_id': 'req-c20d5833-0ee3-479a-87d1-27974ad51b5e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:13.148259 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c20d5833-0ee3-479a-87d1-27974ad51b5e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '266d9fe8adee4fef95b6a3de7e394c87', 'request_id': 'req-c20d5833-0ee3-479a-87d1-27974ad51b5e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:13.159628 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c20d5833-0ee3-479a-87d1-27974ad51b5e admin admin] The token cache is being invalidate because project 266d9fe8adee4fef95b6a3de7e394c87 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:29:13.159916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c20d5833-0ee3-479a-87d1-27974ad51b5e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:13.160578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-c20d5833-0ee3-479a-87d1-27974ad51b5e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:29:13.162151 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1247/2451] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:29:13 2022] DELETE /identity/v3/projects/266d9fe8adee4fef95b6a3de7e394c87 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:29:22.837191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=25,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:29:23.156123 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=41,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:29:53.856162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630adfb-d5d7-47d4-becd-241d66f9f041 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:29:53.857822 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6630adfb-d5d7-47d4-becd-241d66f9f041 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:29:53.983967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6630adfb-d5d7-47d4-becd-241d66f9f041 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:29:54.052626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694e11a-64b9-47f4-8c32-21e8a56cc453 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab4efe6f79d4b3ca5618c089c5f3d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:29:54.053323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694e11a-64b9-47f4-8c32-21e8a56cc453 service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:29:54.053610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694e11a-64b9-47f4-8c32-21e8a56cc453 service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:29:54.053886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3694e11a-64b9-47f4-8c32-21e8a56cc453 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:29:54.056450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3694e11a-64b9-47f4-8c32-21e8a56cc453 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:29:54.067483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694e11a-64b9-47f4-8c32-21e8a56cc453 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:29:54.069115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3694e11a-64b9-47f4-8c32-21e8a56cc453 service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:29:54.080017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1205/2452] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:29:53 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 224 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:29:58.929186 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a9847-43bb-4e50-8261-9a3732738254 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:29:58.929669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a9847-43bb-4e50-8261-9a3732738254 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:29:58.929907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-889a9847-43bb-4e50-8261-9a3732738254 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:29:58.949642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-889a9847-43bb-4e50-8261-9a3732738254 None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:29:58.950866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-889a9847-43bb-4e50-8261-9a3732738254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:29:59.007749 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1248/2453] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:29:58 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:29:59.020388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694e11a-64b9-47f4-8c32-21e8a56cc453 service placement] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:29:59.021934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3694e11a-64b9-47f4-8c32-21e8a56cc453 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:29:59.092381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3694e11a-64b9-47f4-8c32-21e8a56cc453 service placement] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:29:59.097406 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65717e32-8c33-477c-9ba6-0fe3e1a4cb5d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:29:59.098051 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65717e32-8c33-477c-9ba6-0fe3e1a4cb5d service swift] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:29:59.098335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65717e32-8c33-477c-9ba6-0fe3e1a4cb5d service swift] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:29:59.098613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65717e32-8c33-477c-9ba6-0fe3e1a4cb5d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:29:59.108242 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65717e32-8c33-477c-9ba6-0fe3e1a4cb5d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:29:59.110575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65717e32-8c33-477c-9ba6-0fe3e1a4cb5d service swift] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:29:59.119987 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1206/2454] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:29:59 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:30:00.811211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a9847-43bb-4e50-8261-9a3732738254 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:00.813447 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-889a9847-43bb-4e50-8261-9a3732738254 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:00.879971 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-889a9847-43bb-4e50-8261-9a3732738254 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:00.883909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7c0d5-b695-44bb-af56-2a9e7affb80e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:00.884593 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7c0d5-b695-44bb-af56-2a9e7affb80e service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:00.884933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7c0d5-b695-44bb-af56-2a9e7affb80e service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:00.885255 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a7c0d5-b695-44bb-af56-2a9e7affb80e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:00.887101 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-08a7c0d5-b695-44bb-af56-2a9e7affb80e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:00.974854 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7c0d5-b695-44bb-af56-2a9e7affb80e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:00.976445 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a7c0d5-b695-44bb-af56-2a9e7affb80e service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:00.988091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1249/2455] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:00 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 177 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:03.262725 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65717e32-8c33-477c-9ba6-0fe3e1a4cb5d service swift] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:03.275326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65717e32-8c33-477c-9ba6-0fe3e1a4cb5d service swift] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:03.289812 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51f822-3440-41d4-ad68-3c179f96f771 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:03.290486 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51f822-3440-41d4-ad68-3c179f96f771 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:03.290963 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51f822-3440-41d4-ad68-3c179f96f771 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:03.291485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f51f822-3440-41d4-ad68-3c179f96f771 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:03.295902 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4f51f822-3440-41d4-ad68-3c179f96f771 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:03.329761 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51f822-3440-41d4-ad68-3c179f96f771 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:03.331272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f51f822-3440-41d4-ad68-3c179f96f771 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:03.348699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1207/2456] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:03 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:05.360659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7c0d5-b695-44bb-af56-2a9e7affb80e service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:05.362310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-08a7c0d5-b695-44bb-af56-2a9e7affb80e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:05.377470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a7c0d5-b695-44bb-af56-2a9e7affb80e service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:05.385026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0554e2e-8c29-4986-a0e5-9cb1a6c005fe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:05.386667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0554e2e-8c29-4986-a0e5-9cb1a6c005fe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:05.386980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0554e2e-8c29-4986-a0e5-9cb1a6c005fe admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:05.387253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0554e2e-8c29-4986-a0e5-9cb1a6c005fe admin admin] PATH_INFO: `/v3/users/b2d13c401ad84870a8d76d49a8054056` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:05.388714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0554e2e-8c29-4986-a0e5-9cb1a6c005fe admin admin] RBAC: Authorizing `identity:delete_user(user_id=b2d13c401ad84870a8d76d49a8054056)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:05.391164 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0554e2e-8c29-4986-a0e5-9cb1a6c005fe admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:05.467074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0554e2e-8c29-4986-a0e5-9cb1a6c005fe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'b2d13c401ad84870a8d76d49a8054056'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:05.467822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0554e2e-8c29-4986-a0e5-9cb1a6c005fe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'b2d13c401ad84870a8d76d49a8054056'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:05.471583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:DELETE=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:05.484852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0554e2e-8c29-4986-a0e5-9cb1a6c005fe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'b2d13c401ad84870a8d76d49a8054056'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:05.485655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0554e2e-8c29-4986-a0e5-9cb1a6c005fe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'b2d13c401ad84870a8d76d49a8054056'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:05.504809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f0554e2e-8c29-4986-a0e5-9cb1a6c005fe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'b2d13c401ad84870a8d76d49a8054056'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:05.519305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1250/2457] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:05 2022] DELETE /identity/v3/users/b2d13c401ad84870a8d76d49a8054056 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:05.748940 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51f822-3440-41d4-ad68-3c179f96f771 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:05.764587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f51f822-3440-41d4-ad68-3c179f96f771 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:05.792372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:05.927534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abc076b5-7150-4caf-a365-9161de156739 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:05.928671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc076b5-7150-4caf-a365-9161de156739 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:05.929835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc076b5-7150-4caf-a365-9161de156739 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:05.930324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abc076b5-7150-4caf-a365-9161de156739 admin admin] PATH_INFO: `/v3/projects/be2b13dd00dd45e3aae6a231b8e60a1c` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:05.931782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc076b5-7150-4caf-a365-9161de156739 admin admin] RBAC: Authorizing `identity:delete_project(project_id=be2b13dd00dd45e3aae6a231b8e60a1c)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:05.933777 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abc076b5-7150-4caf-a365-9161de156739 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:06.040802 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-abc076b5-7150-4caf-a365-9161de156739 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'be2b13dd00dd45e3aae6a231b8e60a1c', 'request_id': 'req-abc076b5-7150-4caf-a365-9161de156739'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:06.054763 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-abc076b5-7150-4caf-a365-9161de156739 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'be2b13dd00dd45e3aae6a231b8e60a1c', 'request_id': 'req-abc076b5-7150-4caf-a365-9161de156739'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:06.062790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-abc076b5-7150-4caf-a365-9161de156739 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'be2b13dd00dd45e3aae6a231b8e60a1c', 'request_id': 'req-abc076b5-7150-4caf-a365-9161de156739'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:06.076260 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-abc076b5-7150-4caf-a365-9161de156739 admin admin] The token cache is being invalidate because project be2b13dd00dd45e3aae6a231b8e60a1c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:06.076554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-abc076b5-7150-4caf-a365-9161de156739 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:06.077771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-abc076b5-7150-4caf-a365-9161de156739 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:06.082685 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1208/2458] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:05 2022] DELETE /identity/v3/projects/be2b13dd00dd45e3aae6a231b8e60a1c => generated 0 bytes in 331 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:06.085086 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829531b-b378-41f1-92c9-2b5195bc089a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:06.085569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829531b-b378-41f1-92c9-2b5195bc089a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:06.086119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8829531b-b378-41f1-92c9-2b5195bc089a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:06.116127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8829531b-b378-41f1-92c9-2b5195bc089a None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:06.116789 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8829531b-b378-41f1-92c9-2b5195bc089a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:06.274244 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f95aeb-dc7e-415c-86e9-c39699777685 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:06.274740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f95aeb-dc7e-415c-86e9-c39699777685 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:06.275120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f95aeb-dc7e-415c-86e9-c39699777685 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:06.279035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1251/2459] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:06.300698 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d6f95aeb-dc7e-415c-86e9-c39699777685 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:06.303323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d6f95aeb-dc7e-415c-86e9-c39699777685 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:06.325412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1209/2460] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:06 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 52 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:06.330801 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829531b-b378-41f1-92c9-2b5195bc089a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:06.341711 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8829531b-b378-41f1-92c9-2b5195bc089a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:06.347657 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2539e6-8174-479e-a5c6-6bbbafbbd0aa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:06.348543 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2539e6-8174-479e-a5c6-6bbbafbbd0aa admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:06.348691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2539e6-8174-479e-a5c6-6bbbafbbd0aa admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:06.349149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b2539e6-8174-479e-a5c6-6bbbafbbd0aa admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:06.350264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2539e6-8174-479e-a5c6-6bbbafbbd0aa admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:30:06.350565 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2539e6-8174-479e-a5c6-6bbbafbbd0aa admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:06.352268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b2539e6-8174-479e-a5c6-6bbbafbbd0aa admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:06.368762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1252/2461] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:30:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 51 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:30:06.370375 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f95aeb-dc7e-415c-86e9-c39699777685 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:06.394858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f95aeb-dc7e-415c-86e9-c39699777685 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:06.400819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93871351-9604-49cc-9d8a-a5cd02a79fa1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:06.401518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871351-9604-49cc-9d8a-a5cd02a79fa1 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:06.401797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871351-9604-49cc-9d8a-a5cd02a79fa1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:06.402193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93871351-9604-49cc-9d8a-a5cd02a79fa1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:06.402904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93871351-9604-49cc-9d8a-a5cd02a79fa1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:06.405736 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93871351-9604-49cc-9d8a-a5cd02a79fa1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:06.474067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1210/2462] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:06 2022] POST /identity/v3/projects => generated 365 bytes in 105 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:30:06.478097 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2539e6-8174-479e-a5c6-6bbbafbbd0aa admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:06.494816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b2539e6-8174-479e-a5c6-6bbbafbbd0aa admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:06.598514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b911d9-eae3-4c22-88a4-cb657179c268 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:06.599210 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b911d9-eae3-4c22-88a4-cb657179c268 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:06.601126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b911d9-eae3-4c22-88a4-cb657179c268 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:06.601272 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99b911d9-eae3-4c22-88a4-cb657179c268 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:06.601950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b911d9-eae3-4c22-88a4-cb657179c268 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:06.605106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99b911d9-eae3-4c22-88a4-cb657179c268 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:06.654107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1253/2463] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:06 2022] POST /identity/v3/users => generated 283 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:06.657174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93871351-9604-49cc-9d8a-a5cd02a79fa1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:06.668490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93871351-9604-49cc-9d8a-a5cd02a79fa1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:06.681446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d406e53-383a-4adb-be7f-7c631269b203 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:06.682527 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d406e53-383a-4adb-be7f-7c631269b203 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:06.683060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d406e53-383a-4adb-be7f-7c631269b203 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:06.683548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d406e53-383a-4adb-be7f-7c631269b203 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:06.684670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d406e53-383a-4adb-be7f-7c631269b203 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:06.687796 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d406e53-383a-4adb-be7f-7c631269b203 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:06.702845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1211/2464] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 46 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:06.706989 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b911d9-eae3-4c22-88a4-cb657179c268 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:06.727529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99b911d9-eae3-4c22-88a4-cb657179c268 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:06.732580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b64e18c7-ef14-4ace-a433-cf82ae49f967 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:06.733914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e18c7-ef14-4ace-a433-cf82ae49f967 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:06.734046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e18c7-ef14-4ace-a433-cf82ae49f967 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:06.734292 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b64e18c7-ef14-4ace-a433-cf82ae49f967 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:06.735028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e18c7-ef14-4ace-a433-cf82ae49f967 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:06.736656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b64e18c7-ef14-4ace-a433-cf82ae49f967 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:06.768361 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1254/2465] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:06 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:06.772368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d406e53-383a-4adb-be7f-7c631269b203 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:06.785164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d406e53-383a-4adb-be7f-7c631269b203 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:06.797833 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07924247-5b32-4fda-99a4-79fc3b854aca admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:06.798752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07924247-5b32-4fda-99a4-79fc3b854aca admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:06.799030 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07924247-5b32-4fda-99a4-79fc3b854aca admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:06.799304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07924247-5b32-4fda-99a4-79fc3b854aca admin admin] PATH_INFO: `/v3/projects/cd36b00712794584b9384a294f18317c/users/d95b8f598e094663a834dfe445139569/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:06.836412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07924247-5b32-4fda-99a4-79fc3b854aca admin admin] RBAC: Authorizing `identity:create_grant(project_id=cd36b00712794584b9384a294f18317c, user_id=d95b8f598e094663a834dfe445139569, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:06.842975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07924247-5b32-4fda-99a4-79fc3b854aca admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:06.883488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1212/2466] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:06 2022] PUT /identity/v3/projects/cd36b00712794584b9384a294f18317c/users/d95b8f598e094663a834dfe445139569/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:06.884628 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a506bd8-1d8f-4072-9fc5-7bdbc8788afe None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:06.885281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a506bd8-1d8f-4072-9fc5-7bdbc8788afe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:06.887423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a506bd8-1d8f-4072-9fc5-7bdbc8788afe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:06.944162 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-0a506bd8-1d8f-4072-9fc5-7bdbc8788afe None None] MFA Rules not processed for user `d95b8f598e094663a834dfe445139569`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:06.945884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0a506bd8-1d8f-4072-9fc5-7bdbc8788afe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:06.984839 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:DELETE=3,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:07.083959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1255/2467] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:06 2022] POST /identity/v3/auth/tokens => generated 3232 bytes in 201 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:07.091613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07924247-5b32-4fda-99a4-79fc3b854aca admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:07.140882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:07.178594 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07924247-5b32-4fda-99a4-79fc3b854aca admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:07.186981 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f2da2-7aac-4b36-8a4d-d092e5009287 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:07.187665 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f2da2-7aac-4b36-8a4d-d092e5009287 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:07.187948 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f2da2-7aac-4b36-8a4d-d092e5009287 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:07.188226 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb2f2da2-7aac-4b36-8a4d-d092e5009287 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:07.189063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f2da2-7aac-4b36-8a4d-d092e5009287 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:07.191302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb2f2da2-7aac-4b36-8a4d-d092e5009287 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:07.228153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1213/2468] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:07 2022] POST /identity/v3/projects => generated 365 bytes in 139 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:07.232621 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a506bd8-1d8f-4072-9fc5-7bdbc8788afe None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:07.245837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a506bd8-1d8f-4072-9fc5-7bdbc8788afe None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:07.324005 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4a759-e951-4a7e-8ea4-487072ee8955 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:07.325529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4a759-e951-4a7e-8ea4-487072ee8955 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:07.326027 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4a759-e951-4a7e-8ea4-487072ee8955 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:07.326591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fa4a759-e951-4a7e-8ea4-487072ee8955 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:07.328340 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4a759-e951-4a7e-8ea4-487072ee8955 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:07.337195 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fa4a759-e951-4a7e-8ea4-487072ee8955 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:07.389962 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1256/2469] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:07 2022] POST /identity/v3/users => generated 289 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:30:07.394304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f2da2-7aac-4b36-8a4d-d092e5009287 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:07.405134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb2f2da2-7aac-4b36-8a4d-d092e5009287 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:07.426430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58f6e8-fe60-4523-bf1a-53be10ea3dbb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:07.427131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58f6e8-fe60-4523-bf1a-53be10ea3dbb admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:07.427418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58f6e8-fe60-4523-bf1a-53be10ea3dbb admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:07.427702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e58f6e8-fe60-4523-bf1a-53be10ea3dbb admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:07.428446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58f6e8-fe60-4523-bf1a-53be10ea3dbb admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:07.430144 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e58f6e8-fe60-4523-bf1a-53be10ea3dbb admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:07.450324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1214/2470] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 56 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:07.451231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4a759-e951-4a7e-8ea4-487072ee8955 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:07.477680 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fa4a759-e951-4a7e-8ea4-487072ee8955 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:07.491542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b561ed9-f332-478b-9e8a-8fd085b3b4df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:07.491763 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b561ed9-f332-478b-9e8a-8fd085b3b4df admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:07.492220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b561ed9-f332-478b-9e8a-8fd085b3b4df admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:07.497307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b561ed9-f332-478b-9e8a-8fd085b3b4df admin admin] PATH_INFO: `/v3/projects/ff47cb0ecd1f4880927326968612a777/users/a03d6b38ae134bf981b3de6fdc0eda7b/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:07.520578 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b561ed9-f332-478b-9e8a-8fd085b3b4df admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff47cb0ecd1f4880927326968612a777, user_id=a03d6b38ae134bf981b3de6fdc0eda7b, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:07.522900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b561ed9-f332-478b-9e8a-8fd085b3b4df admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:07.569487 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1257/2471] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:07 2022] PUT /identity/v3/projects/ff47cb0ecd1f4880927326968612a777/users/a03d6b38ae134bf981b3de6fdc0eda7b/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:07.570991 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58f6e8-fe60-4523-bf1a-53be10ea3dbb admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:07.588962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e58f6e8-fe60-4523-bf1a-53be10ea3dbb admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:07.667142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a40b783b-dcaf-4c50-b444-54865526fd92 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:07.668168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b783b-dcaf-4c50-b444-54865526fd92 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:07.668461 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b783b-dcaf-4c50-b444-54865526fd92 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:07.668868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a40b783b-dcaf-4c50-b444-54865526fd92 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:07.673281 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b783b-dcaf-4c50-b444-54865526fd92 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:07.675418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a40b783b-dcaf-4c50-b444-54865526fd92 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:07.699496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1215/2472] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:07 2022] GET /identity/v3/roles => generated 1420 bytes in 129 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:07.703752 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b561ed9-f332-478b-9e8a-8fd085b3b4df admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:07.721225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b561ed9-f332-478b-9e8a-8fd085b3b4df admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:07.734797 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191c246-5763-402e-8da0-9caea82df7d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:07.736136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191c246-5763-402e-8da0-9caea82df7d1 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:07.736630 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191c246-5763-402e-8da0-9caea82df7d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:07.737215 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b191c246-5763-402e-8da0-9caea82df7d1 admin admin] PATH_INFO: `/v3/projects/ff47cb0ecd1f4880927326968612a777/users/a03d6b38ae134bf981b3de6fdc0eda7b/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:07.740056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191c246-5763-402e-8da0-9caea82df7d1 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff47cb0ecd1f4880927326968612a777, user_id=a03d6b38ae134bf981b3de6fdc0eda7b, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:07.743838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b191c246-5763-402e-8da0-9caea82df7d1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:07.762265 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1258/2473] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:07 2022] PUT /identity/v3/projects/ff47cb0ecd1f4880927326968612a777/users/a03d6b38ae134bf981b3de6fdc0eda7b/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:07.772481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1fcb1-d41d-4149-bcd7-4e0491515bc4 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:07.773184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1fcb1-d41d-4149-bcd7-4e0491515bc4 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:07.773184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25d1fcb1-d41d-4149-bcd7-4e0491515bc4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:07.807316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-25d1fcb1-d41d-4149-bcd7-4e0491515bc4 None None] MFA Rules not processed for user `a03d6b38ae134bf981b3de6fdc0eda7b`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:07.808572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-25d1fcb1-d41d-4149-bcd7-4e0491515bc4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:07.978285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1216/2474] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:07 2022] POST /identity/v3/auth/tokens => generated 3299 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:07.993406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191c246-5763-402e-8da0-9caea82df7d1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:07.995698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b191c246-5763-402e-8da0-9caea82df7d1 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:08.100936 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b191c246-5763-402e-8da0-9caea82df7d1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:08.108470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dd1ed-cd77-4692-b245-92bc88a09467 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:08.109288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dd1ed-cd77-4692-b245-92bc88a09467 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:08.109632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dd1ed-cd77-4692-b245-92bc88a09467 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:08.109982 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5dd1ed-cd77-4692-b245-92bc88a09467 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:08.121390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5dd1ed-cd77-4692-b245-92bc88a09467 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:08.122939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5dd1ed-cd77-4692-b245-92bc88a09467 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:08.137412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1259/2475] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:07 2022] GET /identity/v3/auth/tokens => generated 3299 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:08.294678 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1fcb1-d41d-4149-bcd7-4e0491515bc4 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:08.316041 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25d1fcb1-d41d-4149-bcd7-4e0491515bc4 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:08.327236 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f87d5-ddb0-4b6f-9f12-2b59a8f38932 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:08.328188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f87d5-ddb0-4b6f-9f12-2b59a8f38932 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:08.328669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f87d5-ddb0-4b6f-9f12-2b59a8f38932 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:08.328972 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f3f87d5-ddb0-4b6f-9f12-2b59a8f38932 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:08.369117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:08.422139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f87d5-ddb0-4b6f-9f12-2b59a8f38932 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:08.425523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f3f87d5-ddb0-4b6f-9f12-2b59a8f38932 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:08.438607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1217/2476] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:08 2022] GET /identity/v3/auth/tokens => generated 3232 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:08.918737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dd1ed-cd77-4692-b245-92bc88a09467 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:08.921657 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8e5dd1ed-cd77-4692-b245-92bc88a09467 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:08.955843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:09.014629 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5dd1ed-cd77-4692-b245-92bc88a09467 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:09.022666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0b84db-64e6-4876-8bfe-57053d149176 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:09.023393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b84db-64e6-4876-8bfe-57053d149176 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:09.023903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b84db-64e6-4876-8bfe-57053d149176 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:09.024288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0b84db-64e6-4876-8bfe-57053d149176 admin admin] PATH_INFO: `/v3/users/4f1948e8724647bd893015835a50d8db` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:09.025646 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b84db-64e6-4876-8bfe-57053d149176 admin admin] RBAC: Authorizing `identity:delete_user(user_id=4f1948e8724647bd893015835a50d8db)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:09.027727 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0b84db-64e6-4876-8bfe-57053d149176 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:09.095218 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2d0b84db-64e6-4876-8bfe-57053d149176 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4f1948e8724647bd893015835a50d8db'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:09.095983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2d0b84db-64e6-4876-8bfe-57053d149176 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4f1948e8724647bd893015835a50d8db'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:09.105458 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2d0b84db-64e6-4876-8bfe-57053d149176 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4f1948e8724647bd893015835a50d8db'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:09.106239 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2d0b84db-64e6-4876-8bfe-57053d149176 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4f1948e8724647bd893015835a50d8db'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:09.121494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-2d0b84db-64e6-4876-8bfe-57053d149176 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4f1948e8724647bd893015835a50d8db'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:09.134877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1260/2477] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:08 2022] DELETE /identity/v3/users/4f1948e8724647bd893015835a50d8db => generated 0 bytes in 217 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:09.346826 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f87d5-ddb0-4b6f-9f12-2b59a8f38932 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:09.369138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f3f87d5-ddb0-4b6f-9f12-2b59a8f38932 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:09.439866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:09.440858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:09.441242 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:09.441623 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3 admin admin] PATH_INFO: `/v3/projects/0d44a99c284744069fb1f97f9c9649f0` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:09.442881 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d44a99c284744069fb1f97f9c9649f0)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:09.444913 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:09.491076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d44a99c284744069fb1f97f9c9649f0', 'request_id': 'req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:09.498455 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d44a99c284744069fb1f97f9c9649f0', 'request_id': 'req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:09.504418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d44a99c284744069fb1f97f9c9649f0', 'request_id': 'req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:09.517657 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3 admin admin] The token cache is being invalidate because project 0d44a99c284744069fb1f97f9c9649f0 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:09.518008 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:09.518775 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9b34a4a8-e6b4-4db9-9f5b-859081388ce3 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:09.520756 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1218/2478] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:09 2022] DELETE /identity/v3/projects/0d44a99c284744069fb1f97f9c9649f0 => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:09.525377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6421fa-6953-42b3-8f31-c2b44e585a0f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:09.525753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6421fa-6953-42b3-8f31-c2b44e585a0f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:09.525966 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad6421fa-6953-42b3-8f31-c2b44e585a0f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:09.546496 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-ad6421fa-6953-42b3-8f31-c2b44e585a0f None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:09.547838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ad6421fa-6953-42b3-8f31-c2b44e585a0f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:09.612568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1261/2479] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:09.620890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11eca5-cd24-4858-b7ae-271cdd682e35 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:09.621219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11eca5-cd24-4858-b7ae-271cdd682e35 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:09.621523 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b11eca5-cd24-4858-b7ae-271cdd682e35 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:09.642798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0b11eca5-cd24-4858-b7ae-271cdd682e35 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:09.644164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0b11eca5-cd24-4858-b7ae-271cdd682e35 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:09.652641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1219/2480] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:09.659257 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6421fa-6953-42b3-8f31-c2b44e585a0f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:09.670056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad6421fa-6953-42b3-8f31-c2b44e585a0f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:09.675408 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda35638-fdb4-449b-bc6a-36c9a685249f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:09.676145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda35638-fdb4-449b-bc6a-36c9a685249f admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:09.676506 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda35638-fdb4-449b-bc6a-36c9a685249f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:09.676859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dda35638-fdb4-449b-bc6a-36c9a685249f admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:09.677691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda35638-fdb4-449b-bc6a-36c9a685249f admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:30:09.678075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda35638-fdb4-449b-bc6a-36c9a685249f admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:09.682605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dda35638-fdb4-449b-bc6a-36c9a685249f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:09.700079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1262/2481] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:30:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 41 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:30:09.700811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11eca5-cd24-4858-b7ae-271cdd682e35 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:09.714511 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b11eca5-cd24-4858-b7ae-271cdd682e35 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:09.721650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34de2c-3319-4dbd-a8fc-e3a530e992f3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:09.722432 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34de2c-3319-4dbd-a8fc-e3a530e992f3 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:09.722810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34de2c-3319-4dbd-a8fc-e3a530e992f3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:09.723179 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c34de2c-3319-4dbd-a8fc-e3a530e992f3 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:09.723971 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34de2c-3319-4dbd-a8fc-e3a530e992f3 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:09.726378 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c34de2c-3319-4dbd-a8fc-e3a530e992f3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:09.777476 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1220/2482] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:09 2022] POST /identity/v3/projects => generated 373 bytes in 77 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:09.781890 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda35638-fdb4-449b-bc6a-36c9a685249f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:09.805125 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dda35638-fdb4-449b-bc6a-36c9a685249f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:09.845635 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:09.906952 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546fcb8-b594-493b-8581-86255a5ec092 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:09.907699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546fcb8-b594-493b-8581-86255a5ec092 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:09.907983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546fcb8-b594-493b-8581-86255a5ec092 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:09.908248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b546fcb8-b594-493b-8581-86255a5ec092 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:09.909108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546fcb8-b594-493b-8581-86255a5ec092 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:09.911134 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b546fcb8-b594-493b-8581-86255a5ec092 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:09.940648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1263/2483] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:09 2022] POST /identity/v3/users => generated 287 bytes in 157 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:09.942453 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34de2c-3319-4dbd-a8fc-e3a530e992f3 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:09.953601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c34de2c-3319-4dbd-a8fc-e3a530e992f3 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:09.959348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49294fd-3765-444e-aa34-9bac0cab4e96 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:09.971854 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49294fd-3765-444e-aa34-9bac0cab4e96 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:09.973336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49294fd-3765-444e-aa34-9bac0cab4e96 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:09.974290 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d49294fd-3765-444e-aa34-9bac0cab4e96 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:09.975335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49294fd-3765-444e-aa34-9bac0cab4e96 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:09.977454 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d49294fd-3765-444e-aa34-9bac0cab4e96 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:09.995058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1221/2484] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 50 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:09.996684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546fcb8-b594-493b-8581-86255a5ec092 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:10.008852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b546fcb8-b594-493b-8581-86255a5ec092 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:10.014462 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e408ab8-1c84-4422-b574-c1b490a2f64a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:10.015738 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e408ab8-1c84-4422-b574-c1b490a2f64a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:10.016227 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e408ab8-1c84-4422-b574-c1b490a2f64a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:10.016683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e408ab8-1c84-4422-b574-c1b490a2f64a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:10.017602 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e408ab8-1c84-4422-b574-c1b490a2f64a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:10.019208 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e408ab8-1c84-4422-b574-c1b490a2f64a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:10.043568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1264/2485] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:09 2022] GET /identity/v3/roles => generated 1420 bytes in 47 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:10.048217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49294fd-3765-444e-aa34-9bac0cab4e96 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:10.064900 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d49294fd-3765-444e-aa34-9bac0cab4e96 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:10.071070 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92d06b-95a4-429f-b23c-8e3e49807904 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:10.071965 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92d06b-95a4-429f-b23c-8e3e49807904 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:10.072291 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92d06b-95a4-429f-b23c-8e3e49807904 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:10.072528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f92d06b-95a4-429f-b23c-8e3e49807904 admin admin] PATH_INFO: `/v3/projects/44c82a7dc77540a7bf4b8e64457e14cd/users/a79e4ea941714798a388a7fb64056f15/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:10.090563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92d06b-95a4-429f-b23c-8e3e49807904 admin admin] RBAC: Authorizing `identity:create_grant(project_id=44c82a7dc77540a7bf4b8e64457e14cd, user_id=a79e4ea941714798a388a7fb64056f15, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:10.094258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f92d06b-95a4-429f-b23c-8e3e49807904 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:10.097878 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:10.126843 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1222/2486] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:10 2022] PUT /identity/v3/projects/44c82a7dc77540a7bf4b8e64457e14cd/users/a79e4ea941714798a388a7fb64056f15/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:10.129054 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b35cc9-58d1-4594-a83a-850e0be7867a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:10.129351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b35cc9-58d1-4594-a83a-850e0be7867a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:10.129733 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59b35cc9-58d1-4594-a83a-850e0be7867a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:10.186107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-59b35cc9-58d1-4594-a83a-850e0be7867a None None] MFA Rules not processed for user `a79e4ea941714798a388a7fb64056f15`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:10.187310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-59b35cc9-58d1-4594-a83a-850e0be7867a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:10.309358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1265/2487] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:10.318964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92d06b-95a4-429f-b23c-8e3e49807904 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:10.408215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f92d06b-95a4-429f-b23c-8e3e49807904 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:10.412792 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2218f3-b71f-42bd-be89-c82bc8d1c0da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:10.413482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2218f3-b71f-42bd-be89-c82bc8d1c0da admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:10.413784 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2218f3-b71f-42bd-be89-c82bc8d1c0da admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:10.414065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea2218f3-b71f-42bd-be89-c82bc8d1c0da admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:10.414751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2218f3-b71f-42bd-be89-c82bc8d1c0da admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:10.416881 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea2218f3-b71f-42bd-be89-c82bc8d1c0da admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:10.464380 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1223/2488] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:10 2022] POST /identity/v3/projects => generated 371 bytes in 146 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:10.470007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b35cc9-58d1-4594-a83a-850e0be7867a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:10.481644 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59b35cc9-58d1-4594-a83a-850e0be7867a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:10.547376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bc7b4-5830-4a5e-94b3-1dae6a10a8dd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:10.548065 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bc7b4-5830-4a5e-94b3-1dae6a10a8dd admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:10.548352 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bc7b4-5830-4a5e-94b3-1dae6a10a8dd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:10.548631 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3bc7b4-5830-4a5e-94b3-1dae6a10a8dd admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:10.549401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bc7b4-5830-4a5e-94b3-1dae6a10a8dd admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:10.551351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3bc7b4-5830-4a5e-94b3-1dae6a10a8dd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:10.574549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1266/2489] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:10 2022] POST /identity/v3/users => generated 292 bytes in 102 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:30:10.575743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2218f3-b71f-42bd-be89-c82bc8d1c0da admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:10.586828 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea2218f3-b71f-42bd-be89-c82bc8d1c0da admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:10.591841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4d8b6-d511-44a3-9eb6-33a4d8f87d57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:10.593214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4d8b6-d511-44a3-9eb6-33a4d8f87d57 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:10.593499 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4d8b6-d511-44a3-9eb6-33a4d8f87d57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:10.593776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ef4d8b6-d511-44a3-9eb6-33a4d8f87d57 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:10.594498 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4d8b6-d511-44a3-9eb6-33a4d8f87d57 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:10.596095 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ef4d8b6-d511-44a3-9eb6-33a4d8f87d57 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:10.606419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1224/2490] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:10.610378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bc7b4-5830-4a5e-94b3-1dae6a10a8dd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:10.620205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3bc7b4-5830-4a5e-94b3-1dae6a10a8dd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:10.625115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480273e-7e4a-4d41-8a49-9e7dc0e7c5f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:10.626109 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480273e-7e4a-4d41-8a49-9e7dc0e7c5f9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:10.626274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480273e-7e4a-4d41-8a49-9e7dc0e7c5f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:10.626548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2480273e-7e4a-4d41-8a49-9e7dc0e7c5f9 admin admin] PATH_INFO: `/v3/projects/8b6ada11f4a34e87970047f1dff6f066/users/c303ece7a9f248a8b365dc554b49526b/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:10.653301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480273e-7e4a-4d41-8a49-9e7dc0e7c5f9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b6ada11f4a34e87970047f1dff6f066, user_id=c303ece7a9f248a8b365dc554b49526b, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:10.656590 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2480273e-7e4a-4d41-8a49-9e7dc0e7c5f9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:10.665063 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:10.672378 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1267/2491] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:10 2022] PUT /identity/v3/projects/8b6ada11f4a34e87970047f1dff6f066/users/c303ece7a9f248a8b365dc554b49526b/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 62 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:10.676402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4d8b6-d511-44a3-9eb6-33a4d8f87d57 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:10.687597 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ef4d8b6-d511-44a3-9eb6-33a4d8f87d57 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:10.750008 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-182166e7-8d48-47fe-acef-e25eed4b0965 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:10.750742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182166e7-8d48-47fe-acef-e25eed4b0965 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:10.751025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182166e7-8d48-47fe-acef-e25eed4b0965 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:10.751302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-182166e7-8d48-47fe-acef-e25eed4b0965 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:10.752022 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182166e7-8d48-47fe-acef-e25eed4b0965 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:10.754282 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-182166e7-8d48-47fe-acef-e25eed4b0965 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:10.763660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1225/2492] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:10 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:10.768450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480273e-7e4a-4d41-8a49-9e7dc0e7c5f9 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:10.778874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2480273e-7e4a-4d41-8a49-9e7dc0e7c5f9 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:10.784087 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb2c72-2276-465e-a4dd-a7fa0527c339 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:10.784971 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb2c72-2276-465e-a4dd-a7fa0527c339 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:10.785290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb2c72-2276-465e-a4dd-a7fa0527c339 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:10.785569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71fb2c72-2276-465e-a4dd-a7fa0527c339 admin admin] PATH_INFO: `/v3/projects/8b6ada11f4a34e87970047f1dff6f066/users/c303ece7a9f248a8b365dc554b49526b/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:10.787684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb2c72-2276-465e-a4dd-a7fa0527c339 admin admin] RBAC: Authorizing `identity:create_grant(project_id=8b6ada11f4a34e87970047f1dff6f066, user_id=c303ece7a9f248a8b365dc554b49526b, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:10.790446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71fb2c72-2276-465e-a4dd-a7fa0527c339 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:10.802163 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1268/2493] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:10 2022] PUT /identity/v3/projects/8b6ada11f4a34e87970047f1dff6f066/users/c303ece7a9f248a8b365dc554b49526b/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:10.812447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7e991-8d87-411f-a0f1-9bcdedde7871 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:10.812739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7e991-8d87-411f-a0f1-9bcdedde7871 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:10.813082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffe7e991-8d87-411f-a0f1-9bcdedde7871 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:10.848816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ffe7e991-8d87-411f-a0f1-9bcdedde7871 None None] MFA Rules not processed for user `c303ece7a9f248a8b365dc554b49526b`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:10.850066 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ffe7e991-8d87-411f-a0f1-9bcdedde7871 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:10.900554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:10.919546 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1226/2494] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:10 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:10.930649 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb2c72-2276-465e-a4dd-a7fa0527c339 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:10.932341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-71fb2c72-2276-465e-a4dd-a7fa0527c339 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:10.988374 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71fb2c72-2276-465e-a4dd-a7fa0527c339 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:10.991974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110155b-d943-479a-a06e-17687ce63c54 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:10.992586 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110155b-d943-479a-a06e-17687ce63c54 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:10.992867 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110155b-d943-479a-a06e-17687ce63c54 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:10.993174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1110155b-d943-479a-a06e-17687ce63c54 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:11.002499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110155b-d943-479a-a06e-17687ce63c54 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:11.003913 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1110155b-d943-479a-a06e-17687ce63c54 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:11.013250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1269/2495] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:10 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:11.392333 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7e991-8d87-411f-a0f1-9bcdedde7871 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:11.469235 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffe7e991-8d87-411f-a0f1-9bcdedde7871 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:11.477337 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc971c59-4c1c-4b6e-8406-39984323ad2a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:11.478454 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc971c59-4c1c-4b6e-8406-39984323ad2a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:11.478823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc971c59-4c1c-4b6e-8406-39984323ad2a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:11.479100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc971c59-4c1c-4b6e-8406-39984323ad2a admin admin] PATH_INFO: `/v3/users/a79e4ea941714798a388a7fb64056f15` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:11.480348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc971c59-4c1c-4b6e-8406-39984323ad2a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a79e4ea941714798a388a7fb64056f15)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:11.482321 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc971c59-4c1c-4b6e-8406-39984323ad2a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:11.562588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bc971c59-4c1c-4b6e-8406-39984323ad2a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a79e4ea941714798a388a7fb64056f15'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:11.572347 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bc971c59-4c1c-4b6e-8406-39984323ad2a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a79e4ea941714798a388a7fb64056f15'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:11.573625 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bc971c59-4c1c-4b6e-8406-39984323ad2a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a79e4ea941714798a388a7fb64056f15'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:11.590147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bc971c59-4c1c-4b6e-8406-39984323ad2a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a79e4ea941714798a388a7fb64056f15'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:11.613224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110155b-d943-479a-a06e-17687ce63c54 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:11.614843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1110155b-d943-479a-a06e-17687ce63c54 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:11.616668 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bc971c59-4c1c-4b6e-8406-39984323ad2a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a79e4ea941714798a388a7fb64056f15'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:11.625374 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1227/2496] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:11 2022] DELETE /identity/v3/users/a79e4ea941714798a388a7fb64056f15 => generated 0 bytes in 234 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:11.630971 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6bf92-2d79-4b3a-995b-8d4d7854631d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:11.631450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6bf92-2d79-4b3a-995b-8d4d7854631d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:11.631968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cf6bf92-2d79-4b3a-995b-8d4d7854631d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:11.637412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1110155b-d943-479a-a06e-17687ce63c54 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:11.672870 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0cf6bf92-2d79-4b3a-995b-8d4d7854631d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:11.674981 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0cf6bf92-2d79-4b3a-995b-8d4d7854631d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:11.734069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865f51de-7729-4009-96ee-e156e62b0d63 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:11.735260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f51de-7729-4009-96ee-e156e62b0d63 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:11.735998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f51de-7729-4009-96ee-e156e62b0d63 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:11.736377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865f51de-7729-4009-96ee-e156e62b0d63 admin admin] PATH_INFO: `/v3/users/d95b8f598e094663a834dfe445139569` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:11.738355 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f51de-7729-4009-96ee-e156e62b0d63 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d95b8f598e094663a834dfe445139569)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:11.740346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865f51de-7729-4009-96ee-e156e62b0d63 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:11.755338 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1228/2497] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 126 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:11.766241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6bf92-2d79-4b3a-995b-8d4d7854631d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:11.767707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0cf6bf92-2d79-4b3a-995b-8d4d7854631d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:11.784141 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:11.798572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-865f51de-7729-4009-96ee-e156e62b0d63 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd95b8f598e094663a834dfe445139569'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:11.799692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-865f51de-7729-4009-96ee-e156e62b0d63 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd95b8f598e094663a834dfe445139569'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:11.808407 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-865f51de-7729-4009-96ee-e156e62b0d63 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd95b8f598e094663a834dfe445139569'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:11.808960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-865f51de-7729-4009-96ee-e156e62b0d63 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd95b8f598e094663a834dfe445139569'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:11.826418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-865f51de-7729-4009-96ee-e156e62b0d63 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd95b8f598e094663a834dfe445139569'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:11.840137 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1270/2498] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:11 2022] DELETE /identity/v3/users/d95b8f598e094663a834dfe445139569 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:11.840737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cf6bf92-2d79-4b3a-995b-8d4d7854631d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:11.844875 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d39ac-ad6d-44a9-83c0-3f77c74d97fe None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:11.845197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d39ac-ad6d-44a9-83c0-3f77c74d97fe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:11.845486 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b02d39ac-ad6d-44a9-83c0-3f77c74d97fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:11.857004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=88,keystone:INSERT=2,keystone:DELETE=10 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:11.865061 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b02d39ac-ad6d-44a9-83c0-3f77c74d97fe None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:11.866882 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b02d39ac-ad6d-44a9-83c0-3f77c74d97fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:11.897350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84634498-5995-434c-b797-21133af2c465 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:11.898033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84634498-5995-434c-b797-21133af2c465 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:11.898311 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84634498-5995-434c-b797-21133af2c465 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:11.898596 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84634498-5995-434c-b797-21133af2c465 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:11.900439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-84634498-5995-434c-b797-21133af2c465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:11.928689 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1271/2499] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:11.938189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d39ac-ad6d-44a9-83c0-3f77c74d97fe None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:11.939599 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b02d39ac-ad6d-44a9-83c0-3f77c74d97fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:11.951219 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b02d39ac-ad6d-44a9-83c0-3f77c74d97fe None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:11.955362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4081f7-789d-4b98-9ad5-be546f8f5d7b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:11.955998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4081f7-789d-4b98-9ad5-be546f8f5d7b service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:11.956279 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4081f7-789d-4b98-9ad5-be546f8f5d7b service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:11.956555 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a4081f7-789d-4b98-9ad5-be546f8f5d7b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:11.964852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84634498-5995-434c-b797-21133af2c465 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:11.965933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4081f7-789d-4b98-9ad5-be546f8f5d7b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:11.966324 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84634498-5995-434c-b797-21133af2c465 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:11.968024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a4081f7-789d-4b98-9ad5-be546f8f5d7b service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:11.976344 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1229/2500] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 211 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:30:11.977771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1272/2501] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:11 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:30:12.264406 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84634498-5995-434c-b797-21133af2c465 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:12.269334 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-84634498-5995-434c-b797-21133af2c465 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:12.270992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4081f7-789d-4b98-9ad5-be546f8f5d7b service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:12.272480 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3a4081f7-789d-4b98-9ad5-be546f8f5d7b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:12.281343 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84634498-5995-434c-b797-21133af2c465 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:12.286422 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:12.286902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a4081f7-789d-4b98-9ad5-be546f8f5d7b service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:12.287315 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:12.287600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:12.287901 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] PATH_INFO: `/v3/projects/44c82a7dc77540a7bf4b8e64457e14cd` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:12.289168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] RBAC: Authorizing `identity:delete_project(project_id=44c82a7dc77540a7bf4b8e64457e14cd)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:12.291238 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:12.292423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:12.293572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:12.293957 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:12.294382 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] PATH_INFO: `/v3/projects/cd36b00712794584b9384a294f18317c` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:12.295672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] RBAC: Authorizing `identity:delete_project(project_id=cd36b00712794584b9384a294f18317c)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:12.300301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:12.343299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '44c82a7dc77540a7bf4b8e64457e14cd', 'request_id': 'req-90f92b75-aa67-42c3-bac7-df99c06287da'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.351213 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '44c82a7dc77540a7bf4b8e64457e14cd', 'request_id': 'req-90f92b75-aa67-42c3-bac7-df99c06287da'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.356590 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cd36b00712794584b9384a294f18317c', 'request_id': 'req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.357282 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '44c82a7dc77540a7bf4b8e64457e14cd', 'request_id': 'req-90f92b75-aa67-42c3-bac7-df99c06287da'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.363945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cd36b00712794584b9384a294f18317c', 'request_id': 'req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.364976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:12.369237 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] The token cache is being invalidate because project 44c82a7dc77540a7bf4b8e64457e14cd was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:12.369758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.370871 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.371822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cd36b00712794584b9384a294f18317c', 'request_id': 'req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.372703 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1230/2502] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:12 2022] DELETE /identity/v3/projects/44c82a7dc77540a7bf4b8e64457e14cd => generated 0 bytes in 109 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:12.376978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:12.379158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:12.386555 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] The token cache is being invalidate because project cd36b00712794584b9384a294f18317c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:12.386842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.387493 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.392967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1273/2503] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:12 2022] DELETE /identity/v3/projects/cd36b00712794584b9384a294f18317c => generated 0 bytes in 120 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:12.393614 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:12.395013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:12.448905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90f92b75-aa67-42c3-bac7-df99c06287da admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:12.454724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0a1ac-f087-4123-bdaa-a54ecea18717 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:12.455754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0a1ac-f087-4123-bdaa-a54ecea18717 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:12.456552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0a1ac-f087-4123-bdaa-a54ecea18717 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:12.456964 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5e0a1ac-f087-4123-bdaa-a54ecea18717 admin admin] PATH_INFO: `/v3/users/c303ece7a9f248a8b365dc554b49526b` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:12.458196 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0a1ac-f087-4123-bdaa-a54ecea18717 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c303ece7a9f248a8b365dc554b49526b)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:12.459571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82152aef-0f68-4dd9-8a76-b1a133b5c5cc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:12.460121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5e0a1ac-f087-4123-bdaa-a54ecea18717 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:12.464715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc2417-7a88-4a09-87c2-99436b9dd46a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:12.465769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2417-7a88-4a09-87c2-99436b9dd46a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:12.466053 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2417-7a88-4a09-87c2-99436b9dd46a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:12.466336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0bc2417-7a88-4a09-87c2-99436b9dd46a admin admin] PATH_INFO: `/v3/users/a03d6b38ae134bf981b3de6fdc0eda7b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:12.467533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc2417-7a88-4a09-87c2-99436b9dd46a admin admin] RBAC: Authorizing `identity:delete_user(user_id=a03d6b38ae134bf981b3de6fdc0eda7b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:12.469514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0bc2417-7a88-4a09-87c2-99436b9dd46a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:12.491509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=90,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:12.508671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d5e0a1ac-f087-4123-bdaa-a54ecea18717 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c303ece7a9f248a8b365dc554b49526b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.518722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d5e0a1ac-f087-4123-bdaa-a54ecea18717 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c303ece7a9f248a8b365dc554b49526b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.519496 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d5e0a1ac-f087-4123-bdaa-a54ecea18717 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c303ece7a9f248a8b365dc554b49526b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.520831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a0bc2417-7a88-4a09-87c2-99436b9dd46a admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'a03d6b38ae134bf981b3de6fdc0eda7b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.521532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a0bc2417-7a88-4a09-87c2-99436b9dd46a admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'a03d6b38ae134bf981b3de6fdc0eda7b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.528499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a0bc2417-7a88-4a09-87c2-99436b9dd46a admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'a03d6b38ae134bf981b3de6fdc0eda7b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.529176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a0bc2417-7a88-4a09-87c2-99436b9dd46a admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'a03d6b38ae134bf981b3de6fdc0eda7b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.531432 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d5e0a1ac-f087-4123-bdaa-a54ecea18717 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c303ece7a9f248a8b365dc554b49526b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.539604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d5e0a1ac-f087-4123-bdaa-a54ecea18717 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c303ece7a9f248a8b365dc554b49526b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.543441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a0bc2417-7a88-4a09-87c2-99436b9dd46a admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'a03d6b38ae134bf981b3de6fdc0eda7b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:12.546351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1231/2504] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:12 2022] DELETE /identity/v3/users/c303ece7a9f248a8b365dc554b49526b => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:12.558619 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1274/2505] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:12 2022] DELETE /identity/v3/users/a03d6b38ae134bf981b3de6fdc0eda7b => generated 0 bytes in 165 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:12.843868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0a1ac-f087-4123-bdaa-a54ecea18717 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:12.845521 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d5e0a1ac-f087-4123-bdaa-a54ecea18717 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:12.915384 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5e0a1ac-f087-4123-bdaa-a54ecea18717 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:12.924395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc2417-7a88-4a09-87c2-99436b9dd46a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:12.928406 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a0bc2417-7a88-4a09-87c2-99436b9dd46a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:12.950639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:12.989327 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c355aaea-9510-405b-b307-358b8495951c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:12.990319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355aaea-9510-405b-b307-358b8495951c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:12.990701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355aaea-9510-405b-b307-358b8495951c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:12.991073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c355aaea-9510-405b-b307-358b8495951c admin admin] PATH_INFO: `/v3/projects/8b6ada11f4a34e87970047f1dff6f066` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:12.992327 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355aaea-9510-405b-b307-358b8495951c admin admin] RBAC: Authorizing `identity:delete_project(project_id=8b6ada11f4a34e87970047f1dff6f066)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:12.994365 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c355aaea-9510-405b-b307-358b8495951c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.001647 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0bc2417-7a88-4a09-87c2-99436b9dd46a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.006569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b431a0aa-501a-461d-8301-04f032168b56 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.007437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431a0aa-501a-461d-8301-04f032168b56 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.007828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431a0aa-501a-461d-8301-04f032168b56 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.008110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b431a0aa-501a-461d-8301-04f032168b56 admin admin] PATH_INFO: `/v3/projects/ff47cb0ecd1f4880927326968612a777` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.009377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431a0aa-501a-461d-8301-04f032168b56 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff47cb0ecd1f4880927326968612a777)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.011230 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b431a0aa-501a-461d-8301-04f032168b56 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.041269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c355aaea-9510-405b-b307-358b8495951c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '8b6ada11f4a34e87970047f1dff6f066', 'request_id': 'req-c355aaea-9510-405b-b307-358b8495951c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:13.050736 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c355aaea-9510-405b-b307-358b8495951c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '8b6ada11f4a34e87970047f1dff6f066', 'request_id': 'req-c355aaea-9510-405b-b307-358b8495951c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:13.057372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c355aaea-9510-405b-b307-358b8495951c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '8b6ada11f4a34e87970047f1dff6f066', 'request_id': 'req-c355aaea-9510-405b-b307-358b8495951c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:13.060157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b431a0aa-501a-461d-8301-04f032168b56 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff47cb0ecd1f4880927326968612a777', 'request_id': 'req-b431a0aa-501a-461d-8301-04f032168b56'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:13.067665 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b431a0aa-501a-461d-8301-04f032168b56 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff47cb0ecd1f4880927326968612a777', 'request_id': 'req-b431a0aa-501a-461d-8301-04f032168b56'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:13.070019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c355aaea-9510-405b-b307-358b8495951c admin admin] The token cache is being invalidate because project 8b6ada11f4a34e87970047f1dff6f066 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:13.070382 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c355aaea-9510-405b-b307-358b8495951c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:13.071131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c355aaea-9510-405b-b307-358b8495951c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:13.072744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1232/2506] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:12 2022] DELETE /identity/v3/projects/8b6ada11f4a34e87970047f1dff6f066 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:13.076705 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b431a0aa-501a-461d-8301-04f032168b56 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff47cb0ecd1f4880927326968612a777', 'request_id': 'req-b431a0aa-501a-461d-8301-04f032168b56'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:13.077424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3559a-22d4-4077-ac30-744ed575bfc2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.077704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3559a-22d4-4077-ac30-744ed575bfc2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.077975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00a3559a-22d4-4077-ac30-744ed575bfc2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.087787 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b431a0aa-501a-461d-8301-04f032168b56 admin admin] The token cache is being invalidate because project ff47cb0ecd1f4880927326968612a777 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:13.088072 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b431a0aa-501a-461d-8301-04f032168b56 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:13.088966 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b431a0aa-501a-461d-8301-04f032168b56 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:13.090700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1275/2507] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:12 2022] DELETE /identity/v3/projects/ff47cb0ecd1f4880927326968612a777 => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:13.095563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa12a-d4b6-4de7-a6cf-a4ae4d5a61f8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.095852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa12a-d4b6-4de7-a6cf-a4ae4d5a61f8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.096134 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4baa12a-d4b6-4de7-a6cf-a4ae4d5a61f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.096544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-00a3559a-22d4-4077-ac30-744ed575bfc2 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:13.097771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-00a3559a-22d4-4077-ac30-744ed575bfc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:13.114323 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c4baa12a-d4b6-4de7-a6cf-a4ae4d5a61f8 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:13.115510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c4baa12a-d4b6-4de7-a6cf-a4ae4d5a61f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:13.140237 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=15,keystone:SELECT=83,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:13.163000 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1233/2508] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:13.171974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb447c06-ce90-4d79-8807-fe53d12a8a94 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.172339 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb447c06-ce90-4d79-8807-fe53d12a8a94 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.172699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb447c06-ce90-4d79-8807-fe53d12a8a94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.188697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1276/2509] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:13.191294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-bb447c06-ce90-4d79-8807-fe53d12a8a94 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:13.192564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bb447c06-ce90-4d79-8807-fe53d12a8a94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:13.196020 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712623a-6cd9-4c0d-8cd4-6a8a224f3f5d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.196405 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712623a-6cd9-4c0d-8cd4-6a8a224f3f5d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.196750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3712623a-6cd9-4c0d-8cd4-6a8a224f3f5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.200641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1234/2510] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:13.204458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb447c06-ce90-4d79-8807-fe53d12a8a94 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.214200 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb447c06-ce90-4d79-8807-fe53d12a8a94 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.215293 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-3712623a-6cd9-4c0d-8cd4-6a8a224f3f5d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:13.216583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3712623a-6cd9-4c0d-8cd4-6a8a224f3f5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:13.219890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290ff02-7846-4a38-94d8-6dae48cc7226 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.220545 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290ff02-7846-4a38-94d8-6dae48cc7226 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.220827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290ff02-7846-4a38-94d8-6dae48cc7226 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.221143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3290ff02-7846-4a38-94d8-6dae48cc7226 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.221864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290ff02-7846-4a38-94d8-6dae48cc7226 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:30:13.222173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290ff02-7846-4a38-94d8-6dae48cc7226 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.223770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3290ff02-7846-4a38-94d8-6dae48cc7226 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.225349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1277/2511] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:13 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:13.229412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712623a-6cd9-4c0d-8cd4-6a8a224f3f5d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.238722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1235/2512] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:30:13.239294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3712623a-6cd9-4c0d-8cd4-6a8a224f3f5d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.243848 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cac0d-f8c0-49f0-8e81-1595f39dac13 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.244276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290ff02-7846-4a38-94d8-6dae48cc7226 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.244610 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cac0d-f8c0-49f0-8e81-1595f39dac13 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.244900 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cac0d-f8c0-49f0-8e81-1595f39dac13 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.245210 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b0cac0d-f8c0-49f0-8e81-1595f39dac13 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.246045 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cac0d-f8c0-49f0-8e81-1595f39dac13 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:30:13.246362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cac0d-f8c0-49f0-8e81-1595f39dac13 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.247953 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b0cac0d-f8c0-49f0-8e81-1595f39dac13 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.254159 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3290ff02-7846-4a38-94d8-6dae48cc7226 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.258727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025085a-196f-410f-8dc7-f5919fcd3d12 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.259357 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025085a-196f-410f-8dc7-f5919fcd3d12 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.259691 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025085a-196f-410f-8dc7-f5919fcd3d12 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.259792 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1278/2513] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:30:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:30:13.259915 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d025085a-196f-410f-8dc7-f5919fcd3d12 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.261419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025085a-196f-410f-8dc7-f5919fcd3d12 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.262576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d025085a-196f-410f-8dc7-f5919fcd3d12 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.264050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cac0d-f8c0-49f0-8e81-1595f39dac13 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.273769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b0cac0d-f8c0-49f0-8e81-1595f39dac13 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.278457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7feae25-119e-4b31-a8b4-e3848572d14b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.279114 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7feae25-119e-4b31-a8b4-e3848572d14b admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.279905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7feae25-119e-4b31-a8b4-e3848572d14b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.280184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7feae25-119e-4b31-a8b4-e3848572d14b admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.280879 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7feae25-119e-4b31-a8b4-e3848572d14b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.282821 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7feae25-119e-4b31-a8b4-e3848572d14b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.294053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1236/2514] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:13 2022] POST /identity/v3/projects => generated 383 bytes in 47 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:13.295772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025085a-196f-410f-8dc7-f5919fcd3d12 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.312617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1279/2515] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:13 2022] POST /identity/v3/projects => generated 367 bytes in 46 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:13.313817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7feae25-119e-4b31-a8b4-e3848572d14b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.314455 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:13.378150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d025085a-196f-410f-8dc7-f5919fcd3d12 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.392503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7feae25-119e-4b31-a8b4-e3848572d14b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.397364 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c07bd-abc1-40f8-9e8c-51d627c04123 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.398164 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c07bd-abc1-40f8-9e8c-51d627c04123 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.398514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c07bd-abc1-40f8-9e8c-51d627c04123 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.398864 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac2c07bd-abc1-40f8-9e8c-51d627c04123 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.399586 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c07bd-abc1-40f8-9e8c-51d627c04123 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.401650 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac2c07bd-abc1-40f8-9e8c-51d627c04123 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.432582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1280/2516] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:13 2022] POST /identity/v3/users => generated 284 bytes in 116 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:13.434321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c07bd-abc1-40f8-9e8c-51d627c04123 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.447678 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac2c07bd-abc1-40f8-9e8c-51d627c04123 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.447880 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73435d4c-2c9e-4661-861e-7af41e954dd6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.448438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435d4c-2c9e-4661-861e-7af41e954dd6 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.448827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435d4c-2c9e-4661-861e-7af41e954dd6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.449143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73435d4c-2c9e-4661-861e-7af41e954dd6 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.449882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73435d4c-2c9e-4661-861e-7af41e954dd6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.452743 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73435d4c-2c9e-4661-861e-7af41e954dd6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.457434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d3268-d5be-4086-92e2-7c910490cc9a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.458124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d3268-d5be-4086-92e2-7c910490cc9a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.458487 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d3268-d5be-4086-92e2-7c910490cc9a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.458818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d0d3268-d5be-4086-92e2-7c910490cc9a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.469434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d3268-d5be-4086-92e2-7c910490cc9a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.470971 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d0d3268-d5be-4086-92e2-7c910490cc9a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.485760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1237/2517] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:13 2022] POST /identity/v3/users => generated 292 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:13.489845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73435d4c-2c9e-4661-861e-7af41e954dd6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.496464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1281/2518] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 62 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:13.504773 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73435d4c-2c9e-4661-861e-7af41e954dd6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.510874 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70cdad-cc60-45be-8b37-bd21cf4ecb34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.511827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70cdad-cc60-45be-8b37-bd21cf4ecb34 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.511933 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70cdad-cc60-45be-8b37-bd21cf4ecb34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.512364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd70cdad-cc60-45be-8b37-bd21cf4ecb34 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.512488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d3268-d5be-4086-92e2-7c910490cc9a admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.512910 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70cdad-cc60-45be-8b37-bd21cf4ecb34 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.515123 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd70cdad-cc60-45be-8b37-bd21cf4ecb34 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.524314 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d0d3268-d5be-4086-92e2-7c910490cc9a admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.529036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1238/2519] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:13.529204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88191b1-6bef-48e1-ba8f-9b7ceb3af4fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.530412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88191b1-6bef-48e1-ba8f-9b7ceb3af4fc admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.530893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88191b1-6bef-48e1-ba8f-9b7ceb3af4fc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.531137 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d88191b1-6bef-48e1-ba8f-9b7ceb3af4fc admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.531868 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88191b1-6bef-48e1-ba8f-9b7ceb3af4fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.531994 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70cdad-cc60-45be-8b37-bd21cf4ecb34 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.533525 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d88191b1-6bef-48e1-ba8f-9b7ceb3af4fc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.543039 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd70cdad-cc60-45be-8b37-bd21cf4ecb34 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.546812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1282/2520] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:13.548575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3988b-1d0f-483f-9977-0590345ac3c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.549450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3988b-1d0f-483f-9977-0590345ac3c2 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.549739 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3988b-1d0f-483f-9977-0590345ac3c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.550021 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9db3988b-1d0f-483f-9977-0590345ac3c2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.550832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3988b-1d0f-483f-9977-0590345ac3c2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.551339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88191b1-6bef-48e1-ba8f-9b7ceb3af4fc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.552600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9db3988b-1d0f-483f-9977-0590345ac3c2 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.561761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d88191b1-6bef-48e1-ba8f-9b7ceb3af4fc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.564414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1239/2521] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:13 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:13.567329 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85119e3-77e1-49ff-8be0-ee4eaf704190 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.568257 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85119e3-77e1-49ff-8be0-ee4eaf704190 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.568696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85119e3-77e1-49ff-8be0-ee4eaf704190 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.568807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85119e3-77e1-49ff-8be0-ee4eaf704190 admin admin] PATH_INFO: `/v3/projects/da137fc29c9243b09b0a4669708f872b/users/741a97d7ed2f4b1d8cc6b6145209cf89/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.577276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3988b-1d0f-483f-9977-0590345ac3c2 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.587091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85119e3-77e1-49ff-8be0-ee4eaf704190 admin admin] RBAC: Authorizing `identity:create_grant(project_id=da137fc29c9243b09b0a4669708f872b, user_id=741a97d7ed2f4b1d8cc6b6145209cf89, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.590093 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85119e3-77e1-49ff-8be0-ee4eaf704190 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.594189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9db3988b-1d0f-483f-9977-0590345ac3c2 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.603922 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1283/2522] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:13 2022] PUT /identity/v3/projects/da137fc29c9243b09b0a4669708f872b/users/741a97d7ed2f4b1d8cc6b6145209cf89/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:13.606116 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a7de4b7-99a2-4ad3-a24f-4da59dcd2394 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.607009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7de4b7-99a2-4ad3-a24f-4da59dcd2394 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.607289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7de4b7-99a2-4ad3-a24f-4da59dcd2394 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.607593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a7de4b7-99a2-4ad3-a24f-4da59dcd2394 admin admin] PATH_INFO: `/v3/projects/83b105ef2eeb4b7491aabc9b6aecdbe6/users/f85abea80901404a809dffef8c60a860/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.615287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0381ecc-6332-4a70-8bb3-60cfa3d2f8d8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.615628 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0381ecc-6332-4a70-8bb3-60cfa3d2f8d8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.616336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0381ecc-6332-4a70-8bb3-60cfa3d2f8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.622687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7de4b7-99a2-4ad3-a24f-4da59dcd2394 admin admin] RBAC: Authorizing `identity:create_grant(project_id=83b105ef2eeb4b7491aabc9b6aecdbe6, user_id=f85abea80901404a809dffef8c60a860, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.625446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a7de4b7-99a2-4ad3-a24f-4da59dcd2394 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.639504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1240/2523] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:13 2022] PUT /identity/v3/projects/83b105ef2eeb4b7491aabc9b6aecdbe6/users/f85abea80901404a809dffef8c60a860/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 71 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:13.644941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-d0381ecc-6332-4a70-8bb3-60cfa3d2f8d8 None None] MFA Rules not processed for user `741a97d7ed2f4b1d8cc6b6145209cf89`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:13.646233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d0381ecc-6332-4a70-8bb3-60cfa3d2f8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:13.649409 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061c6a-23b9-4f93-b53f-db1b1368a4be None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.649700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061c6a-23b9-4f93-b53f-db1b1368a4be None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.649979 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80061c6a-23b9-4f93-b53f-db1b1368a4be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.663959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:13.676224 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-80061c6a-23b9-4f93-b53f-db1b1368a4be None None] MFA Rules not processed for user `f85abea80901404a809dffef8c60a860`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:13.677830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-80061c6a-23b9-4f93-b53f-db1b1368a4be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:13.717939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1284/2524] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:13 2022] POST /identity/v3/auth/tokens => generated 3234 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:13.722264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0381ecc-6332-4a70-8bb3-60cfa3d2f8d8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.739698 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:13.751829 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1241/2525] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:13 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:13.757248 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80061c6a-23b9-4f93-b53f-db1b1368a4be None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.814941 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0381ecc-6332-4a70-8bb3-60cfa3d2f8d8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.821877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af456b-4da6-42fc-b7fe-abe5a58da5d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.822652 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af456b-4da6-42fc-b7fe-abe5a58da5d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.823006 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af456b-4da6-42fc-b7fe-abe5a58da5d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.824616 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05af456b-4da6-42fc-b7fe-abe5a58da5d2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.825541 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af456b-4da6-42fc-b7fe-abe5a58da5d2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.828327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05af456b-4da6-42fc-b7fe-abe5a58da5d2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.846724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80061c6a-23b9-4f93-b53f-db1b1368a4be None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.854059 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadffca1-e5fe-4007-b725-20a18b662c0b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.854740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadffca1-e5fe-4007-b725-20a18b662c0b admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.855081 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadffca1-e5fe-4007-b725-20a18b662c0b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.855391 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cadffca1-e5fe-4007-b725-20a18b662c0b admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.856212 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadffca1-e5fe-4007-b725-20a18b662c0b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.858363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cadffca1-e5fe-4007-b725-20a18b662c0b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:13.865026 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1285/2526] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:13 2022] POST /identity/v3/projects => generated 367 bytes in 142 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:30:13.867649 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af456b-4da6-42fc-b7fe-abe5a58da5d2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.892012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1242/2527] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:13 2022] POST /identity/v3/projects => generated 383 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:13.896956 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadffca1-e5fe-4007-b725-20a18b662c0b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:13.948565 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05af456b-4da6-42fc-b7fe-abe5a58da5d2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.969076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cadffca1-e5fe-4007-b725-20a18b662c0b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:13.974335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb82656-4ba9-425e-90a3-401d981c9aec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:13.975160 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb82656-4ba9-425e-90a3-401d981c9aec admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:13.975660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb82656-4ba9-425e-90a3-401d981c9aec admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:13.976044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fb82656-4ba9-425e-90a3-401d981c9aec admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:13.976836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb82656-4ba9-425e-90a3-401d981c9aec admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:13.979283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fb82656-4ba9-425e-90a3-401d981c9aec admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:14.001615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:14.003188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1243/2528] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:13 2022] POST /identity/v3/users => generated 298 bytes in 107 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:30:14.007110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb82656-4ba9-425e-90a3-401d981c9aec admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:14.016512 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5340a-9377-47e9-9cb8-6444bfe559bc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:14.017797 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5340a-9377-47e9-9cb8-6444bfe559bc admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.019129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5340a-9377-47e9-9cb8-6444bfe559bc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.019410 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fa5340a-9377-47e9-9cb8-6444bfe559bc admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.020119 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5340a-9377-47e9-9cb8-6444bfe559bc admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:14.022132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fa5340a-9377-47e9-9cb8-6444bfe559bc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:14.023697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fb82656-4ba9-425e-90a3-401d981c9aec admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:14.032011 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191b105-d020-4f5b-a411-bc21f3032ca4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:14.032995 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191b105-d020-4f5b-a411-bc21f3032ca4 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.033519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191b105-d020-4f5b-a411-bc21f3032ca4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.033829 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2191b105-d020-4f5b-a411-bc21f3032ca4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.034741 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191b105-d020-4f5b-a411-bc21f3032ca4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:14.036833 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2191b105-d020-4f5b-a411-bc21f3032ca4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:14.044722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1286/2529] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:13 2022] POST /identity/v3/users => generated 290 bytes in 177 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:30:14.048390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5340a-9377-47e9-9cb8-6444bfe559bc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:14.051345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1244/2530] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 44 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:14.056197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191b105-d020-4f5b-a411-bc21f3032ca4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:14.060369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fa5340a-9377-47e9-9cb8-6444bfe559bc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:14.065886 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e68fd7-62a8-4e22-8828-0fd123c81442 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:14.066626 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e68fd7-62a8-4e22-8828-0fd123c81442 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.067015 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e68fd7-62a8-4e22-8828-0fd123c81442 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.067349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89e68fd7-62a8-4e22-8828-0fd123c81442 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.068201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e68fd7-62a8-4e22-8828-0fd123c81442 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:14.070010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89e68fd7-62a8-4e22-8828-0fd123c81442 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:14.073277 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2191b105-d020-4f5b-a411-bc21f3032ca4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:14.079177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f4c6c-fc6b-4f1d-8bb3-b80d313bc98f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:14.080075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f4c6c-fc6b-4f1d-8bb3-b80d313bc98f admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.080363 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f4c6c-fc6b-4f1d-8bb3-b80d313bc98f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.080646 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-666f4c6c-fc6b-4f1d-8bb3-b80d313bc98f admin admin] PATH_INFO: `/v3/projects/842e6c7b12024966b652613a6ee4fdd2/users/1ba11866d84c45c78f50ae13747cdd9b/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.081679 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1287/2531] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:30:14.085719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e68fd7-62a8-4e22-8828-0fd123c81442 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:14.096296 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89e68fd7-62a8-4e22-8828-0fd123c81442 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:14.100128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f4c6c-fc6b-4f1d-8bb3-b80d313bc98f admin admin] RBAC: Authorizing `identity:create_grant(project_id=842e6c7b12024966b652613a6ee4fdd2, user_id=1ba11866d84c45c78f50ae13747cdd9b, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:14.100889 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb53a20-86ce-4246-b68c-f8131528b4e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:14.101812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb53a20-86ce-4246-b68c-f8131528b4e3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.102098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb53a20-86ce-4246-b68c-f8131528b4e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.102376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb53a20-86ce-4246-b68c-f8131528b4e3 admin admin] PATH_INFO: `/v3/projects/272f9c7303ab4ea2af8fc3b436a2eb6f/users/7635bfa37c5d48fe8c8d970b732f094b/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.102886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-666f4c6c-fc6b-4f1d-8bb3-b80d313bc98f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:14.118514 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1245/2532] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:14 2022] PUT /identity/v3/projects/842e6c7b12024966b652613a6ee4fdd2/users/1ba11866d84c45c78f50ae13747cdd9b/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 63 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:14.119654 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb53a20-86ce-4246-b68c-f8131528b4e3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=272f9c7303ab4ea2af8fc3b436a2eb6f, user_id=7635bfa37c5d48fe8c8d970b732f094b, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:14.122712 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb53a20-86ce-4246-b68c-f8131528b4e3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:14.124588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f4c6c-fc6b-4f1d-8bb3-b80d313bc98f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:14.138557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1288/2533] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:14 2022] PUT /identity/v3/projects/272f9c7303ab4ea2af8fc3b436a2eb6f/users/7635bfa37c5d48fe8c8d970b732f094b/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:14.143409 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb53a20-86ce-4246-b68c-f8131528b4e3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:14.176532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:14.205423 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-666f4c6c-fc6b-4f1d-8bb3-b80d313bc98f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:14.229916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb53a20-86ce-4246-b68c-f8131528b4e3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:14.237621 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969a1f5-3521-4d14-9329-4cb98df82e94 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:14.238326 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969a1f5-3521-4d14-9329-4cb98df82e94 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.238604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969a1f5-3521-4d14-9329-4cb98df82e94 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.238878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e969a1f5-3521-4d14-9329-4cb98df82e94 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.239636 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969a1f5-3521-4d14-9329-4cb98df82e94 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:14.242531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e969a1f5-3521-4d14-9329-4cb98df82e94 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:14.257376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1289/2534] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:14.258543 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969a1f5-3521-4d14-9329-4cb98df82e94 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:14.269694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e969a1f5-3521-4d14-9329-4cb98df82e94 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:14.274441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f26ec-faa4-4ef0-aca0-da3dff80a2ab admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:14.275321 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f26ec-faa4-4ef0-aca0-da3dff80a2ab admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.275610 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f26ec-faa4-4ef0-aca0-da3dff80a2ab admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.275891 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-074f26ec-faa4-4ef0-aca0-da3dff80a2ab admin admin] PATH_INFO: `/v3/projects/272f9c7303ab4ea2af8fc3b436a2eb6f/users/7635bfa37c5d48fe8c8d970b732f094b/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.277963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f26ec-faa4-4ef0-aca0-da3dff80a2ab admin admin] RBAC: Authorizing `identity:create_grant(project_id=272f9c7303ab4ea2af8fc3b436a2eb6f, user_id=7635bfa37c5d48fe8c8d970b732f094b, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:14.279379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2da9f3f-c6f1-4a59-ba99-500b9453f133 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:14.280153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da9f3f-c6f1-4a59-ba99-500b9453f133 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.280506 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da9f3f-c6f1-4a59-ba99-500b9453f133 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.280799 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-074f26ec-faa4-4ef0-aca0-da3dff80a2ab admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:14.280901 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2da9f3f-c6f1-4a59-ba99-500b9453f133 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.281957 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da9f3f-c6f1-4a59-ba99-500b9453f133 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:14.283824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2da9f3f-c6f1-4a59-ba99-500b9453f133 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:14.292546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1290/2535] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:14 2022] PUT /identity/v3/projects/272f9c7303ab4ea2af8fc3b436a2eb6f/users/7635bfa37c5d48fe8c8d970b732f094b/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 34 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:14.297131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1246/2536] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:14 2022] GET /identity/v3/roles => generated 1420 bytes in 173 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:14.306122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f26ec-faa4-4ef0-aca0-da3dff80a2ab admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:14.306513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d305d2-4065-46a8-ab32-43b97330e978 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.306806 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d305d2-4065-46a8-ab32-43b97330e978 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.307087 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d305d2-4065-46a8-ab32-43b97330e978 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.343661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-d1d305d2-4065-46a8-ab32-43b97330e978 None None] MFA Rules not processed for user `7635bfa37c5d48fe8c8d970b732f094b`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:14.344885 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d1d305d2-4065-46a8-ab32-43b97330e978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:14.396415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-074f26ec-faa4-4ef0-aca0-da3dff80a2ab admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:14.401189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d070be82-06d0-4a1e-9bef-622f27e8de6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:14.402085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070be82-06d0-4a1e-9bef-622f27e8de6b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.402375 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070be82-06d0-4a1e-9bef-622f27e8de6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.402673 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d070be82-06d0-4a1e-9bef-622f27e8de6b admin admin] PATH_INFO: `/v3/projects/842e6c7b12024966b652613a6ee4fdd2/users/1ba11866d84c45c78f50ae13747cdd9b/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.404910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070be82-06d0-4a1e-9bef-622f27e8de6b admin admin] RBAC: Authorizing `identity:create_grant(project_id=842e6c7b12024966b652613a6ee4fdd2, user_id=1ba11866d84c45c78f50ae13747cdd9b, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:14.409154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d070be82-06d0-4a1e-9bef-622f27e8de6b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:14.421737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1291/2537] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:14 2022] PUT /identity/v3/projects/842e6c7b12024966b652613a6ee4fdd2/users/1ba11866d84c45c78f50ae13747cdd9b/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:14.432808 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48396014-c2de-4e73-880d-c5515a4654d2 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.433232 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48396014-c2de-4e73-880d-c5515a4654d2 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.433707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48396014-c2de-4e73-880d-c5515a4654d2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.439296 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1247/2538] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:14 2022] POST /identity/v3/auth/tokens => generated 3301 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:14.453595 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d305d2-4065-46a8-ab32-43b97330e978 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:14.454993 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d1d305d2-4065-46a8-ab32-43b97330e978 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:14.467918 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-48396014-c2de-4e73-880d-c5515a4654d2 None None] MFA Rules not processed for user `1ba11866d84c45c78f50ae13747cdd9b`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:14.469262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-48396014-c2de-4e73-880d-c5515a4654d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:14.479201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=94,keystone:INSERT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:14.513855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d305d2-4065-46a8-ab32-43b97330e978 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:14.534948 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:14.551693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1292/2539] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:14 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:14.569057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48396014-c2de-4e73-880d-c5515a4654d2 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:14.570672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-48396014-c2de-4e73-880d-c5515a4654d2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:14.585690 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa48365-4c54-4423-9649-ec172b3a9d0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:14.586438 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48365-4c54-4423-9649-ec172b3a9d0c service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.586762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48365-4c54-4423-9649-ec172b3a9d0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.587110 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa48365-4c54-4423-9649-ec172b3a9d0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.645369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48396014-c2de-4e73-880d-c5515a4654d2 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:14.651198 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b6d30-e79b-4c97-8cee-84bad5f3b8d4 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:14.652591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b6d30-e79b-4c97-8cee-84bad5f3b8d4 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.652591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b6d30-e79b-4c97-8cee-84bad5f3b8d4 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.652591 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-631b6d30-e79b-4c97-8cee-84bad5f3b8d4 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.664720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa48365-4c54-4423-9649-ec172b3a9d0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:14.665414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efa48365-4c54-4423-9649-ec172b3a9d0c service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:14.666096 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b6d30-e79b-4c97-8cee-84bad5f3b8d4 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:14.667764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-631b6d30-e79b-4c97-8cee-84bad5f3b8d4 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:14.676189 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1248/2540] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:14 2022] GET /identity/v3/auth/tokens => generated 3301 bytes in 223 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:30:14.677658 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e952-5409-40b5-bc8a-5a2de7fa80ca None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.677950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e952-5409-40b5-bc8a-5a2de7fa80ca None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.678230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02c9e952-5409-40b5-bc8a-5a2de7fa80ca None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.679532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1249/2541] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 26 18:30:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:30:14.685127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1293/2542] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:14 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:30:14.685945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148c21e-70ae-4da6-bf00-a4f6805f2255 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.686513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148c21e-70ae-4da6-bf00-a4f6805f2255 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.687003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a148c21e-70ae-4da6-bf00-a4f6805f2255 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.738293 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a148c21e-70ae-4da6-bf00-a4f6805f2255 None None] MFA Rules not processed for user `97f259ac2eb4425f8b4dcffeccdcd439`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:14.739667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a148c21e-70ae-4da6-bf00-a4f6805f2255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:14.808437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b6d30-e79b-4c97-8cee-84bad5f3b8d4 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:14.820894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-631b6d30-e79b-4c97-8cee-84bad5f3b8d4 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:14.824779 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a74bb66-d1fe-4f71-afa6-dfe6ccf2a425 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:14.825512 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74bb66-d1fe-4f71-afa6-dfe6ccf2a425 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.825816 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74bb66-d1fe-4f71-afa6-dfe6ccf2a425 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.826076 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a74bb66-d1fe-4f71-afa6-dfe6ccf2a425 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.838198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1250/2543] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 26 18:30:14 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:14.852388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148c21e-70ae-4da6-bf00-a4f6805f2255 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:14.853908 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a148c21e-70ae-4da6-bf00-a4f6805f2255 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:14.901791 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74bb66-d1fe-4f71-afa6-dfe6ccf2a425 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:14.903341 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a74bb66-d1fe-4f71-afa6-dfe6ccf2a425 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:14.914499 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1294/2544] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:14 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:30:14.918836 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:14.925217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a148c21e-70ae-4da6-bf00-a4f6805f2255 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:14.929734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-896cf27f-6bb0-40a6-b25c-df34e10dcad3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbb5beba8a45a5b0a9b0beba0e0d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:14.930427 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cf27f-6bb0-40a6-b25c-df34e10dcad3 service glance] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:14.930716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cf27f-6bb0-40a6-b25c-df34e10dcad3 service glance] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:14.930995 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-896cf27f-6bb0-40a6-b25c-df34e10dcad3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:14.944781 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cf27f-6bb0-40a6-b25c-df34e10dcad3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:14.946384 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-896cf27f-6bb0-40a6-b25c-df34e10dcad3 service glance] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:14.958884 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1251/2545] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:14 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:15.038326 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434b3c3-8a2e-4691-8994-b408bf0eefcb None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:15.038623 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434b3c3-8a2e-4691-8994-b408bf0eefcb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:15.038909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7434b3c3-8a2e-4691-8994-b408bf0eefcb None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:15.040289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1295/2546] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 26 18:30:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:30:15.045540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217e876-a699-49f8-b872-7af0c3afc210 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:15.046622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217e876-a699-49f8-b872-7af0c3afc210 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:15.047119 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4217e876-a699-49f8-b872-7af0c3afc210 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:15.071208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4217e876-a699-49f8-b872-7af0c3afc210 None None] MFA Rules not processed for user `1b725c28490f4f90b5eec565cd0fb603`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:15.072427 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4217e876-a699-49f8-b872-7af0c3afc210 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:15.143365 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1252/2547] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 26 18:30:15 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:15.157033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434b3c3-8a2e-4691-8994-b408bf0eefcb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:15.159296 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7434b3c3-8a2e-4691-8994-b408bf0eefcb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:15.175277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7434b3c3-8a2e-4691-8994-b408bf0eefcb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:15.184878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-141c2473-c782-40e2-9637-7b3c40a54d3f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:15.185998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c2473-c782-40e2-9637-7b3c40a54d3f service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:15.186118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c2473-c782-40e2-9637-7b3c40a54d3f service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:15.186423 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-141c2473-c782-40e2-9637-7b3c40a54d3f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:15.195274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c2473-c782-40e2-9637-7b3c40a54d3f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:15.201544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-141c2473-c782-40e2-9637-7b3c40a54d3f service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:15.207258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1296/2548] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:15 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 51 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:16.174276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217e876-a699-49f8-b872-7af0c3afc210 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:16.242300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4217e876-a699-49f8-b872-7af0c3afc210 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:16.246728 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2075274a-56e5-46b5-8f45-c25831e21da7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:16.247592 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075274a-56e5-46b5-8f45-c25831e21da7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:16.247907 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075274a-56e5-46b5-8f45-c25831e21da7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:16.248186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2075274a-56e5-46b5-8f45-c25831e21da7 admin admin] PATH_INFO: `/v3/users/741a97d7ed2f4b1d8cc6b6145209cf89` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:16.249377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075274a-56e5-46b5-8f45-c25831e21da7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=741a97d7ed2f4b1d8cc6b6145209cf89)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:16.251300 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2075274a-56e5-46b5-8f45-c25831e21da7 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:16.302081 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2075274a-56e5-46b5-8f45-c25831e21da7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '741a97d7ed2f4b1d8cc6b6145209cf89'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:16.309574 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2075274a-56e5-46b5-8f45-c25831e21da7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '741a97d7ed2f4b1d8cc6b6145209cf89'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:16.310929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2075274a-56e5-46b5-8f45-c25831e21da7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '741a97d7ed2f4b1d8cc6b6145209cf89'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:16.327103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2075274a-56e5-46b5-8f45-c25831e21da7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '741a97d7ed2f4b1d8cc6b6145209cf89'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:16.332752 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed01ada-e29d-4390-a61c-322fcdf91a01 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:16.333424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed01ada-e29d-4390-a61c-322fcdf91a01 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:16.333424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ed01ada-e29d-4390-a61c-322fcdf91a01 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:16.335036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1297/2549] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 26 18:30:16 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:30:16.335603 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-2075274a-56e5-46b5-8f45-c25831e21da7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '741a97d7ed2f4b1d8cc6b6145209cf89'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:16.341081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bbccb-5ac6-4b76-b764-1e094ac4e5ec None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:16.341561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bbccb-5ac6-4b76-b764-1e094ac4e5ec None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:16.342355 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35bbccb-5ac6-4b76-b764-1e094ac4e5ec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:16.344685 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1253/2550] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:16 2022] DELETE /identity/v3/users/741a97d7ed2f4b1d8cc6b6145209cf89 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:16.348941 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c892-5c5f-455f-ab2b-d6b9b8d88b95 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:16.349354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c892-5c5f-455f-ab2b-d6b9b8d88b95 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:16.349721 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2e9c892-5c5f-455f-ab2b-d6b9b8d88b95 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:16.368595 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b35bbccb-5ac6-4b76-b764-1e094ac4e5ec None None] MFA Rules not processed for user `97f259ac2eb4425f8b4dcffeccdcd439`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:16.373917 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b35bbccb-5ac6-4b76-b764-1e094ac4e5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:16.374223 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a2e9c892-5c5f-455f-ab2b-d6b9b8d88b95 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:16.375569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a2e9c892-5c5f-455f-ab2b-d6b9b8d88b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:16.403633 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:16.414805 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:16.480042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1254/2551] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:16 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:16.489503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1298/2552] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 26 18:30:16 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 149 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:16.491362 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9c892-5c5f-455f-ab2b-d6b9b8d88b95 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:16.500943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a2e9c892-5c5f-455f-ab2b-d6b9b8d88b95 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:16.507726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bbccb-5ac6-4b76-b764-1e094ac4e5ec None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:16.509247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b35bbccb-5ac6-4b76-b764-1e094ac4e5ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:16.578708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2e9c892-5c5f-455f-ab2b-d6b9b8d88b95 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:16.583187 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63edb28-2074-46c8-a5e7-c32961c67192 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:16.583827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63edb28-2074-46c8-a5e7-c32961c67192 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:16.584106 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63edb28-2074-46c8-a5e7-c32961c67192 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:16.584373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a63edb28-2074-46c8-a5e7-c32961c67192 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:16.602865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63edb28-2074-46c8-a5e7-c32961c67192 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:16.606989 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35bbccb-5ac6-4b76-b764-1e094ac4e5ec None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:16.607661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a63edb28-2074-46c8-a5e7-c32961c67192 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:16.612777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76407faf-60c1-4311-bd06-527db9725ac1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:16.613568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76407faf-60c1-4311-bd06-527db9725ac1 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:16.613918 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76407faf-60c1-4311-bd06-527db9725ac1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:16.614265 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76407faf-60c1-4311-bd06-527db9725ac1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:16.625773 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76407faf-60c1-4311-bd06-527db9725ac1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:16.627349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76407faf-60c1-4311-bd06-527db9725ac1 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:16.627707 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1255/2553] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:16 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:16.639486 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1299/2554] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:16 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 132 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:16.925238 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63edb28-2074-46c8-a5e7-c32961c67192 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:16.926769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a63edb28-2074-46c8-a5e7-c32961c67192 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:16.940483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a63edb28-2074-46c8-a5e7-c32961c67192 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:16.946140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:16.947009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:16.947295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:16.947886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] PATH_INFO: `/v3/projects/da137fc29c9243b09b0a4669708f872b` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:16.948816 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=da137fc29c9243b09b0a4669708f872b)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:16.950790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:17.008395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'da137fc29c9243b09b0a4669708f872b', 'request_id': 'req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.016679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'da137fc29c9243b09b0a4669708f872b', 'request_id': 'req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.023278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'da137fc29c9243b09b0a4669708f872b', 'request_id': 'req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.036868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] The token cache is being invalidate because project da137fc29c9243b09b0a4669708f872b was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:17.037418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.038209 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.040418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1256/2555] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:16 2022] DELETE /identity/v3/projects/da137fc29c9243b09b0a4669708f872b => generated 0 bytes in 116 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:17.044370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76407faf-60c1-4311-bd06-527db9725ac1 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:17.059332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76407faf-60c1-4311-bd06-527db9725ac1 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:17.148284 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6783574-4bb8-4851-a0f5-c5f1a1899314 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:17.148974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6783574-4bb8-4851-a0f5-c5f1a1899314 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:17.149466 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6783574-4bb8-4851-a0f5-c5f1a1899314 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:17.149763 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6783574-4bb8-4851-a0f5-c5f1a1899314 admin admin] PATH_INFO: `/v3/users/7635bfa37c5d48fe8c8d970b732f094b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:17.150933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6783574-4bb8-4851-a0f5-c5f1a1899314 admin admin] RBAC: Authorizing `identity:delete_user(user_id=7635bfa37c5d48fe8c8d970b732f094b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:17.152970 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6783574-4bb8-4851-a0f5-c5f1a1899314 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:17.200067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e6783574-4bb8-4851-a0f5-c5f1a1899314 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '7635bfa37c5d48fe8c8d970b732f094b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.200739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e6783574-4bb8-4851-a0f5-c5f1a1899314 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '7635bfa37c5d48fe8c8d970b732f094b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.208203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e6783574-4bb8-4851-a0f5-c5f1a1899314 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '7635bfa37c5d48fe8c8d970b732f094b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.208829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e6783574-4bb8-4851-a0f5-c5f1a1899314 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '7635bfa37c5d48fe8c8d970b732f094b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.219931 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=9 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:17.221222 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e6783574-4bb8-4851-a0f5-c5f1a1899314 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '7635bfa37c5d48fe8c8d970b732f094b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.235107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1300/2556] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:17 2022] DELETE /identity/v3/users/7635bfa37c5d48fe8c8d970b732f094b => generated 0 bytes in 191 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:17.494323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:17.495874 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:17.509598 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef2c37ba-e3d8-4ddc-9bc7-9ca5d51d42b5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:17.554583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:17.570233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:17.571120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:17.571401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:17.571677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] PATH_INFO: `/v3/projects/272f9c7303ab4ea2af8fc3b436a2eb6f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:17.572949 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] RBAC: Authorizing `identity:delete_project(project_id=272f9c7303ab4ea2af8fc3b436a2eb6f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:17.574973 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:17.619904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '272f9c7303ab4ea2af8fc3b436a2eb6f', 'request_id': 'req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.626914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '272f9c7303ab4ea2af8fc3b436a2eb6f', 'request_id': 'req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.632445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '272f9c7303ab4ea2af8fc3b436a2eb6f', 'request_id': 'req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.643055 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] The token cache is being invalidate because project 272f9c7303ab4ea2af8fc3b436a2eb6f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:17.643339 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.643974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.645567 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1257/2557] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:17 2022] DELETE /identity/v3/projects/272f9c7303ab4ea2af8fc3b436a2eb6f => generated 0 bytes in 152 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:17.650444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430ac18-8cd5-477e-8b70-ea0f5ed0a85d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:17.650910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430ac18-8cd5-477e-8b70-ea0f5ed0a85d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:17.651030 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f430ac18-8cd5-477e-8b70-ea0f5ed0a85d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:17.669579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f430ac18-8cd5-477e-8b70-ea0f5ed0a85d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:17.671442 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f430ac18-8cd5-477e-8b70-ea0f5ed0a85d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:17.720535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:17.721932 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:17.730571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1301/2558] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:17.738853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aef80-1bc5-41e0-8565-a2cc2a791cd9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:17.739138 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aef80-1bc5-41e0-8565-a2cc2a791cd9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:17.739416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b00aef80-1bc5-41e0-8565-a2cc2a791cd9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:17.756571 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b00aef80-1bc5-41e0-8565-a2cc2a791cd9 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:17.757826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b00aef80-1bc5-41e0-8565-a2cc2a791cd9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:17.765736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1302/2559] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:17.769791 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00aef80-1bc5-41e0-8565-a2cc2a791cd9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:17.779553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b00aef80-1bc5-41e0-8565-a2cc2a791cd9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:17.784216 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317552-7add-427d-b907-b130afd9e6d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:17.784867 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317552-7add-427d-b907-b130afd9e6d2 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:17.785193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317552-7add-427d-b907-b130afd9e6d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:17.785470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc317552-7add-427d-b907-b130afd9e6d2 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:17.786183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc317552-7add-427d-b907-b130afd9e6d2 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:30:17.786489 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc317552-7add-427d-b907-b130afd9e6d2 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:17.788073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc317552-7add-427d-b907-b130afd9e6d2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:17.788270 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c868c575-3b1c-4ae6-ade2-c80dd56aac5b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:17.792808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca8bfd5-6b5b-43b5-bc14-0cdbb342382d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:17.793708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8bfd5-6b5b-43b5-bc14-0cdbb342382d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:17.793988 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8bfd5-6b5b-43b5-bc14-0cdbb342382d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:17.794261 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca8bfd5-6b5b-43b5-bc14-0cdbb342382d admin admin] PATH_INFO: `/v3/users/f85abea80901404a809dffef8c60a860` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:17.796094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8bfd5-6b5b-43b5-bc14-0cdbb342382d admin admin] RBAC: Authorizing `identity:delete_user(user_id=f85abea80901404a809dffef8c60a860)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:17.798071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca8bfd5-6b5b-43b5-bc14-0cdbb342382d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:17.806923 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1303/2560] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:30:17 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:30:17.807744 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317552-7add-427d-b907-b130afd9e6d2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:17.818484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc317552-7add-427d-b907-b130afd9e6d2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:17.823893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e85709-7d18-4cf1-b2b1-5911b1b1401b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:17.824585 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e85709-7d18-4cf1-b2b1-5911b1b1401b admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:17.824806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e85709-7d18-4cf1-b2b1-5911b1b1401b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:17.825159 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e85709-7d18-4cf1-b2b1-5911b1b1401b admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:17.825868 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e85709-7d18-4cf1-b2b1-5911b1b1401b admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:17.828077 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e85709-7d18-4cf1-b2b1-5911b1b1401b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:17.858498 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-aca8bfd5-6b5b-43b5-bc14-0cdbb342382d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f85abea80901404a809dffef8c60a860'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.862830 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1304/2561] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:17 2022] POST /identity/v3/projects => generated 379 bytes in 56 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:30:17.866133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-aca8bfd5-6b5b-43b5-bc14-0cdbb342382d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f85abea80901404a809dffef8c60a860'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.867008 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-aca8bfd5-6b5b-43b5-bc14-0cdbb342382d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f85abea80901404a809dffef8c60a860'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.867282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e85709-7d18-4cf1-b2b1-5911b1b1401b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:17.882233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-aca8bfd5-6b5b-43b5-bc14-0cdbb342382d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f85abea80901404a809dffef8c60a860'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.887824 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:17.892258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-aca8bfd5-6b5b-43b5-bc14-0cdbb342382d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f85abea80901404a809dffef8c60a860'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:17.902855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1258/2562] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:17 2022] DELETE /identity/v3/users/f85abea80901404a809dffef8c60a860 => generated 0 bytes in 183 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:17.907722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520e3cf-1abe-473f-93a7-e11db467457a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:17.908087 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520e3cf-1abe-473f-93a7-e11db467457a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:17.908439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3520e3cf-1abe-473f-93a7-e11db467457a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:17.928309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3520e3cf-1abe-473f-93a7-e11db467457a None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:17.929588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3520e3cf-1abe-473f-93a7-e11db467457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:17.942564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e85709-7d18-4cf1-b2b1-5911b1b1401b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:17.989444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1259/2563] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:17.995221 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=2,keystone:DELETE=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:17.999558 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520e3cf-1abe-473f-93a7-e11db467457a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:18.000905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3520e3cf-1abe-473f-93a7-e11db467457a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:18.002948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428552e-5d83-49cd-80bf-750db6b20873 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:18.003638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428552e-5d83-49cd-80bf-750db6b20873 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.004288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428552e-5d83-49cd-80bf-750db6b20873 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.004633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6428552e-5d83-49cd-80bf-750db6b20873 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.005667 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428552e-5d83-49cd-80bf-750db6b20873 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:18.007813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6428552e-5d83-49cd-80bf-750db6b20873 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:18.028266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1305/2564] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:17 2022] POST /identity/v3/users => generated 290 bytes in 161 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:18.032895 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428552e-5d83-49cd-80bf-750db6b20873 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:18.035640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6428552e-5d83-49cd-80bf-750db6b20873 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:18.047532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6428552e-5d83-49cd-80bf-750db6b20873 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:18.052542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d437abe-1ebc-41d9-b80f-205c55e9bdb8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:18.053253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d437abe-1ebc-41d9-b80f-205c55e9bdb8 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.053534 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d437abe-1ebc-41d9-b80f-205c55e9bdb8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.053841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d437abe-1ebc-41d9-b80f-205c55e9bdb8 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.054533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d437abe-1ebc-41d9-b80f-205c55e9bdb8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:18.056107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d437abe-1ebc-41d9-b80f-205c55e9bdb8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:18.064016 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3520e3cf-1abe-473f-93a7-e11db467457a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:18.066137 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1306/2565] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:30:18.070057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d437abe-1ebc-41d9-b80f-205c55e9bdb8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:18.070636 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d06fab-1fbf-4449-ab50-0d2fa12eb2e0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:18.071278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d06fab-1fbf-4449-ab50-0d2fa12eb2e0 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.071563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d06fab-1fbf-4449-ab50-0d2fa12eb2e0 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.071838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d06fab-1fbf-4449-ab50-0d2fa12eb2e0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.080776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d437abe-1ebc-41d9-b80f-205c55e9bdb8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:18.081486 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d06fab-1fbf-4449-ab50-0d2fa12eb2e0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:18.082910 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d06fab-1fbf-4449-ab50-0d2fa12eb2e0 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:18.085604 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0d12470-aa23-4332-a0c8-cc0a2b9e363b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:18.086266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d12470-aa23-4332-a0c8-cc0a2b9e363b admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.086632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d12470-aa23-4332-a0c8-cc0a2b9e363b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.086990 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0d12470-aa23-4332-a0c8-cc0a2b9e363b admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.087703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d12470-aa23-4332-a0c8-cc0a2b9e363b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:18.089545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0d12470-aa23-4332-a0c8-cc0a2b9e363b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:18.093548 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1260/2566] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:18.108118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1307/2567] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 36 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:30:18.110021 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d06fab-1fbf-4449-ab50-0d2fa12eb2e0 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:18.119641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d06fab-1fbf-4449-ab50-0d2fa12eb2e0 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:18.124323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dbe9b-52df-4ae7-80e2-7cf02c1e8948 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:18.125246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dbe9b-52df-4ae7-80e2-7cf02c1e8948 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.125572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dbe9b-52df-4ae7-80e2-7cf02c1e8948 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.125845 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec2dbe9b-52df-4ae7-80e2-7cf02c1e8948 admin admin] PATH_INFO: `/v3/projects/123262f4501e4abc8c3649a03637981d/users/c93f54a202414e13b9888ef37915fd8e/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.141951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dbe9b-52df-4ae7-80e2-7cf02c1e8948 admin admin] RBAC: Authorizing `identity:create_grant(project_id=123262f4501e4abc8c3649a03637981d, user_id=c93f54a202414e13b9888ef37915fd8e, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:18.146222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec2dbe9b-52df-4ae7-80e2-7cf02c1e8948 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:18.167682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1261/2568] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:18 2022] PUT /identity/v3/projects/123262f4501e4abc8c3649a03637981d/users/c93f54a202414e13b9888ef37915fd8e/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:18.178491 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2967c-bd21-4865-8839-8d62a2ea4dae None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.179079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2967c-bd21-4865-8839-8d62a2ea4dae None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.179584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09b2967c-bd21-4865-8839-8d62a2ea4dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.211876 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-09b2967c-bd21-4865-8839-8d62a2ea4dae None None] MFA Rules not processed for user `c93f54a202414e13b9888ef37915fd8e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:18.213590 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-09b2967c-bd21-4865-8839-8d62a2ea4dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:18.293043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1308/2569] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:18 2022] POST /identity/v3/auth/tokens => generated 3246 bytes in 115 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:18.296461 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dbe9b-52df-4ae7-80e2-7cf02c1e8948 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:18.372215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec2dbe9b-52df-4ae7-80e2-7cf02c1e8948 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:18.377408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba24f0-b627-4a66-9d3b-fe0e10af1898 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:18.378065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba24f0-b627-4a66-9d3b-fe0e10af1898 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.378344 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba24f0-b627-4a66-9d3b-fe0e10af1898 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.378618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32ba24f0-b627-4a66-9d3b-fe0e10af1898 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.379360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba24f0-b627-4a66-9d3b-fe0e10af1898 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:18.381230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32ba24f0-b627-4a66-9d3b-fe0e10af1898 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:18.391075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2967c-bd21-4865-8839-8d62a2ea4dae None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:18.392549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-09b2967c-bd21-4865-8839-8d62a2ea4dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:18.405946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:18.408703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09b2967c-bd21-4865-8839-8d62a2ea4dae None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:18.416894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1262/2570] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:18 2022] POST /identity/v3/projects => generated 377 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:18.417107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:18.417107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.417107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.417107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] PATH_INFO: `/v3/projects/83b105ef2eeb4b7491aabc9b6aecdbe6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.418435 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=83b105ef2eeb4b7491aabc9b6aecdbe6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:18.423415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:18.424797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba24f0-b627-4a66-9d3b-fe0e10af1898 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:18.472027 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '83b105ef2eeb4b7491aabc9b6aecdbe6', 'request_id': 'req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:18.480086 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '83b105ef2eeb4b7491aabc9b6aecdbe6', 'request_id': 'req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:18.486810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32ba24f0-b627-4a66-9d3b-fe0e10af1898 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:18.487154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '83b105ef2eeb4b7491aabc9b6aecdbe6', 'request_id': 'req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:18.498522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] The token cache is being invalidate because project 83b105ef2eeb4b7491aabc9b6aecdbe6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:18.498809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:18.499455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:18.501016 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1309/2571] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:18 2022] DELETE /identity/v3/projects/83b105ef2eeb4b7491aabc9b6aecdbe6 => generated 0 bytes in 110 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:18.504777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:18.506108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:18.544164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fbdf0-ac07-49b0-88ae-3fa4f6c73356 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:18.545531 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fbdf0-ac07-49b0-88ae-3fa4f6c73356 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.545814 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fbdf0-ac07-49b0-88ae-3fa4f6c73356 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.546089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-300fbdf0-ac07-49b0-88ae-3fa4f6c73356 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.546769 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fbdf0-ac07-49b0-88ae-3fa4f6c73356 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:18.547691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:INSERT=4,keystone:DELETE=7 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:18.549130 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-300fbdf0-ac07-49b0-88ae-3fa4f6c73356 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:18.569517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1263/2572] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:18 2022] POST /identity/v3/users => generated 295 bytes in 145 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:18.573435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fbdf0-ac07-49b0-88ae-3fa4f6c73356 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:18.575027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-300fbdf0-ac07-49b0-88ae-3fa4f6c73356 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:18.578215 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b32eaa71-18e8-43fe-aa7e-2931adf9a1b6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:18.582938 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635128b-d600-48c9-b3ed-159c4314cd3e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:18.583890 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635128b-d600-48c9-b3ed-159c4314cd3e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.584173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635128b-d600-48c9-b3ed-159c4314cd3e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.584448 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b635128b-d600-48c9-b3ed-159c4314cd3e admin admin] PATH_INFO: `/v3/users/1ba11866d84c45c78f50ae13747cdd9b` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.585659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635128b-d600-48c9-b3ed-159c4314cd3e admin admin] RBAC: Authorizing `identity:delete_user(user_id=1ba11866d84c45c78f50ae13747cdd9b)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:18.586861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-300fbdf0-ac07-49b0-88ae-3fa4f6c73356 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:18.587579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b635128b-d600-48c9-b3ed-159c4314cd3e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:18.592404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d0412-6c1f-41fd-b145-416052a45649 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:18.593081 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d0412-6c1f-41fd-b145-416052a45649 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.593368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d0412-6c1f-41fd-b145-416052a45649 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.593645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-275d0412-6c1f-41fd-b145-416052a45649 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.594362 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d0412-6c1f-41fd-b145-416052a45649 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:18.596007 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-275d0412-6c1f-41fd-b145-416052a45649 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:18.606037 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1264/2573] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:30:18.610818 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d0412-6c1f-41fd-b145-416052a45649 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:18.621106 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-275d0412-6c1f-41fd-b145-416052a45649 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:18.626186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37093a2-0b36-4b19-8bbf-9ac97ab2a7ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:18.627053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37093a2-0b36-4b19-8bbf-9ac97ab2a7ee admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.627336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37093a2-0b36-4b19-8bbf-9ac97ab2a7ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.627616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e37093a2-0b36-4b19-8bbf-9ac97ab2a7ee admin admin] PATH_INFO: `/v3/projects/32ee8a96c8f142db85bcf3073764107e/users/93c4022067ae489e8da4890f15651ba8/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.641385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b635128b-d600-48c9-b3ed-159c4314cd3e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '1ba11866d84c45c78f50ae13747cdd9b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:18.642061 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b635128b-d600-48c9-b3ed-159c4314cd3e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '1ba11866d84c45c78f50ae13747cdd9b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:18.642934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37093a2-0b36-4b19-8bbf-9ac97ab2a7ee admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ee8a96c8f142db85bcf3073764107e, user_id=93c4022067ae489e8da4890f15651ba8, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:18.645649 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e37093a2-0b36-4b19-8bbf-9ac97ab2a7ee admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:18.649067 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b635128b-d600-48c9-b3ed-159c4314cd3e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '1ba11866d84c45c78f50ae13747cdd9b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:18.649818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b635128b-d600-48c9-b3ed-159c4314cd3e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '1ba11866d84c45c78f50ae13747cdd9b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:18.659465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1265/2574] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:18 2022] PUT /identity/v3/projects/32ee8a96c8f142db85bcf3073764107e/users/93c4022067ae489e8da4890f15651ba8/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:18.663377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37093a2-0b36-4b19-8bbf-9ac97ab2a7ee admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:18.664672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b635128b-d600-48c9-b3ed-159c4314cd3e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '1ba11866d84c45c78f50ae13747cdd9b'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:18.665204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e37093a2-0b36-4b19-8bbf-9ac97ab2a7ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:18.678789 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1310/2575] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:18 2022] DELETE /identity/v3/users/1ba11866d84c45c78f50ae13747cdd9b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:18.735904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e37093a2-0b36-4b19-8bbf-9ac97ab2a7ee admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:18.741173 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:18.797402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98417a05-3f3a-44d7-80be-259841d6b473 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:18.798092 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98417a05-3f3a-44d7-80be-259841d6b473 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.798372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98417a05-3f3a-44d7-80be-259841d6b473 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.798643 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98417a05-3f3a-44d7-80be-259841d6b473 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.799354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98417a05-3f3a-44d7-80be-259841d6b473 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:18.800946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98417a05-3f3a-44d7-80be-259841d6b473 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:18.810760 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1266/2576] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:18 2022] GET /identity/v3/roles => generated 1420 bytes in 148 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:30:18.814928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635128b-d600-48c9-b3ed-159c4314cd3e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:18.825120 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b635128b-d600-48c9-b3ed-159c4314cd3e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:18.830994 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b49e1-2e41-4baa-a454-ac172f9a146b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:18.832042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b49e1-2e41-4baa-a454-ac172f9a146b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.832439 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b49e1-2e41-4baa-a454-ac172f9a146b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.845390 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-561b49e1-2e41-4baa-a454-ac172f9a146b admin admin] PATH_INFO: `/v3/projects/32ee8a96c8f142db85bcf3073764107e/users/93c4022067ae489e8da4890f15651ba8/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.848384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b49e1-2e41-4baa-a454-ac172f9a146b admin admin] RBAC: Authorizing `identity:create_grant(project_id=32ee8a96c8f142db85bcf3073764107e, user_id=93c4022067ae489e8da4890f15651ba8, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:18.851132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-561b49e1-2e41-4baa-a454-ac172f9a146b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:18.862085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1311/2577] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:18 2022] PUT /identity/v3/projects/32ee8a96c8f142db85bcf3073764107e/users/93c4022067ae489e8da4890f15651ba8/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:18.872238 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba3f9-dde4-47b3-a3ca-327bb6b71462 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:18.872578 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba3f9-dde4-47b3-a3ca-327bb6b71462 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:18.872911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceba3f9-dde4-47b3-a3ca-327bb6b71462 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:18.899427 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-3ceba3f9-dde4-47b3-a3ca-327bb6b71462 None None] MFA Rules not processed for user `93c4022067ae489e8da4890f15651ba8`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:18.900556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3ceba3f9-dde4-47b3-a3ca-327bb6b71462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:18.962864 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b49e1-2e41-4baa-a454-ac172f9a146b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:18.965181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-561b49e1-2e41-4baa-a454-ac172f9a146b admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:18.997771 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1267/2578] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:18 2022] POST /identity/v3/auth/tokens => generated 3311 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:18.999027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceba3f9-dde4-47b3-a3ca-327bb6b71462 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:19.000678 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3ceba3f9-dde4-47b3-a3ca-327bb6b71462 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:19.061768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceba3f9-dde4-47b3-a3ca-327bb6b71462 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:19.063282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-561b49e1-2e41-4baa-a454-ac172f9a146b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:19.065467 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1a1dfa7-38ff-4289-80cf-6d16b7f0dd0c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:19.066154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1dfa7-38ff-4289-80cf-6d16b7f0dd0c service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.066398 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1dfa7-38ff-4289-80cf-6d16b7f0dd0c service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.066684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1a1dfa7-38ff-4289-80cf-6d16b7f0dd0c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.068328 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fc64330-2971-48f7-aedf-7d82732086e4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:19.068474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f1a1dfa7-38ff-4289-80cf-6d16b7f0dd0c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:19.069208 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64330-2971-48f7-aedf-7d82732086e4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.069566 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64330-2971-48f7-aedf-7d82732086e4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.069766 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fc64330-2971-48f7-aedf-7d82732086e4 admin admin] PATH_INFO: `/v3/projects/842e6c7b12024966b652613a6ee4fdd2` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.070921 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc64330-2971-48f7-aedf-7d82732086e4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=842e6c7b12024966b652613a6ee4fdd2)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:19.072799 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fc64330-2971-48f7-aedf-7d82732086e4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:19.115703 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:19.115911 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:19.120691 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fc64330-2971-48f7-aedf-7d82732086e4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '842e6c7b12024966b652613a6ee4fdd2', 'request_id': 'req-5fc64330-2971-48f7-aedf-7d82732086e4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:19.129926 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fc64330-2971-48f7-aedf-7d82732086e4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '842e6c7b12024966b652613a6ee4fdd2', 'request_id': 'req-5fc64330-2971-48f7-aedf-7d82732086e4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:19.133161 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1dfa7-38ff-4289-80cf-6d16b7f0dd0c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:19.134687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1a1dfa7-38ff-4289-80cf-6d16b7f0dd0c service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:19.135774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fc64330-2971-48f7-aedf-7d82732086e4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '842e6c7b12024966b652613a6ee4fdd2', 'request_id': 'req-5fc64330-2971-48f7-aedf-7d82732086e4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:19.147634 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fc64330-2971-48f7-aedf-7d82732086e4 admin admin] The token cache is being invalidate because project 842e6c7b12024966b652613a6ee4fdd2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:19.148399 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fc64330-2971-48f7-aedf-7d82732086e4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:19.148584 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5fc64330-2971-48f7-aedf-7d82732086e4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:19.150233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1312/2579] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:18 2022] DELETE /identity/v3/projects/842e6c7b12024966b652613a6ee4fdd2 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:19.150721 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1268/2580] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:18 2022] GET /identity/v3/auth/tokens => generated 3246 bytes in 152 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:30:19.154755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a984a-c77c-421e-8370-19293ec8a9b8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.155048 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a984a-c77c-421e-8370-19293ec8a9b8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.155331 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-469a984a-c77c-421e-8370-19293ec8a9b8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.174451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-469a984a-c77c-421e-8370-19293ec8a9b8 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:19.175741 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-469a984a-c77c-421e-8370-19293ec8a9b8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:19.238659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1313/2581] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:19.246469 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00439f-e1ac-4306-8908-4d90d34e7d81 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.246789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00439f-e1ac-4306-8908-4d90d34e7d81 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.247172 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef00439f-e1ac-4306-8908-4d90d34e7d81 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.266465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-ef00439f-e1ac-4306-8908-4d90d34e7d81 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:19.267655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ef00439f-e1ac-4306-8908-4d90d34e7d81 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:19.275811 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1269/2582] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:19.280182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a984a-c77c-421e-8370-19293ec8a9b8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:19.290851 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-469a984a-c77c-421e-8370-19293ec8a9b8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:19.295633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04117d-709c-40eb-affb-f5247d75d3fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:19.296353 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04117d-709c-40eb-affb-f5247d75d3fb admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.296701 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04117d-709c-40eb-affb-f5247d75d3fb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.297056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d04117d-709c-40eb-affb-f5247d75d3fb admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.297922 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04117d-709c-40eb-affb-f5247d75d3fb admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:30:19.298270 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04117d-709c-40eb-affb-f5247d75d3fb admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:19.299874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d04117d-709c-40eb-affb-f5247d75d3fb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:19.313286 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1314/2583] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:30:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:30:19.317889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00439f-e1ac-4306-8908-4d90d34e7d81 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:19.330929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef00439f-e1ac-4306-8908-4d90d34e7d81 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:19.336280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d199-e900-4daa-a813-0960cb0f3ab0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:19.336944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d199-e900-4daa-a813-0960cb0f3ab0 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.337271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d199-e900-4daa-a813-0960cb0f3ab0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.337546 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a71d199-e900-4daa-a813-0960cb0f3ab0 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.338474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71d199-e900-4daa-a813-0960cb0f3ab0 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:19.340396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a71d199-e900-4daa-a813-0960cb0f3ab0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:19.369690 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1270/2584] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:19 2022] POST /identity/v3/projects => generated 405 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:19.374936 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04117d-709c-40eb-affb-f5247d75d3fb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:19.387095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d04117d-709c-40eb-affb-f5247d75d3fb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:19.462416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a471998-3d4d-408e-8c4e-ab10aa05abc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:19.464545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a471998-3d4d-408e-8c4e-ab10aa05abc3 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.464905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a471998-3d4d-408e-8c4e-ab10aa05abc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.465190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a471998-3d4d-408e-8c4e-ab10aa05abc3 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.466643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a471998-3d4d-408e-8c4e-ab10aa05abc3 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:19.469414 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a471998-3d4d-408e-8c4e-ab10aa05abc3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:19.492251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1315/2585] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:19 2022] POST /identity/v3/users => generated 303 bytes in 119 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:30:19.498275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d199-e900-4daa-a813-0960cb0f3ab0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:19.511178 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a71d199-e900-4daa-a813-0960cb0f3ab0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:19.517403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a480f8-451b-48b3-a03a-d42733897a6b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:19.518163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a480f8-451b-48b3-a03a-d42733897a6b admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.518441 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a480f8-451b-48b3-a03a-d42733897a6b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.518714 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a480f8-451b-48b3-a03a-d42733897a6b admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.519497 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a480f8-451b-48b3-a03a-d42733897a6b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:19.521168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a480f8-451b-48b3-a03a-d42733897a6b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:19.537061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1271/2586] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:30:19.538656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a471998-3d4d-408e-8c4e-ab10aa05abc3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:19.549525 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a471998-3d4d-408e-8c4e-ab10aa05abc3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:19.554110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-942fc77e-9a48-4a1d-adb6-7f385d09942a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:19.554768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fc77e-9a48-4a1d-adb6-7f385d09942a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.555050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fc77e-9a48-4a1d-adb6-7f385d09942a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.555324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-942fc77e-9a48-4a1d-adb6-7f385d09942a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.556161 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fc77e-9a48-4a1d-adb6-7f385d09942a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:19.557780 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-942fc77e-9a48-4a1d-adb6-7f385d09942a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:19.568461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1316/2587] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:19.572618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a480f8-451b-48b3-a03a-d42733897a6b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:19.582658 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a480f8-451b-48b3-a03a-d42733897a6b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:19.587257 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45103c9c-c2f1-4d4e-967f-a7f93cc921d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:19.588127 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45103c9c-c2f1-4d4e-967f-a7f93cc921d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.589291 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45103c9c-c2f1-4d4e-967f-a7f93cc921d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.589589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45103c9c-c2f1-4d4e-967f-a7f93cc921d2 admin admin] PATH_INFO: `/v3/projects/7b28dd80d00a4f7383bdf0040011dfa2/users/9d75962e08104b0fa44ac0358fd088c1/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.605264 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45103c9c-c2f1-4d4e-967f-a7f93cc921d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=7b28dd80d00a4f7383bdf0040011dfa2, user_id=9d75962e08104b0fa44ac0358fd088c1, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:19.608460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45103c9c-c2f1-4d4e-967f-a7f93cc921d2 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:19.620740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1272/2588] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:19 2022] PUT /identity/v3/projects/7b28dd80d00a4f7383bdf0040011dfa2/users/9d75962e08104b0fa44ac0358fd088c1/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:19.631772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f27ba-e2b1-4617-8439-4eb4b152e097 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.632065 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f27ba-e2b1-4617-8439-4eb4b152e097 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.632346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3f27ba-e2b1-4617-8439-4eb4b152e097 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.658272 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-2d3f27ba-e2b1-4617-8439-4eb4b152e097 None None] MFA Rules not processed for user `9d75962e08104b0fa44ac0358fd088c1`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:19.659485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-2d3f27ba-e2b1-4617-8439-4eb4b152e097 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:19.686901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=92,keystone:DELETE=4,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:19.728732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1317/2589] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:19 2022] POST /identity/v3/auth/tokens => generated 3272 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:19.734142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45103c9c-c2f1-4d4e-967f-a7f93cc921d2 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:19.793328 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45103c9c-c2f1-4d4e-967f-a7f93cc921d2 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:19.798376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ff53e-0c42-43b3-9ace-a8f13d9abc17 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:19.799025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ff53e-0c42-43b3-9ace-a8f13d9abc17 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.799309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ff53e-0c42-43b3-9ace-a8f13d9abc17 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.799587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a4ff53e-0c42-43b3-9ace-a8f13d9abc17 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.800272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ff53e-0c42-43b3-9ace-a8f13d9abc17 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:19.802224 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a4ff53e-0c42-43b3-9ace-a8f13d9abc17 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:19.828482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1273/2590] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:19 2022] POST /identity/v3/projects => generated 409 bytes in 95 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:19.832615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f27ba-e2b1-4617-8439-4eb4b152e097 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:19.844055 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d3f27ba-e2b1-4617-8439-4eb4b152e097 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:19.899069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810214a-7dfd-4d52-9819-7a196b508d75 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:19.899730 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810214a-7dfd-4d52-9819-7a196b508d75 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.900013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810214a-7dfd-4d52-9819-7a196b508d75 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.900288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8810214a-7dfd-4d52-9819-7a196b508d75 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.900977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810214a-7dfd-4d52-9819-7a196b508d75 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:19.902976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8810214a-7dfd-4d52-9819-7a196b508d75 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:19.922882 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1318/2591] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:19 2022] POST /identity/v3/users => generated 311 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:19.927120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ff53e-0c42-43b3-9ace-a8f13d9abc17 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:19.937788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a4ff53e-0c42-43b3-9ace-a8f13d9abc17 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:19.942379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dade1-4306-453d-b86d-ef3cef6f3e6d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:19.943025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dade1-4306-453d-b86d-ef3cef6f3e6d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.943301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dade1-4306-453d-b86d-ef3cef6f3e6d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.943572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-649dade1-4306-453d-b86d-ef3cef6f3e6d admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.944278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649dade1-4306-453d-b86d-ef3cef6f3e6d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:19.945906 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-649dade1-4306-453d-b86d-ef3cef6f3e6d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:19.956434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1274/2592] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:19 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:19.960517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810214a-7dfd-4d52-9819-7a196b508d75 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:19.971112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8810214a-7dfd-4d52-9819-7a196b508d75 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:19.975715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78aab85-5311-4104-a068-4d8596fec053 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:19.976592 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aab85-5311-4104-a068-4d8596fec053 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:19.976873 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aab85-5311-4104-a068-4d8596fec053 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:19.977184 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78aab85-5311-4104-a068-4d8596fec053 admin admin] PATH_INFO: `/v3/projects/0d965dd0fd65454daf77f7ad7215392d/users/d448c8d6fc0948d699e69fc7a8e482a1/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:19.992223 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78aab85-5311-4104-a068-4d8596fec053 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d965dd0fd65454daf77f7ad7215392d, user_id=d448c8d6fc0948d699e69fc7a8e482a1, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:19.994911 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d78aab85-5311-4104-a068-4d8596fec053 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:20.008010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1319/2593] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:19 2022] PUT /identity/v3/projects/0d965dd0fd65454daf77f7ad7215392d/users/d448c8d6fc0948d699e69fc7a8e482a1/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:20.011993 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dade1-4306-453d-b86d-ef3cef6f3e6d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:20.021855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-649dade1-4306-453d-b86d-ef3cef6f3e6d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:20.077606 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:20.086032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6116138b-4e83-4391-b12d-11cbb3a3cf74 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:20.086761 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116138b-4e83-4391-b12d-11cbb3a3cf74 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:20.087050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116138b-4e83-4391-b12d-11cbb3a3cf74 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:20.087641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6116138b-4e83-4391-b12d-11cbb3a3cf74 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:20.088097 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116138b-4e83-4391-b12d-11cbb3a3cf74 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:20.090027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6116138b-4e83-4391-b12d-11cbb3a3cf74 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:20.100720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1275/2594] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:20 2022] GET /identity/v3/roles => generated 1420 bytes in 89 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:20.104926 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78aab85-5311-4104-a068-4d8596fec053 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:20.116781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d78aab85-5311-4104-a068-4d8596fec053 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:20.121516 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c9ea6-8eb0-4416-85f2-bf7b4ed65f91 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:20.122403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c9ea6-8eb0-4416-85f2-bf7b4ed65f91 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:20.122717 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c9ea6-8eb0-4416-85f2-bf7b4ed65f91 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:20.122995 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9c9ea6-8eb0-4416-85f2-bf7b4ed65f91 admin admin] PATH_INFO: `/v3/projects/0d965dd0fd65454daf77f7ad7215392d/users/d448c8d6fc0948d699e69fc7a8e482a1/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:20.124975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c9ea6-8eb0-4416-85f2-bf7b4ed65f91 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0d965dd0fd65454daf77f7ad7215392d, user_id=d448c8d6fc0948d699e69fc7a8e482a1, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:20.127649 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9c9ea6-8eb0-4416-85f2-bf7b4ed65f91 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:20.140059 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1320/2595] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:20 2022] PUT /identity/v3/projects/0d965dd0fd65454daf77f7ad7215392d/users/d448c8d6fc0948d699e69fc7a8e482a1/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:20.154785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec3c6a-85cd-4c04-950d-68463b1e7d79 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:20.155026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec3c6a-85cd-4c04-950d-68463b1e7d79 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:20.155309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ec3c6a-85cd-4c04-950d-68463b1e7d79 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:20.186546 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-63ec3c6a-85cd-4c04-950d-68463b1e7d79 None None] MFA Rules not processed for user `d448c8d6fc0948d699e69fc7a8e482a1`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:20.187915 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-63ec3c6a-85cd-4c04-950d-68463b1e7d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:20.257045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1276/2596] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:20 2022] POST /identity/v3/auth/tokens => generated 3343 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:20.268186 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c9ea6-8eb0-4416-85f2-bf7b4ed65f91 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:20.269914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-af9c9ea6-8eb0-4416-85f2-bf7b4ed65f91 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:20.328877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9c9ea6-8eb0-4416-85f2-bf7b4ed65f91 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:20.332569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc794e-fddd-453f-b36b-1f1253f49d7e service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:20.333258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc794e-fddd-453f-b36b-1f1253f49d7e service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:20.333542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc794e-fddd-453f-b36b-1f1253f49d7e service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:20.333820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bc794e-fddd-453f-b36b-1f1253f49d7e service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:20.343738 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc794e-fddd-453f-b36b-1f1253f49d7e service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:20.345185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bc794e-fddd-453f-b36b-1f1253f49d7e service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:20.354465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1321/2597] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:20 2022] GET /identity/v3/auth/tokens => generated 3343 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:20.532630 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec3c6a-85cd-4c04-950d-68463b1e7d79 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:20.534219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-63ec3c6a-85cd-4c04-950d-68463b1e7d79 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:20.547269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ec3c6a-85cd-4c04-950d-68463b1e7d79 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:20.551377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-775a7985-2a12-4941-b88b-b4415e649293 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:20.552115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7985-2a12-4941-b88b-b4415e649293 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:20.552450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7985-2a12-4941-b88b-b4415e649293 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:20.552727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-775a7985-2a12-4941-b88b-b4415e649293 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:20.561880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc794e-fddd-453f-b36b-1f1253f49d7e service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:20.573089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bc794e-fddd-453f-b36b-1f1253f49d7e service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:20.583611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9d880-028c-4786-b1fc-41bd792fe461 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:20.584418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9d880-028c-4786-b1fc-41bd792fe461 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:20.584776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9d880-028c-4786-b1fc-41bd792fe461 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:20.585139 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ab9d880-028c-4786-b1fc-41bd792fe461 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:20.587457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5ab9d880-028c-4786-b1fc-41bd792fe461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:20.619081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:20.630171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a7985-2a12-4941-b88b-b4415e649293 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:20.631675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-775a7985-2a12-4941-b88b-b4415e649293 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:20.649198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1277/2598] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:20 2022] GET /identity/v3/auth/tokens => generated 3272 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:20.685706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9d880-028c-4786-b1fc-41bd792fe461 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:20.687213 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ab9d880-028c-4786-b1fc-41bd792fe461 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:20.705983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1322/2599] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:20 2022] GET /identity/v3/auth/tokens => generated 3311 bytes in 144 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:30:21.859810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48ab73-70c3-4160-b11f-bb56f0713fe0 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:21.860269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48ab73-70c3-4160-b11f-bb56f0713fe0 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:21.860364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e48ab73-70c3-4160-b11f-bb56f0713fe0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:21.877885 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2e48ab73-70c3-4160-b11f-bb56f0713fe0 None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:21.879090 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2e48ab73-70c3-4160-b11f-bb56f0713fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:21.947061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1278/2600] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:30:21 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 88 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:21.959739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9d880-028c-4786-b1fc-41bd792fe461 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:21.963393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5ab9d880-028c-4786-b1fc-41bd792fe461 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:22.042912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ab9d880-028c-4786-b1fc-41bd792fe461 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:22.050363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67c90334-0a82-4b8d-9710-2417c342ab6e service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:22.051025 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c90334-0a82-4b8d-9710-2417c342ab6e service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:22.051354 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c90334-0a82-4b8d-9710-2417c342ab6e service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:22.052012 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67c90334-0a82-4b8d-9710-2417c342ab6e service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:22.063842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c90334-0a82-4b8d-9710-2417c342ab6e service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:22.065482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67c90334-0a82-4b8d-9710-2417c342ab6e service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:22.077994 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1323/2601] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:30:21 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:30:24.710706 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48ab73-70c3-4160-b11f-bb56f0713fe0 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:24.712186 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2e48ab73-70c3-4160-b11f-bb56f0713fe0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:24.738610 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=100 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:24.793134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e48ab73-70c3-4160-b11f-bb56f0713fe0 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:24.798099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438fdca-f81c-46d4-a3ea-314b6ba74128 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:24.799050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438fdca-f81c-46d4-a3ea-314b6ba74128 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:24.799328 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438fdca-f81c-46d4-a3ea-314b6ba74128 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:24.799606 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3438fdca-f81c-46d4-a3ea-314b6ba74128 admin admin] PATH_INFO: `/v3/users/c93f54a202414e13b9888ef37915fd8e` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:24.800805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438fdca-f81c-46d4-a3ea-314b6ba74128 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c93f54a202414e13b9888ef37915fd8e)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:24.802779 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3438fdca-f81c-46d4-a3ea-314b6ba74128 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:24.855677 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3438fdca-f81c-46d4-a3ea-314b6ba74128 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c93f54a202414e13b9888ef37915fd8e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:24.863513 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3438fdca-f81c-46d4-a3ea-314b6ba74128 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c93f54a202414e13b9888ef37915fd8e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:24.864221 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3438fdca-f81c-46d4-a3ea-314b6ba74128 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c93f54a202414e13b9888ef37915fd8e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:24.878187 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3438fdca-f81c-46d4-a3ea-314b6ba74128 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c93f54a202414e13b9888ef37915fd8e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:24.886715 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-3438fdca-f81c-46d4-a3ea-314b6ba74128 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c93f54a202414e13b9888ef37915fd8e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:24.894495 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1279/2602] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:24 2022] DELETE /identity/v3/users/c93f54a202414e13b9888ef37915fd8e => generated 0 bytes in 184 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:24.898977 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944d4e2-77b2-4032-9b4a-868939e2acdc None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:24.899465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944d4e2-77b2-4032-9b4a-868939e2acdc None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:24.899605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a944d4e2-77b2-4032-9b4a-868939e2acdc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:24.917884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a944d4e2-77b2-4032-9b4a-868939e2acdc None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:24.919127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a944d4e2-77b2-4032-9b4a-868939e2acdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:25.000637 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1324/2603] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:24 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:25.010878 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438fdca-f81c-46d4-a3ea-314b6ba74128 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:25.013531 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3438fdca-f81c-46d4-a3ea-314b6ba74128 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:25.117187 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3438fdca-f81c-46d4-a3ea-314b6ba74128 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:25.122229 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441770fe-f518-44e6-ac12-96e81d4b1ad3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:25.122929 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441770fe-f518-44e6-ac12-96e81d4b1ad3 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:25.123213 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441770fe-f518-44e6-ac12-96e81d4b1ad3 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:25.123490 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-441770fe-f518-44e6-ac12-96e81d4b1ad3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:25.133344 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441770fe-f518-44e6-ac12-96e81d4b1ad3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:25.134802 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-441770fe-f518-44e6-ac12-96e81d4b1ad3 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:25.145368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1280/2604] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:25 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:25.535506 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944d4e2-77b2-4032-9b4a-868939e2acdc None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:25.537135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a944d4e2-77b2-4032-9b4a-868939e2acdc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:25.555850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a944d4e2-77b2-4032-9b4a-868939e2acdc None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:25.561021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:25.562098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:25.562444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:25.562786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] PATH_INFO: `/v3/projects/123262f4501e4abc8c3649a03637981d` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:25.564127 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] RBAC: Authorizing `identity:delete_project(project_id=123262f4501e4abc8c3649a03637981d)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:25.566498 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:25.647552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:25.655473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '123262f4501e4abc8c3649a03637981d', 'request_id': 'req-90cd56d8-de12-4ce6-bc2c-18ca40299756'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:25.664929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '123262f4501e4abc8c3649a03637981d', 'request_id': 'req-90cd56d8-de12-4ce6-bc2c-18ca40299756'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:25.674050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '123262f4501e4abc8c3649a03637981d', 'request_id': 'req-90cd56d8-de12-4ce6-bc2c-18ca40299756'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:25.685979 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] The token cache is being invalidate because project 123262f4501e4abc8c3649a03637981d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:25.686295 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:25.686915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:25.688832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1325/2605] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:25 2022] DELETE /identity/v3/projects/123262f4501e4abc8c3649a03637981d => generated 0 bytes in 154 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:25.692637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441770fe-f518-44e6-ac12-96e81d4b1ad3 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:25.704867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-441770fe-f518-44e6-ac12-96e81d4b1ad3 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:25.772791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:25.796069 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557fbad-651f-46ac-9529-e94e35f636c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:25.797350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557fbad-651f-46ac-9529-e94e35f636c2 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:25.797740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557fbad-651f-46ac-9529-e94e35f636c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:25.797904 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9557fbad-651f-46ac-9529-e94e35f636c2 admin admin] PATH_INFO: `/v3/users/93c4022067ae489e8da4890f15651ba8` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:25.799117 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557fbad-651f-46ac-9529-e94e35f636c2 admin admin] RBAC: Authorizing `identity:delete_user(user_id=93c4022067ae489e8da4890f15651ba8)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:25.801183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9557fbad-651f-46ac-9529-e94e35f636c2 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:25.850574 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9557fbad-651f-46ac-9529-e94e35f636c2 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '93c4022067ae489e8da4890f15651ba8'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:25.858924 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9557fbad-651f-46ac-9529-e94e35f636c2 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '93c4022067ae489e8da4890f15651ba8'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:25.859911 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9557fbad-651f-46ac-9529-e94e35f636c2 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '93c4022067ae489e8da4890f15651ba8'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:25.876841 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9557fbad-651f-46ac-9529-e94e35f636c2 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '93c4022067ae489e8da4890f15651ba8'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:25.887099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9557fbad-651f-46ac-9529-e94e35f636c2 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '93c4022067ae489e8da4890f15651ba8'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:25.895143 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1281/2606] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:25 2022] DELETE /identity/v3/users/93c4022067ae489e8da4890f15651ba8 => generated 0 bytes in 203 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:26.220894 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:26.222425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:26.242404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90cd56d8-de12-4ce6-bc2c-18ca40299756 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:26.360996 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:26.365793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:26.366352 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:26.366807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76 admin admin] PATH_INFO: `/v3/projects/32ee8a96c8f142db85bcf3073764107e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:26.368340 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76 admin admin] RBAC: Authorizing `identity:delete_project(project_id=32ee8a96c8f142db85bcf3073764107e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:26.370509 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:26.419170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557fbad-651f-46ac-9529-e94e35f636c2 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:26.421390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9557fbad-651f-46ac-9529-e94e35f636c2 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:26.438310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9557fbad-651f-46ac-9529-e94e35f636c2 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:26.467906 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '32ee8a96c8f142db85bcf3073764107e', 'request_id': 'req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:26.484069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '32ee8a96c8f142db85bcf3073764107e', 'request_id': 'req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:26.496009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '32ee8a96c8f142db85bcf3073764107e', 'request_id': 'req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:26.509180 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76 admin admin] The token cache is being invalidate because project 32ee8a96c8f142db85bcf3073764107e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:26.509553 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:26.512101 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-ac3b4162-6cf1-4b95-8a26-a0d4b5e11c76 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:26.515129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1326/2607] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:26 2022] DELETE /identity/v3/projects/32ee8a96c8f142db85bcf3073764107e => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:26.520337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0ba2-aa93-4b7f-a8c6-0f6c955c0951 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:26.520704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0ba2-aa93-4b7f-a8c6-0f6c955c0951 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:26.520945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ed0ba2-aa93-4b7f-a8c6-0f6c955c0951 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:26.523983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ee2131c-0203-4616-bba2-ed7f39854837 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:26.524867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2131c-0203-4616-bba2-ed7f39854837 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:26.525182 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2131c-0203-4616-bba2-ed7f39854837 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:26.525463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ee2131c-0203-4616-bba2-ed7f39854837 admin admin] PATH_INFO: `/v3/users/9d75962e08104b0fa44ac0358fd088c1` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:26.526651 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2131c-0203-4616-bba2-ed7f39854837 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9d75962e08104b0fa44ac0358fd088c1)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:26.530414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ee2131c-0203-4616-bba2-ed7f39854837 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:26.547489 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-58ed0ba2-aa93-4b7f-a8c6-0f6c955c0951 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:26.549017 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-58ed0ba2-aa93-4b7f-a8c6-0f6c955c0951 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:26.570988 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1327/2608] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:26.573639 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a3f47-ac2a-40a8-9122-658d4eab79fe None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:26.574056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a3f47-ac2a-40a8-9122-658d4eab79fe None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:26.574437 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-042a3f47-ac2a-40a8-9122-658d4eab79fe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:26.600576 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-042a3f47-ac2a-40a8-9122-658d4eab79fe None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:26.604531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-042a3f47-ac2a-40a8-9122-658d4eab79fe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:26.621216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6ee2131c-0203-4616-bba2-ed7f39854837 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9d75962e08104b0fa44ac0358fd088c1'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:26.630704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1328/2609] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:26.631323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6ee2131c-0203-4616-bba2-ed7f39854837 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9d75962e08104b0fa44ac0358fd088c1'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:26.632386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6ee2131c-0203-4616-bba2-ed7f39854837 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9d75962e08104b0fa44ac0358fd088c1'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:26.634478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a3f47-ac2a-40a8-9122-658d4eab79fe None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:26.639608 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=81,keystone:DELETE=18,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:26.648384 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-042a3f47-ac2a-40a8-9122-658d4eab79fe None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:26.650054 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6ee2131c-0203-4616-bba2-ed7f39854837 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9d75962e08104b0fa44ac0358fd088c1'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:26.655318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e58d47-06b8-45d0-ac4c-3a9fc98fddb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:26.656185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e58d47-06b8-45d0-ac4c-3a9fc98fddb6 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:26.656419 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e58d47-06b8-45d0-ac4c-3a9fc98fddb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:26.656723 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5e58d47-06b8-45d0-ac4c-3a9fc98fddb6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:26.657677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e58d47-06b8-45d0-ac4c-3a9fc98fddb6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:30:26.657945 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e58d47-06b8-45d0-ac4c-3a9fc98fddb6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:26.658864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6ee2131c-0203-4616-bba2-ed7f39854837 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9d75962e08104b0fa44ac0358fd088c1'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:26.659972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5e58d47-06b8-45d0-ac4c-3a9fc98fddb6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:26.675128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1282/2610] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:26 2022] DELETE /identity/v3/users/9d75962e08104b0fa44ac0358fd088c1 => generated 0 bytes in 254 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:26.677356 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee99aa-00f5-4de0-b1bb-0b948b8dc3a8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:26.677759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee99aa-00f5-4de0-b1bb-0b948b8dc3a8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:26.678026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9eee99aa-00f5-4de0-b1bb-0b948b8dc3a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:26.698380 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-9eee99aa-00f5-4de0-b1bb-0b948b8dc3a8 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:26.699644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9eee99aa-00f5-4de0-b1bb-0b948b8dc3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:26.710717 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1329/2611] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:30:26 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 77 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:30:26.715726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e58d47-06b8-45d0-ac4c-3a9fc98fddb6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:26.722038 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c5e58d47-06b8-45d0-ac4c-3a9fc98fddb6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:26.745678 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5e58d47-06b8-45d0-ac4c-3a9fc98fddb6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:26.777978 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1283/2612] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:26 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:26.789590 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee99aa-00f5-4de0-b1bb-0b948b8dc3a8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:26.792289 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9eee99aa-00f5-4de0-b1bb-0b948b8dc3a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:26.819352 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:26.859912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee4865-6788-4dc1-88a1-207963fe5e44 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:26.860514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee4865-6788-4dc1-88a1-207963fe5e44 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:26.860795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee4865-6788-4dc1-88a1-207963fe5e44 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:26.861118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ee4865-6788-4dc1-88a1-207963fe5e44 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:26.861824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee4865-6788-4dc1-88a1-207963fe5e44 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:26.863775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02ee4865-6788-4dc1-88a1-207963fe5e44 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:26.880972 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9eee99aa-00f5-4de0-b1bb-0b948b8dc3a8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:26.885330 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac39869-d776-400f-996f-38dfb68d43b5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:26.886154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac39869-d776-400f-996f-38dfb68d43b5 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:26.886439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac39869-d776-400f-996f-38dfb68d43b5 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:26.886988 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ac39869-d776-400f-996f-38dfb68d43b5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:26.900600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1330/2613] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:26 2022] POST /identity/v3/projects => generated 371 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:30:26.901602 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee4865-6788-4dc1-88a1-207963fe5e44 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:26.906283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac39869-d776-400f-996f-38dfb68d43b5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:26.908197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ac39869-d776-400f-996f-38dfb68d43b5 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:26.923693 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1284/2614] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:26 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 135 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:30:26.999815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02ee4865-6788-4dc1-88a1-207963fe5e44 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:27.006360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04857a8c-dd58-445b-8c12-e4ce767311d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:27.007150 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04857a8c-dd58-445b-8c12-e4ce767311d1 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:27.007638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04857a8c-dd58-445b-8c12-e4ce767311d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:27.007972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04857a8c-dd58-445b-8c12-e4ce767311d1 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:27.008838 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04857a8c-dd58-445b-8c12-e4ce767311d1 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:27.010897 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04857a8c-dd58-445b-8c12-e4ce767311d1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:27.041975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1331/2615] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:26 2022] POST /identity/v3/users => generated 286 bytes in 141 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:27.042850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac39869-d776-400f-996f-38dfb68d43b5 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:27.055751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ac39869-d776-400f-996f-38dfb68d43b5 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:27.075152 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe6309-9d63-4299-8dda-135b5fd2d23d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:27.075922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6309-9d63-4299-8dda-135b5fd2d23d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:27.076211 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6309-9d63-4299-8dda-135b5fd2d23d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:27.076494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dfe6309-9d63-4299-8dda-135b5fd2d23d admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:27.077254 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe6309-9d63-4299-8dda-135b5fd2d23d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:27.078887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dfe6309-9d63-4299-8dda-135b5fd2d23d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:27.102653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1285/2616] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 60 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:27.106842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04857a8c-dd58-445b-8c12-e4ce767311d1 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:27.143580 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04857a8c-dd58-445b-8c12-e4ce767311d1 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:27.162160 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12a924f4-4731-42ee-863d-4265dd7e7a08 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:27.165831 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a924f4-4731-42ee-863d-4265dd7e7a08 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:27.166131 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a924f4-4731-42ee-863d-4265dd7e7a08 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:27.166414 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12a924f4-4731-42ee-863d-4265dd7e7a08 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:27.167200 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a924f4-4731-42ee-863d-4265dd7e7a08 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:27.168839 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12a924f4-4731-42ee-863d-4265dd7e7a08 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:27.196752 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1332/2617] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:27 2022] GET /identity/v3/roles => generated 1420 bytes in 88 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:27.199713 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe6309-9d63-4299-8dda-135b5fd2d23d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:27.213587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dfe6309-9d63-4299-8dda-135b5fd2d23d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:27.218641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9909fe-a61c-4297-a224-f886e1375a4e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:27.220250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9909fe-a61c-4297-a224-f886e1375a4e admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:27.220701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9909fe-a61c-4297-a224-f886e1375a4e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:27.221120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef9909fe-a61c-4297-a224-f886e1375a4e admin admin] PATH_INFO: `/v3/projects/97475167a2bc45b8811f89b47fc5c317/users/30e278548ecf41abafe7b903565184b0/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:27.240793 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9909fe-a61c-4297-a224-f886e1375a4e admin admin] RBAC: Authorizing `identity:create_grant(project_id=97475167a2bc45b8811f89b47fc5c317, user_id=30e278548ecf41abafe7b903565184b0, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:27.244337 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef9909fe-a61c-4297-a224-f886e1375a4e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:27.262056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1286/2618] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:27 2022] PUT /identity/v3/projects/97475167a2bc45b8811f89b47fc5c317/users/30e278548ecf41abafe7b903565184b0/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 64 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:27.272833 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d54b8-4af9-41af-9873-ac9331a44743 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:27.273448 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d54b8-4af9-41af-9873-ac9331a44743 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:27.273448 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c92d54b8-4af9-41af-9873-ac9331a44743 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:27.305892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9909fe-a61c-4297-a224-f886e1375a4e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:27.307995 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-ef9909fe-a61c-4297-a224-f886e1375a4e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:27.308926 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c92d54b8-4af9-41af-9873-ac9331a44743 None None] MFA Rules not processed for user `30e278548ecf41abafe7b903565184b0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:27.310994 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c92d54b8-4af9-41af-9873-ac9331a44743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:27.412519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:DELETE=2,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:27.417769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1333/2619] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:27 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:27.430146 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d54b8-4af9-41af-9873-ac9331a44743 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:27.431593 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c92d54b8-4af9-41af-9873-ac9331a44743 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:27.442101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef9909fe-a61c-4297-a224-f886e1375a4e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:27.447232 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:27.448250 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:27.448637 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:27.449013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] PATH_INFO: `/v3/projects/7b28dd80d00a4f7383bdf0040011dfa2` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:27.451603 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] RBAC: Authorizing `identity:delete_project(project_id=7b28dd80d00a4f7383bdf0040011dfa2)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:27.454287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:27.469277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:27.515515 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c92d54b8-4af9-41af-9873-ac9331a44743 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:27.539062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '7b28dd80d00a4f7383bdf0040011dfa2', 'request_id': 'req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:27.551474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '7b28dd80d00a4f7383bdf0040011dfa2', 'request_id': 'req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:27.565461 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '7b28dd80d00a4f7383bdf0040011dfa2', 'request_id': 'req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:27.596507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] The token cache is being invalidate because project 7b28dd80d00a4f7383bdf0040011dfa2 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:27.597855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:27.598791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:27.600481 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1287/2620] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:27 2022] DELETE /identity/v3/projects/7b28dd80d00a4f7383bdf0040011dfa2 => generated 0 bytes in 295 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:27.604175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:27.605669 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:27.606512 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc164c49-29f6-47ff-b143-2839f34091a9 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:27.607349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc164c49-29f6-47ff-b143-2839f34091a9 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:27.607650 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc164c49-29f6-47ff-b143-2839f34091a9 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:27.607995 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc164c49-29f6-47ff-b143-2839f34091a9 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:27.609896 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bc164c49-29f6-47ff-b143-2839f34091a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:27.679076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0491d2-1f63-4069-b1b4-d5d54ea5c383 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:27.683901 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8d0054a-2b5a-43bb-b8a4-c1949236e809 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:27.684833 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0054a-2b5a-43bb-b8a4-c1949236e809 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:27.685857 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0054a-2b5a-43bb-b8a4-c1949236e809 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:27.686136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8d0054a-2b5a-43bb-b8a4-c1949236e809 admin admin] PATH_INFO: `/v3/users/d448c8d6fc0948d699e69fc7a8e482a1` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:27.687356 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0054a-2b5a-43bb-b8a4-c1949236e809 admin admin] RBAC: Authorizing `identity:delete_user(user_id=d448c8d6fc0948d699e69fc7a8e482a1)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:27.689393 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8d0054a-2b5a-43bb-b8a4-c1949236e809 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:27.711038 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc164c49-29f6-47ff-b143-2839f34091a9 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:27.719987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc164c49-29f6-47ff-b143-2839f34091a9 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:27.742190 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1334/2621] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:27 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 312 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:27.760889 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f8d0054a-2b5a-43bb-b8a4-c1949236e809 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'd448c8d6fc0948d699e69fc7a8e482a1'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:27.762443 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc164c49-29f6-47ff-b143-2839f34091a9 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:27.764323 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-bc164c49-29f6-47ff-b143-2839f34091a9 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:27.769135 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f8d0054a-2b5a-43bb-b8a4-c1949236e809 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'd448c8d6fc0948d699e69fc7a8e482a1'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:27.769859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f8d0054a-2b5a-43bb-b8a4-c1949236e809 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'd448c8d6fc0948d699e69fc7a8e482a1'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:27.789994 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc164c49-29f6-47ff-b143-2839f34091a9 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:27.798662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e062a31-8d38-43b6-a6ad-678eb738594c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:27.799269 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f8d0054a-2b5a-43bb-b8a4-c1949236e809 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'd448c8d6fc0948d699e69fc7a8e482a1'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:27.799800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e062a31-8d38-43b6-a6ad-678eb738594c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:27.800162 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e062a31-8d38-43b6-a6ad-678eb738594c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:27.800444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e062a31-8d38-43b6-a6ad-678eb738594c admin admin] PATH_INFO: `/v3/users/30e278548ecf41abafe7b903565184b0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:27.801819 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e062a31-8d38-43b6-a6ad-678eb738594c admin admin] RBAC: Authorizing `identity:delete_user(user_id=30e278548ecf41abafe7b903565184b0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:27.803776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e062a31-8d38-43b6-a6ad-678eb738594c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:27.813383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f8d0054a-2b5a-43bb-b8a4-c1949236e809 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'd448c8d6fc0948d699e69fc7a8e482a1'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:27.815056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=81,keystone:DELETE=17,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:27.825999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1288/2622] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:27 2022] DELETE /identity/v3/users/d448c8d6fc0948d699e69fc7a8e482a1 => generated 0 bytes in 218 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:27.914998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9e062a31-8d38-43b6-a6ad-678eb738594c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '30e278548ecf41abafe7b903565184b0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:27.916009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9e062a31-8d38-43b6-a6ad-678eb738594c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '30e278548ecf41abafe7b903565184b0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:27.931187 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9e062a31-8d38-43b6-a6ad-678eb738594c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '30e278548ecf41abafe7b903565184b0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:27.932395 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9e062a31-8d38-43b6-a6ad-678eb738594c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '30e278548ecf41abafe7b903565184b0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:27.968013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9e062a31-8d38-43b6-a6ad-678eb738594c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '30e278548ecf41abafe7b903565184b0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:28.001012 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1335/2623] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:27 2022] DELETE /identity/v3/users/30e278548ecf41abafe7b903565184b0 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:28.005404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de735-fa9a-4081-8d3c-c78ab63e322b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:28.005766 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de735-fa9a-4081-8d3c-c78ab63e322b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:28.006053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e32de735-fa9a-4081-8d3c-c78ab63e322b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:28.024793 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e32de735-fa9a-4081-8d3c-c78ab63e322b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:28.026181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e32de735-fa9a-4081-8d3c-c78ab63e322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:28.142723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1289/2624] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:28.165369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e062a31-8d38-43b6-a6ad-678eb738594c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:28.173969 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9e062a31-8d38-43b6-a6ad-678eb738594c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:28.202990 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:28.273759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32de735-fa9a-4081-8d3c-c78ab63e322b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:28.275561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e32de735-fa9a-4081-8d3c-c78ab63e322b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:28.299668 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e32de735-fa9a-4081-8d3c-c78ab63e322b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:28.313679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c266a2eb-416e-4818-b5db-e0c317627794 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:28.314848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266a2eb-416e-4818-b5db-e0c317627794 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:28.314969 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266a2eb-416e-4818-b5db-e0c317627794 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:28.315209 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c266a2eb-416e-4818-b5db-e0c317627794 admin admin] PATH_INFO: `/v3/projects/0d965dd0fd65454daf77f7ad7215392d` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:28.317138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266a2eb-416e-4818-b5db-e0c317627794 admin admin] RBAC: Authorizing `identity:delete_project(project_id=0d965dd0fd65454daf77f7ad7215392d)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:28.321769 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e062a31-8d38-43b6-a6ad-678eb738594c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:28.322302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c266a2eb-416e-4818-b5db-e0c317627794 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:28.329471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02a3bfc9-7bc6-4ae2-88c0-5e884c8740b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:28.330170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3bfc9-7bc6-4ae2-88c0-5e884c8740b9 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:28.330451 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3bfc9-7bc6-4ae2-88c0-5e884c8740b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:28.330747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02a3bfc9-7bc6-4ae2-88c0-5e884c8740b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:28.352739 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3bfc9-7bc6-4ae2-88c0-5e884c8740b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:28.354389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02a3bfc9-7bc6-4ae2-88c0-5e884c8740b9 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:28.383332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1336/2625] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:28 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 222 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:28.407849 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c266a2eb-416e-4818-b5db-e0c317627794 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0d965dd0fd65454daf77f7ad7215392d', 'request_id': 'req-c266a2eb-416e-4818-b5db-e0c317627794'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:28.429626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c266a2eb-416e-4818-b5db-e0c317627794 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0d965dd0fd65454daf77f7ad7215392d', 'request_id': 'req-c266a2eb-416e-4818-b5db-e0c317627794'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:28.439435 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c266a2eb-416e-4818-b5db-e0c317627794 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0d965dd0fd65454daf77f7ad7215392d', 'request_id': 'req-c266a2eb-416e-4818-b5db-e0c317627794'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:28.455147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c266a2eb-416e-4818-b5db-e0c317627794 admin admin] The token cache is being invalidate because project 0d965dd0fd65454daf77f7ad7215392d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:28.455817 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c266a2eb-416e-4818-b5db-e0c317627794 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:28.456516 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-c266a2eb-416e-4818-b5db-e0c317627794 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:28.459396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1290/2626] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:28 2022] DELETE /identity/v3/projects/0d965dd0fd65454daf77f7ad7215392d => generated 0 bytes in 186 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:28.464844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc8c00-28d6-45de-87f1-4fcf41ec765d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:28.465267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc8c00-28d6-45de-87f1-4fcf41ec765d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:28.465646 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8cc8c00-28d6-45de-87f1-4fcf41ec765d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:28.485366 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e8cc8c00-28d6-45de-87f1-4fcf41ec765d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:28.486836 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e8cc8c00-28d6-45de-87f1-4fcf41ec765d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:28.565806 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245dcad-c37d-4601-aa59-e2d3dcee90c2 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:28.566354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245dcad-c37d-4601-aa59-e2d3dcee90c2 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:28.566790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0245dcad-c37d-4601-aa59-e2d3dcee90c2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:28.570109 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1337/2627] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:28.588123 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-0245dcad-c37d-4601-aa59-e2d3dcee90c2 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:28.589641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0245dcad-c37d-4601-aa59-e2d3dcee90c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:28.617791 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc8c00-28d6-45de-87f1-4fcf41ec765d None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:28.624251 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1291/2628] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 58 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:28.628208 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8cc8c00-28d6-45de-87f1-4fcf41ec765d None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:28.633760 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb86e03-bd07-47e7-ae34-37cadef08886 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:28.634428 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb86e03-bd07-47e7-ae34-37cadef08886 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:28.634709 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb86e03-bd07-47e7-ae34-37cadef08886 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:28.634983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcb86e03-bd07-47e7-ae34-37cadef08886 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:28.635715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb86e03-bd07-47e7-ae34-37cadef08886 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:30:28.636021 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb86e03-bd07-47e7-ae34-37cadef08886 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:28.637705 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcb86e03-bd07-47e7-ae34-37cadef08886 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:28.660677 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1338/2629] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:30:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 43 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:30:28.664590 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245dcad-c37d-4601-aa59-e2d3dcee90c2 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:28.680552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0245dcad-c37d-4601-aa59-e2d3dcee90c2 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:28.685903 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffa318-7128-4a1f-9cda-0b91ec8e59ee admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:28.686574 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffa318-7128-4a1f-9cda-0b91ec8e59ee admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:28.686862 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffa318-7128-4a1f-9cda-0b91ec8e59ee admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:28.687146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fffa318-7128-4a1f-9cda-0b91ec8e59ee admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:28.687856 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffa318-7128-4a1f-9cda-0b91ec8e59ee admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:28.689917 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fffa318-7128-4a1f-9cda-0b91ec8e59ee admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:28.726962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1292/2630] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:28 2022] POST /identity/v3/projects => generated 385 bytes in 63 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:28.730963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb86e03-bd07-47e7-ae34-37cadef08886 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:28.741734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcb86e03-bd07-47e7-ae34-37cadef08886 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:28.812379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffa318-7128-4a1f-9cda-0b91ec8e59ee admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:28.814304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1fffa318-7128-4a1f-9cda-0b91ec8e59ee admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:28.854233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b744b-b61a-4412-88fa-b38d0081c716 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:28.855592 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b744b-b61a-4412-88fa-b38d0081c716 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:28.855973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b744b-b61a-4412-88fa-b38d0081c716 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:28.856350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831b744b-b61a-4412-88fa-b38d0081c716 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:28.857980 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b744b-b61a-4412-88fa-b38d0081c716 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:28.874504 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831b744b-b61a-4412-88fa-b38d0081c716 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:28.893184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:28.905301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1339/2631] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:28 2022] POST /identity/v3/users => generated 293 bytes in 175 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:28.909629 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b744b-b61a-4412-88fa-b38d0081c716 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:28.910554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fffa318-7128-4a1f-9cda-0b91ec8e59ee admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:28.917705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:28.919692 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:28.920411 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:28.921046 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7 admin admin] PATH_INFO: `/v3/projects/97475167a2bc45b8811f89b47fc5c317` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:28.923214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=97475167a2bc45b8811f89b47fc5c317)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:28.924257 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831b744b-b61a-4412-88fa-b38d0081c716 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:28.925886 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:28.929983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ec7bc-361f-4f3a-81fc-ddb0b15c1dc7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:28.931085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ec7bc-361f-4f3a-81fc-ddb0b15c1dc7 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:28.931590 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ec7bc-361f-4f3a-81fc-ddb0b15c1dc7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:28.932093 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a10ec7bc-361f-4f3a-81fc-ddb0b15c1dc7 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:28.933234 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ec7bc-361f-4f3a-81fc-ddb0b15c1dc7 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:28.935868 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a10ec7bc-361f-4f3a-81fc-ddb0b15c1dc7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:28.951441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1340/2632] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:28.953914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ec7bc-361f-4f3a-81fc-ddb0b15c1dc7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:28.974762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a10ec7bc-361f-4f3a-81fc-ddb0b15c1dc7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:28.981169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa5019-2476-44cc-90ba-76f0533fff8c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:28.981884 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa5019-2476-44cc-90ba-76f0533fff8c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:28.982217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa5019-2476-44cc-90ba-76f0533fff8c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:28.982510 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aeaa5019-2476-44cc-90ba-76f0533fff8c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:28.983252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa5019-2476-44cc-90ba-76f0533fff8c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:28.984933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aeaa5019-2476-44cc-90ba-76f0533fff8c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:29.000892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1341/2633] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:28 2022] GET /identity/v3/roles => generated 1420 bytes in 45 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:30:29.001692 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '97475167a2bc45b8811f89b47fc5c317', 'request_id': 'req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:29.002203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa5019-2476-44cc-90ba-76f0533fff8c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:29.014978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aeaa5019-2476-44cc-90ba-76f0533fff8c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:29.015645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '97475167a2bc45b8811f89b47fc5c317', 'request_id': 'req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:29.019640 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:29.023462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '97475167a2bc45b8811f89b47fc5c317', 'request_id': 'req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:29.037953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7 admin admin] The token cache is being invalidate because project 97475167a2bc45b8811f89b47fc5c317 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:29.038222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:29.038940 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a6a8cd9a-49ab-45ed-b8ba-1f13825bcdd7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:29.040529 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1293/2634] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:28 2022] DELETE /identity/v3/projects/97475167a2bc45b8811f89b47fc5c317 => generated 0 bytes in 229 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:29.045613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cda80f-b03d-4766-a436-7559ce73aff3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.045781 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cda80f-b03d-4766-a436-7559ce73aff3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.046014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60cda80f-b03d-4766-a436-7559ce73aff3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.071839 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-60cda80f-b03d-4766-a436-7559ce73aff3 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:29.074961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-60cda80f-b03d-4766-a436-7559ce73aff3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:29.088829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14c368aa-5857-48fd-93db-6cf5045191eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:29.089825 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c368aa-5857-48fd-93db-6cf5045191eb admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.090102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c368aa-5857-48fd-93db-6cf5045191eb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.090373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14c368aa-5857-48fd-93db-6cf5045191eb admin admin] PATH_INFO: `/v3/projects/ff2356c9ad9546ec9eab07d7aa6b2acb/users/19b45593e38e4af29183a4bb27eee533/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.105973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c368aa-5857-48fd-93db-6cf5045191eb admin admin] RBAC: Authorizing `identity:create_grant(project_id=ff2356c9ad9546ec9eab07d7aa6b2acb, user_id=19b45593e38e4af29183a4bb27eee533, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:29.108707 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14c368aa-5857-48fd-93db-6cf5045191eb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:29.129073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1342/2635] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:29 2022] PUT /identity/v3/projects/ff2356c9ad9546ec9eab07d7aa6b2acb/users/19b45593e38e4af29183a4bb27eee533/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:29.139660 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6e752-116c-4109-8a2f-bb5d681db372 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.140081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6e752-116c-4109-8a2f-bb5d681db372 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.140386 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa6e752-116c-4109-8a2f-bb5d681db372 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.190059 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1294/2636] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:29.208482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6d5b7-81d1-4cd5-befa-6088453493d1 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.208924 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6d5b7-81d1-4cd5-befa-6088453493d1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.209320 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d6d5b7-81d1-4cd5-befa-6088453493d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.228468 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9aa6e752-116c-4109-8a2f-bb5d681db372 None None] MFA Rules not processed for user `19b45593e38e4af29183a4bb27eee533`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:29.229781 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9aa6e752-116c-4109-8a2f-bb5d681db372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:29.238798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-31d6d5b7-81d1-4cd5-befa-6088453493d1 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:29.240006 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-31d6d5b7-81d1-4cd5-befa-6088453493d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:29.336153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1343/2637] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:29 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 198 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:29.337034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6e752-116c-4109-8a2f-bb5d681db372 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:29.339178 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9aa6e752-116c-4109-8a2f-bb5d681db372 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:29.378391 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1295/2638] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:29 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:29.382254 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6d5b7-81d1-4cd5-befa-6088453493d1 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:29.392827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d6d5b7-81d1-4cd5-befa-6088453493d1 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:29.399557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142de902-ddda-4e4f-a933-1e02f2b058c9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:29.400268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de902-ddda-4e4f-a933-1e02f2b058c9 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.400551 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de902-ddda-4e4f-a933-1e02f2b058c9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.400830 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142de902-ddda-4e4f-a933-1e02f2b058c9 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.401593 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142de902-ddda-4e4f-a933-1e02f2b058c9 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:30:29.401900 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142de902-ddda-4e4f-a933-1e02f2b058c9 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:29.403540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142de902-ddda-4e4f-a933-1e02f2b058c9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:29.416914 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1296/2639] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:30:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) May 26 18:30:29.421629 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142de902-ddda-4e4f-a933-1e02f2b058c9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:29.442842 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142de902-ddda-4e4f-a933-1e02f2b058c9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:29.445224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa6e752-116c-4109-8a2f-bb5d681db372 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:29.448697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df28d7-f2c3-404d-ade0-e6eae99638cc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:29.449591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df28d7-f2c3-404d-ade0-e6eae99638cc admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.450039 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df28d7-f2c3-404d-ade0-e6eae99638cc admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.450249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bea4a-4cff-4693-88fb-7bd1bb986cb2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:29.450891 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17df28d7-f2c3-404d-ade0-e6eae99638cc admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.451158 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bea4a-4cff-4693-88fb-7bd1bb986cb2 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.451546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bea4a-4cff-4693-88fb-7bd1bb986cb2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.451916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d1bea4a-4cff-4693-88fb-7bd1bb986cb2 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.452390 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df28d7-f2c3-404d-ade0-e6eae99638cc admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:29.452795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bea4a-4cff-4693-88fb-7bd1bb986cb2 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:29.454936 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d1bea4a-4cff-4693-88fb-7bd1bb986cb2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:29.455274 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17df28d7-f2c3-404d-ade0-e6eae99638cc admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:29.468613 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:29.501175 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1344/2640] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:29 2022] POST /identity/v3/projects => generated 387 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:29.504448 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bea4a-4cff-4693-88fb-7bd1bb986cb2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:29.514214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1297/2641] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:29 2022] POST /identity/v3/projects => generated 377 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:29.522486 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df28d7-f2c3-404d-ade0-e6eae99638cc admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:29.524107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:29.599108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d1bea4a-4cff-4693-88fb-7bd1bb986cb2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:29.624107 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17df28d7-f2c3-404d-ade0-e6eae99638cc admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:29.646544 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f77e5-2e1f-494e-ad88-aa409bce88e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:29.647931 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f77e5-2e1f-494e-ad88-aa409bce88e8 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.648369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f77e5-2e1f-494e-ad88-aa409bce88e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.648814 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-523f77e5-2e1f-494e-ad88-aa409bce88e8 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.649762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f77e5-2e1f-494e-ad88-aa409bce88e8 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:29.652852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-523f77e5-2e1f-494e-ad88-aa409bce88e8 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:29.678498 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eb6b6-2af3-48c7-a0d4-8beb1811c893 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:29.679486 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eb6b6-2af3-48c7-a0d4-8beb1811c893 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.680449 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eb6b6-2af3-48c7-a0d4-8beb1811c893 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.686138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1298/2642] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:29 2022] POST /identity/v3/users => generated 289 bytes in 163 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:29.686352 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e1eb6b6-2af3-48c7-a0d4-8beb1811c893 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.686352 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1eb6b6-2af3-48c7-a0d4-8beb1811c893 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:29.686802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e1eb6b6-2af3-48c7-a0d4-8beb1811c893 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:29.687858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f77e5-2e1f-494e-ad88-aa409bce88e8 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:29.704346 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-523f77e5-2e1f-494e-ad88-aa409bce88e8 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:29.710109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eaf19-d3bf-446d-bd17-8adaec93fa11 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:29.710785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eaf19-d3bf-446d-bd17-8adaec93fa11 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.711071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eaf19-d3bf-446d-bd17-8adaec93fa11 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.711380 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f21eaf19-d3bf-446d-bd17-8adaec93fa11 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.712136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eaf19-d3bf-446d-bd17-8adaec93fa11 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:29.716857 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1345/2643] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:29 2022] POST /identity/v3/users => generated 300 bytes in 210 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:29.717638 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f21eaf19-d3bf-446d-bd17-8adaec93fa11 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:29.719389 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eb6b6-2af3-48c7-a0d4-8beb1811c893 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:29.726148 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1299/2644] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:30:29.729799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eaf19-d3bf-446d-bd17-8adaec93fa11 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:29.729971 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e1eb6b6-2af3-48c7-a0d4-8beb1811c893 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:29.735427 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21df3c-dfad-4b60-8d59-af95d04de511 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:29.736096 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21df3c-dfad-4b60-8d59-af95d04de511 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.736382 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21df3c-dfad-4b60-8d59-af95d04de511 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.736664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc21df3c-dfad-4b60-8d59-af95d04de511 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.741717 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21df3c-dfad-4b60-8d59-af95d04de511 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:29.744106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc21df3c-dfad-4b60-8d59-af95d04de511 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:29.745174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f21eaf19-d3bf-446d-bd17-8adaec93fa11 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:29.757238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1346/2645] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:29.761651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21df3c-dfad-4b60-8d59-af95d04de511 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:29.765152 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368485fd-5222-492e-b697-0eca29305c19 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:29.768556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368485fd-5222-492e-b697-0eca29305c19 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.768928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368485fd-5222-492e-b697-0eca29305c19 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.769287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-368485fd-5222-492e-b697-0eca29305c19 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.770170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368485fd-5222-492e-b697-0eca29305c19 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:29.771852 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-368485fd-5222-492e-b697-0eca29305c19 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:29.779461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc21df3c-dfad-4b60-8d59-af95d04de511 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:29.784807 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbf9ce-dbbb-4db1-b286-a3d499b67790 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:29.785761 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf9ce-dbbb-4db1-b286-a3d499b67790 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.786044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf9ce-dbbb-4db1-b286-a3d499b67790 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.786320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28cbf9ce-dbbb-4db1-b286-a3d499b67790 admin admin] PATH_INFO: `/v3/projects/4146efb5dacf4db19307e935a4f5fb4f/users/266aaccd42894288adf771d93626770e/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.803815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbf9ce-dbbb-4db1-b286-a3d499b67790 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4146efb5dacf4db19307e935a4f5fb4f, user_id=266aaccd42894288adf771d93626770e, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:29.808098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1300/2646] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 76 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:30:29.808262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28cbf9ce-dbbb-4db1-b286-a3d499b67790 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:29.809526 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368485fd-5222-492e-b697-0eca29305c19 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:29.820387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1347/2647] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:29 2022] PUT /identity/v3/projects/4146efb5dacf4db19307e935a4f5fb4f/users/266aaccd42894288adf771d93626770e/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 59 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:29.822866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-368485fd-5222-492e-b697-0eca29305c19 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:29.824557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbf9ce-dbbb-4db1-b286-a3d499b67790 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:29.901022 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28cbf9ce-dbbb-4db1-b286-a3d499b67790 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:29.906362 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd3b9c-a5da-4629-a5b9-bf5a69e68a7c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:29.906541 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26e76a29-08d2-46da-a2df-e1e66ac58111 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:29.907110 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd3b9c-a5da-4629-a5b9-bf5a69e68a7c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.907399 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd3b9c-a5da-4629-a5b9-bf5a69e68a7c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.907681 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20bd3b9c-a5da-4629-a5b9-bf5a69e68a7c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.907873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e76a29-08d2-46da-a2df-e1e66ac58111 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.908407 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd3b9c-a5da-4629-a5b9-bf5a69e68a7c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:29.908519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e76a29-08d2-46da-a2df-e1e66ac58111 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.908943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26e76a29-08d2-46da-a2df-e1e66ac58111 admin admin] PATH_INFO: `/v3/projects/0cf11b58ba3c442aa1bebcabf3f4b1c7/users/c11b3f3f205546a4818eb80b2c3279de/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.910029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20bd3b9c-a5da-4629-a5b9-bf5a69e68a7c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:29.921294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1348/2648] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:29 2022] GET /identity/v3/roles => generated 1420 bytes in 97 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:30:29.924602 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e76a29-08d2-46da-a2df-e1e66ac58111 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0cf11b58ba3c442aa1bebcabf3f4b1c7, user_id=c11b3f3f205546a4818eb80b2c3279de, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:29.925113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd3b9c-a5da-4629-a5b9-bf5a69e68a7c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:29.927372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26e76a29-08d2-46da-a2df-e1e66ac58111 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:29.935275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20bd3b9c-a5da-4629-a5b9-bf5a69e68a7c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:29.937238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:29.942639 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e9104d2-052c-421a-9797-9cd5e84f31db admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:29.943650 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9104d2-052c-421a-9797-9cd5e84f31db admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.944159 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9104d2-052c-421a-9797-9cd5e84f31db admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.944568 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e9104d2-052c-421a-9797-9cd5e84f31db admin admin] PATH_INFO: `/v3/projects/4146efb5dacf4db19307e935a4f5fb4f/users/266aaccd42894288adf771d93626770e/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.947734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9104d2-052c-421a-9797-9cd5e84f31db admin admin] RBAC: Authorizing `identity:create_grant(project_id=4146efb5dacf4db19307e935a4f5fb4f, user_id=266aaccd42894288adf771d93626770e, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:29.951309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1301/2649] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:29 2022] PUT /identity/v3/projects/0cf11b58ba3c442aa1bebcabf3f4b1c7/users/c11b3f3f205546a4818eb80b2c3279de/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:29.959892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e9104d2-052c-421a-9797-9cd5e84f31db admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:29.962386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbcf37-c752-425a-ba07-b726f6cd7faa None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.963013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbcf37-c752-425a-ba07-b726f6cd7faa None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.963401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bbcf37-c752-425a-ba07-b726f6cd7faa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.971844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1349/2650] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:29 2022] PUT /identity/v3/projects/4146efb5dacf4db19307e935a4f5fb4f/users/266aaccd42894288adf771d93626770e/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:29.983337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e023cd-4b6e-4bd0-8681-0bc42abaee8a None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:29.983753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e023cd-4b6e-4bd0-8681-0bc42abaee8a None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:29.984734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84e023cd-4b6e-4bd0-8681-0bc42abaee8a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:29.998535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c7bbcf37-c752-425a-ba07-b726f6cd7faa None None] MFA Rules not processed for user `c11b3f3f205546a4818eb80b2c3279de`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:29.999772 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c7bbcf37-c752-425a-ba07-b726f6cd7faa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:30.024765 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-84e023cd-4b6e-4bd0-8681-0bc42abaee8a None None] MFA Rules not processed for user `266aaccd42894288adf771d93626770e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:30.026042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-84e023cd-4b6e-4bd0-8681-0bc42abaee8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:30.031424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:30.078350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1302/2651] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:30.082692 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbcf37-c752-425a-ba07-b726f6cd7faa None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:30.112827 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1350/2652] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:29 2022] POST /identity/v3/auth/tokens => generated 3321 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:30.123608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e023cd-4b6e-4bd0-8681-0bc42abaee8a None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:30.124960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-84e023cd-4b6e-4bd0-8681-0bc42abaee8a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:30.147364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bbcf37-c752-425a-ba07-b726f6cd7faa None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:30.152569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391d1f3-8e3d-4435-884b-739847216556 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:30.153267 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391d1f3-8e3d-4435-884b-739847216556 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.153727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391d1f3-8e3d-4435-884b-739847216556 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.154524 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a391d1f3-8e3d-4435-884b-739847216556 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:30.155221 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391d1f3-8e3d-4435-884b-739847216556 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:30.157174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a391d1f3-8e3d-4435-884b-739847216556 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:30.189026 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1303/2653] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:30 2022] POST /identity/v3/projects => generated 375 bytes in 106 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:30:30.192747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391d1f3-8e3d-4435-884b-739847216556 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:30.193155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84e023cd-4b6e-4bd0-8681-0bc42abaee8a None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:30.242987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5d32a-a0ce-4db0-bd7e-1ebad7351f47 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:30.243639 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5d32a-a0ce-4db0-bd7e-1ebad7351f47 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.243925 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5d32a-a0ce-4db0-bd7e-1ebad7351f47 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.244197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da5d32a-a0ce-4db0-bd7e-1ebad7351f47 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:30.254726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a391d1f3-8e3d-4435-884b-739847216556 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:30.259968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3e224-69e7-4ba7-b0ed-db6cf2fe59c2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:30.260636 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3e224-69e7-4ba7-b0ed-db6cf2fe59c2 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.260920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3e224-69e7-4ba7-b0ed-db6cf2fe59c2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.261234 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ce3e224-69e7-4ba7-b0ed-db6cf2fe59c2 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:30.261952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3e224-69e7-4ba7-b0ed-db6cf2fe59c2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:30.264413 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ce3e224-69e7-4ba7-b0ed-db6cf2fe59c2 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:30.285918 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1304/2654] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:30 2022] POST /identity/v3/users => generated 288 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:30:30.289704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3e224-69e7-4ba7-b0ed-db6cf2fe59c2 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:30.291914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:30.299590 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ce3e224-69e7-4ba7-b0ed-db6cf2fe59c2 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:30.304499 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9460a7-c826-4f29-9e32-be567e918eec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:30.305208 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9460a7-c826-4f29-9e32-be567e918eec admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.305517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9460a7-c826-4f29-9e32-be567e918eec admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.305800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac9460a7-c826-4f29-9e32-be567e918eec admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:30.306516 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9460a7-c826-4f29-9e32-be567e918eec admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:30.308109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac9460a7-c826-4f29-9e32-be567e918eec admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:30.309715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5d32a-a0ce-4db0-bd7e-1ebad7351f47 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:30.311629 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3da5d32a-a0ce-4db0-bd7e-1ebad7351f47 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:30.318619 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1305/2655] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:30:30.321775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1351/2656] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:30 2022] GET /identity/v3/auth/tokens => generated 3321 bytes in 199 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:30:30.322501 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9460a7-c826-4f29-9e32-be567e918eec admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:30.332633 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac9460a7-c826-4f29-9e32-be567e918eec admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:30.337303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe68bbbe-775f-40e7-b689-2c2c0695ab2c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:30.338242 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68bbbe-775f-40e7-b689-2c2c0695ab2c admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.338532 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68bbbe-775f-40e7-b689-2c2c0695ab2c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.338833 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe68bbbe-775f-40e7-b689-2c2c0695ab2c admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:30.339587 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68bbbe-775f-40e7-b689-2c2c0695ab2c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:30.341616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe68bbbe-775f-40e7-b689-2c2c0695ab2c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:30.352576 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1306/2657] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:30:30.358488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5d32a-a0ce-4db0-bd7e-1ebad7351f47 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:30.369678 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da5d32a-a0ce-4db0-bd7e-1ebad7351f47 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:30.377339 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426e606-1981-44b6-8399-91cc314f98c4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:30.378309 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426e606-1981-44b6-8399-91cc314f98c4 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.378687 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426e606-1981-44b6-8399-91cc314f98c4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.379029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f426e606-1981-44b6-8399-91cc314f98c4 admin admin] PATH_INFO: `/v3/projects/69e53af8d1dd4e899d92c15f102ecc2f/users/84c2fd005c7d4782817c78942438dbe4/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:30.396024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426e606-1981-44b6-8399-91cc314f98c4 admin admin] RBAC: Authorizing `identity:create_grant(project_id=69e53af8d1dd4e899d92c15f102ecc2f, user_id=84c2fd005c7d4782817c78942438dbe4, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:30.398917 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f426e606-1981-44b6-8399-91cc314f98c4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:30.417090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1352/2658] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:30 2022] PUT /identity/v3/projects/69e53af8d1dd4e899d92c15f102ecc2f/users/84c2fd005c7d4782817c78942438dbe4/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 57 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:30.424412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e269b17-2c93-4077-9a0e-cf9107a037b1 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.424705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e269b17-2c93-4077-9a0e-cf9107a037b1 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.425052 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e269b17-2c93-4077-9a0e-cf9107a037b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:30.454872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-2e269b17-2c93-4077-9a0e-cf9107a037b1 None None] MFA Rules not processed for user `84c2fd005c7d4782817c78942438dbe4`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:30.456089 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2e269b17-2c93-4077-9a0e-cf9107a037b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:30.470195 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:30.543517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1307/2659] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:30 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:30.549981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426e606-1981-44b6-8399-91cc314f98c4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:30.622936 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f426e606-1981-44b6-8399-91cc314f98c4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:30.627596 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3ff0e-af11-48bc-8f98-e0ec7ce9ea8e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:30.628259 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3ff0e-af11-48bc-8f98-e0ec7ce9ea8e admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.628544 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3ff0e-af11-48bc-8f98-e0ec7ce9ea8e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.628824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb3ff0e-af11-48bc-8f98-e0ec7ce9ea8e admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:30.629555 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3ff0e-af11-48bc-8f98-e0ec7ce9ea8e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:30.631460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb3ff0e-af11-48bc-8f98-e0ec7ce9ea8e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:30.661047 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1353/2660] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:30 2022] POST /identity/v3/projects => generated 375 bytes in 110 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:30.663877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e269b17-2c93-4077-9a0e-cf9107a037b1 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:30.675829 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e269b17-2c93-4077-9a0e-cf9107a037b1 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:30.737573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df7139-07b5-4b43-ae0d-1a9d030e0635 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:30.738247 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df7139-07b5-4b43-ae0d-1a9d030e0635 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.738534 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df7139-07b5-4b43-ae0d-1a9d030e0635 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.738848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9df7139-07b5-4b43-ae0d-1a9d030e0635 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:30.739525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df7139-07b5-4b43-ae0d-1a9d030e0635 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:30.741482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9df7139-07b5-4b43-ae0d-1a9d030e0635 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:30.761656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1308/2661] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:30 2022] POST /identity/v3/users => generated 294 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:30.765902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3ff0e-af11-48bc-8f98-e0ec7ce9ea8e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:30.777470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb3ff0e-af11-48bc-8f98-e0ec7ce9ea8e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:30.783058 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2fc6c-1e4d-4492-b82c-efbc2b8f6e5d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:30.783725 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2fc6c-1e4d-4492-b82c-efbc2b8f6e5d admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.784122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2fc6c-1e4d-4492-b82c-efbc2b8f6e5d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.784421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2aa2fc6c-1e4d-4492-b82c-efbc2b8f6e5d admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:30.785182 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2fc6c-1e4d-4492-b82c-efbc2b8f6e5d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:30.786924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2aa2fc6c-1e4d-4492-b82c-efbc2b8f6e5d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:30.799208 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1354/2662] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:30.803403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df7139-07b5-4b43-ae0d-1a9d030e0635 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:30.814679 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9df7139-07b5-4b43-ae0d-1a9d030e0635 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:30.819343 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe095ae-b032-4165-871a-cc4ae847a7ae admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:30.820231 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe095ae-b032-4165-871a-cc4ae847a7ae admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.820518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe095ae-b032-4165-871a-cc4ae847a7ae admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.820800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfe095ae-b032-4165-871a-cc4ae847a7ae admin admin] PATH_INFO: `/v3/projects/ec7ad0d795ba440682681979525be456/users/70d1877f3ad64540b6b513c550fcf3c5/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:30.835580 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe095ae-b032-4165-871a-cc4ae847a7ae admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7ad0d795ba440682681979525be456, user_id=70d1877f3ad64540b6b513c550fcf3c5, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:30.838586 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfe095ae-b032-4165-871a-cc4ae847a7ae admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:30.853369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1309/2663] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:30 2022] PUT /identity/v3/projects/ec7ad0d795ba440682681979525be456/users/70d1877f3ad64540b6b513c550fcf3c5/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:30.858112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2fc6c-1e4d-4492-b82c-efbc2b8f6e5d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:30.869776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2aa2fc6c-1e4d-4492-b82c-efbc2b8f6e5d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:30.883562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe095ae-b032-4165-871a-cc4ae847a7ae admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:30.929251 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eecf2-6bbf-4fcf-9caa-e956b4199c98 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:30.930033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eecf2-6bbf-4fcf-9caa-e956b4199c98 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.930595 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eecf2-6bbf-4fcf-9caa-e956b4199c98 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.930726 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa5eecf2-6bbf-4fcf-9caa-e956b4199c98 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:30.931474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5eecf2-6bbf-4fcf-9caa-e956b4199c98 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:30.933176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa5eecf2-6bbf-4fcf-9caa-e956b4199c98 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:30.943320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1355/2664] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:30 2022] GET /identity/v3/roles => generated 1420 bytes in 87 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:30.947272 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eecf2-6bbf-4fcf-9caa-e956b4199c98 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:30.947688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfe095ae-b032-4165-871a-cc4ae847a7ae admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:30.952341 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311280d5-1144-4e1f-9266-da7d272ccfb6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:30.953242 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311280d5-1144-4e1f-9266-da7d272ccfb6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.953530 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311280d5-1144-4e1f-9266-da7d272ccfb6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.953810 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311280d5-1144-4e1f-9266-da7d272ccfb6 admin admin] PATH_INFO: `/v3/users/19b45593e38e4af29183a4bb27eee533` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:30.954997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311280d5-1144-4e1f-9266-da7d272ccfb6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=19b45593e38e4af29183a4bb27eee533)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:30.956552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa5eecf2-6bbf-4fcf-9caa-e956b4199c98 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:30.956923 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311280d5-1144-4e1f-9266-da7d272ccfb6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:30.961087 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2396fa0-17a1-416f-8469-33cc35110375 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:30.961924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2396fa0-17a1-416f-8469-33cc35110375 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.962207 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2396fa0-17a1-416f-8469-33cc35110375 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.962479 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2396fa0-17a1-416f-8469-33cc35110375 admin admin] PATH_INFO: `/v3/projects/ec7ad0d795ba440682681979525be456/users/70d1877f3ad64540b6b513c550fcf3c5/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:30.964651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2396fa0-17a1-416f-8469-33cc35110375 admin admin] RBAC: Authorizing `identity:create_grant(project_id=ec7ad0d795ba440682681979525be456, user_id=70d1877f3ad64540b6b513c550fcf3c5, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:30.967347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2396fa0-17a1-416f-8469-33cc35110375 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:30.977435 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1356/2665] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:30 2022] PUT /identity/v3/projects/ec7ad0d795ba440682681979525be456/users/70d1877f3ad64540b6b513c550fcf3c5/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 30 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:30.978955 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=94,keystone:INSERT=4,keystone:DELETE=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:30.987921 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a4815-7571-488f-aac3-7904eecbfece None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:30.988211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a4815-7571-488f-aac3-7904eecbfece None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:30.988495 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971a4815-7571-488f-aac3-7904eecbfece None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:31.008801 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-311280d5-1144-4e1f-9266-da7d272ccfb6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '19b45593e38e4af29183a4bb27eee533'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.012793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:31.016031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-311280d5-1144-4e1f-9266-da7d272ccfb6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '19b45593e38e4af29183a4bb27eee533'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.016397 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-971a4815-7571-488f-aac3-7904eecbfece None None] MFA Rules not processed for user `70d1877f3ad64540b6b513c550fcf3c5`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:31.016741 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-311280d5-1144-4e1f-9266-da7d272ccfb6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '19b45593e38e4af29183a4bb27eee533'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.018681 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-971a4815-7571-488f-aac3-7904eecbfece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:31.028685 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-311280d5-1144-4e1f-9266-da7d272ccfb6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '19b45593e38e4af29183a4bb27eee533'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.035989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-311280d5-1144-4e1f-9266-da7d272ccfb6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '19b45593e38e4af29183a4bb27eee533'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.042660 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1310/2666] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:30 2022] DELETE /identity/v3/users/19b45593e38e4af29183a4bb27eee533 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:31.047267 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d2ffc-ad0b-4249-ad3c-1c8f40477b14 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:31.047553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d2ffc-ad0b-4249-ad3c-1c8f40477b14 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:31.047829 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c76d2ffc-ad0b-4249-ad3c-1c8f40477b14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:31.065916 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-c76d2ffc-ad0b-4249-ad3c-1c8f40477b14 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:31.067048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c76d2ffc-ad0b-4249-ad3c-1c8f40477b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:31.090285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1357/2667] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:30 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:31.102204 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a4815-7571-488f-aac3-7904eecbfece None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:31.103551 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-971a4815-7571-488f-aac3-7904eecbfece None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:31.129882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1311/2668] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:31 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:31.139592 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d2ffc-ad0b-4249-ad3c-1c8f40477b14 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:31.141698 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c76d2ffc-ad0b-4249-ad3c-1c8f40477b14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:31.162909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971a4815-7571-488f-aac3-7904eecbfece None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:31.200347 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c76d2ffc-ad0b-4249-ad3c-1c8f40477b14 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:31.204034 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccfc4c-eb8f-4e5a-a873-8b8d1eef0c05 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:31.204675 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccfc4c-eb8f-4e5a-a873-8b8d1eef0c05 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:31.204946 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccfc4c-eb8f-4e5a-a873-8b8d1eef0c05 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:31.205241 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14ccfc4c-eb8f-4e5a-a873-8b8d1eef0c05 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:31.210931 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8aff9-d0a4-47c5-95b5-029c5a2ee42c service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:31.211569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8aff9-d0a4-47c5-95b5-029c5a2ee42c service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:31.211850 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8aff9-d0a4-47c5-95b5-029c5a2ee42c service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:31.212120 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8aff9-d0a4-47c5-95b5-029c5a2ee42c service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:31.214156 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-27b8aff9-d0a4-47c5-95b5-029c5a2ee42c service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:31.214819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccfc4c-eb8f-4e5a-a873-8b8d1eef0c05 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:31.216770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14ccfc4c-eb8f-4e5a-a873-8b8d1eef0c05 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:31.226507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1312/2669] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:31 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:30:31.278056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8aff9-d0a4-47c5-95b5-029c5a2ee42c service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:31.280172 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8aff9-d0a4-47c5-95b5-029c5a2ee42c service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:31.290666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1358/2670] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:31 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 189 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:31.521335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccfc4c-eb8f-4e5a-a873-8b8d1eef0c05 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:31.524483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-14ccfc4c-eb8f-4e5a-a873-8b8d1eef0c05 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:31.548373 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14ccfc4c-eb8f-4e5a-a873-8b8d1eef0c05 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:31.557020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:31.559032 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:31.559749 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:31.559749 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] PATH_INFO: `/v3/projects/ff2356c9ad9546ec9eab07d7aa6b2acb` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:31.562366 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] RBAC: Authorizing `identity:delete_project(project_id=ff2356c9ad9546ec9eab07d7aa6b2acb)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:31.564029 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:31.674483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=10,keystone:SELECT=89,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:31.689504 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ff2356c9ad9546ec9eab07d7aa6b2acb', 'request_id': 'req-0c4dc41c-464b-4bd0-a526-605bba6172e6'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.701556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ff2356c9ad9546ec9eab07d7aa6b2acb', 'request_id': 'req-0c4dc41c-464b-4bd0-a526-605bba6172e6'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.710252 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ff2356c9ad9546ec9eab07d7aa6b2acb', 'request_id': 'req-0c4dc41c-464b-4bd0-a526-605bba6172e6'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.730019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] The token cache is being invalidate because project ff2356c9ad9546ec9eab07d7aa6b2acb was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:31.730403 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.731270 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.733444 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1313/2671] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:31 2022] DELETE /identity/v3/projects/ff2356c9ad9546ec9eab07d7aa6b2acb => generated 0 bytes in 213 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:31.737484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8aff9-d0a4-47c5-95b5-029c5a2ee42c service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:31.755515 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8aff9-d0a4-47c5-95b5-029c5a2ee42c service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:31.764396 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:31.827922 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81790911-c358-4fa4-bc9a-572ee5e667a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:31.828804 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81790911-c358-4fa4-bc9a-572ee5e667a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:31.829174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81790911-c358-4fa4-bc9a-572ee5e667a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:31.829455 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81790911-c358-4fa4-bc9a-572ee5e667a6 admin admin] PATH_INFO: `/v3/users/266aaccd42894288adf771d93626770e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:31.830653 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81790911-c358-4fa4-bc9a-572ee5e667a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=266aaccd42894288adf771d93626770e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:31.832615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81790911-c358-4fa4-bc9a-572ee5e667a6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:31.881383 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-81790911-c358-4fa4-bc9a-572ee5e667a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '266aaccd42894288adf771d93626770e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.882290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-81790911-c358-4fa4-bc9a-572ee5e667a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '266aaccd42894288adf771d93626770e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.889834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-81790911-c358-4fa4-bc9a-572ee5e667a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '266aaccd42894288adf771d93626770e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.890470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-81790911-c358-4fa4-bc9a-572ee5e667a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '266aaccd42894288adf771d93626770e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.902920 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-81790911-c358-4fa4-bc9a-572ee5e667a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '266aaccd42894288adf771d93626770e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:31.916363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1359/2672] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:31 2022] DELETE /identity/v3/users/266aaccd42894288adf771d93626770e => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:32.204840 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:32.206333 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:32.220735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c4dc41c-464b-4bd0-a526-605bba6172e6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:32.280822 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd208ac-fd7a-42c1-b698-1e071c79e22b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:32.281722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd208ac-fd7a-42c1-b698-1e071c79e22b admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:32.282009 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd208ac-fd7a-42c1-b698-1e071c79e22b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:32.282286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd208ac-fd7a-42c1-b698-1e071c79e22b admin admin] PATH_INFO: `/v3/projects/4146efb5dacf4db19307e935a4f5fb4f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:32.283452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd208ac-fd7a-42c1-b698-1e071c79e22b admin admin] RBAC: Authorizing `identity:delete_project(project_id=4146efb5dacf4db19307e935a4f5fb4f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:32.285423 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd208ac-fd7a-42c1-b698-1e071c79e22b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:32.333776 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ffd208ac-fd7a-42c1-b698-1e071c79e22b admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4146efb5dacf4db19307e935a4f5fb4f', 'request_id': 'req-ffd208ac-fd7a-42c1-b698-1e071c79e22b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:32.341566 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ffd208ac-fd7a-42c1-b698-1e071c79e22b admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4146efb5dacf4db19307e935a4f5fb4f', 'request_id': 'req-ffd208ac-fd7a-42c1-b698-1e071c79e22b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:32.347169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ffd208ac-fd7a-42c1-b698-1e071c79e22b admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4146efb5dacf4db19307e935a4f5fb4f', 'request_id': 'req-ffd208ac-fd7a-42c1-b698-1e071c79e22b'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:32.359429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ffd208ac-fd7a-42c1-b698-1e071c79e22b admin admin] The token cache is being invalidate because project 4146efb5dacf4db19307e935a4f5fb4f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:32.359716 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ffd208ac-fd7a-42c1-b698-1e071c79e22b admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:32.360377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-ffd208ac-fd7a-42c1-b698-1e071c79e22b admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:32.361977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1314/2673] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:32 2022] DELETE /identity/v3/projects/4146efb5dacf4db19307e935a4f5fb4f => generated 0 bytes in 158 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:32.366922 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321b188-88dc-4481-9884-513ae9b238d4 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:32.367212 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321b188-88dc-4481-9884-513ae9b238d4 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:32.367511 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6321b188-88dc-4481-9884-513ae9b238d4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:32.386196 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6321b188-88dc-4481-9884-513ae9b238d4 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:32.387387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6321b188-88dc-4481-9884-513ae9b238d4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:32.448859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1360/2674] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:32.456718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b01935-f285-4193-be7d-dada1f246627 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:32.457090 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b01935-f285-4193-be7d-dada1f246627 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:32.457377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60b01935-f285-4193-be7d-dada1f246627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:32.476785 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-60b01935-f285-4193-be7d-dada1f246627 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:32.478061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-60b01935-f285-4193-be7d-dada1f246627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:32.487176 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1315/2675] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:32 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:32.491619 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321b188-88dc-4481-9884-513ae9b238d4 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:32.503327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6321b188-88dc-4481-9884-513ae9b238d4 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:32.508136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85239c3-6a0b-456e-9496-19c1dbcc6983 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:32.508798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85239c3-6a0b-456e-9496-19c1dbcc6983 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:32.509128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85239c3-6a0b-456e-9496-19c1dbcc6983 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:32.509392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f85239c3-6a0b-456e-9496-19c1dbcc6983 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:32.510124 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85239c3-6a0b-456e-9496-19c1dbcc6983 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:30:32.510440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85239c3-6a0b-456e-9496-19c1dbcc6983 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:32.512032 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f85239c3-6a0b-456e-9496-19c1dbcc6983 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:32.524291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1361/2676] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:30:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:30:32.529039 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b01935-f285-4193-be7d-dada1f246627 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:32.539858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60b01935-f285-4193-be7d-dada1f246627 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:32.545825 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d247a-6926-43a8-a438-0cd9835ab172 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:32.546604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d247a-6926-43a8-a438-0cd9835ab172 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:32.546887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d247a-6926-43a8-a438-0cd9835ab172 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:32.547163 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f6d247a-6926-43a8-a438-0cd9835ab172 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:32.548025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d247a-6926-43a8-a438-0cd9835ab172 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:32.550017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f6d247a-6926-43a8-a438-0cd9835ab172 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:32.579255 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1316/2677] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:32 2022] POST /identity/v3/projects => generated 383 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:32.582347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85239c3-6a0b-456e-9496-19c1dbcc6983 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:32.593612 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f85239c3-6a0b-456e-9496-19c1dbcc6983 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:32.605257 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:32.653262 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2dd3f-85c1-49a5-8583-714254d12c88 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:32.654557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2dd3f-85c1-49a5-8583-714254d12c88 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:32.654916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2dd3f-85c1-49a5-8583-714254d12c88 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:32.655265 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58e2dd3f-85c1-49a5-8583-714254d12c88 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:32.656040 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2dd3f-85c1-49a5-8583-714254d12c88 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:32.658219 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58e2dd3f-85c1-49a5-8583-714254d12c88 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:32.686360 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1362/2678] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:32 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:32.690396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d247a-6926-43a8-a438-0cd9835ab172 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:32.702197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f6d247a-6926-43a8-a438-0cd9835ab172 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:32.707351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f7678-1b20-465b-b3a0-c593c5c6feb3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:32.708126 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f7678-1b20-465b-b3a0-c593c5c6feb3 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:32.708287 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f7678-1b20-465b-b3a0-c593c5c6feb3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:32.708561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404f7678-1b20-465b-b3a0-c593c5c6feb3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:32.709465 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f7678-1b20-465b-b3a0-c593c5c6feb3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:32.710901 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-404f7678-1b20-465b-b3a0-c593c5c6feb3 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:32.722598 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1317/2679] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:32.726484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2dd3f-85c1-49a5-8583-714254d12c88 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:32.739151 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58e2dd3f-85c1-49a5-8583-714254d12c88 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:32.744318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e112c242-8c26-44db-ba3c-3a183bcb98f9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:32.745157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112c242-8c26-44db-ba3c-3a183bcb98f9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:32.745442 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112c242-8c26-44db-ba3c-3a183bcb98f9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:32.745717 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e112c242-8c26-44db-ba3c-3a183bcb98f9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:32.746448 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112c242-8c26-44db-ba3c-3a183bcb98f9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:32.748263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e112c242-8c26-44db-ba3c-3a183bcb98f9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:32.760020 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1363/2680] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:32 2022] GET /identity/v3/roles => generated 1420 bytes in 34 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:32.764302 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f7678-1b20-465b-b3a0-c593c5c6feb3 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:32.775896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-404f7678-1b20-465b-b3a0-c593c5c6feb3 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:32.784464 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cbc7b-4df2-4c01-84f5-3b4463ca896d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:32.785474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cbc7b-4df2-4c01-84f5-3b4463ca896d admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:32.785838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cbc7b-4df2-4c01-84f5-3b4463ca896d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:32.786122 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-196cbc7b-4df2-4c01-84f5-3b4463ca896d admin admin] PATH_INFO: `/v3/projects/026a50bbe42f4a659bd75371f8adb377/users/98b8b1664b8040dda741db07fab77317/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:32.799396 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=12,keystone:SELECT=85,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:32.806314 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cbc7b-4df2-4c01-84f5-3b4463ca896d admin admin] RBAC: Authorizing `identity:create_grant(project_id=026a50bbe42f4a659bd75371f8adb377, user_id=98b8b1664b8040dda741db07fab77317, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:32.810639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-196cbc7b-4df2-4c01-84f5-3b4463ca896d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:32.831134 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1318/2681] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:32 2022] PUT /identity/v3/projects/026a50bbe42f4a659bd75371f8adb377/users/98b8b1664b8040dda741db07fab77317/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 67 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:32.846318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc1ba1-9b9a-4893-9be6-d0a4ad05fcdd None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:32.846617 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc1ba1-9b9a-4893-9be6-d0a4ad05fcdd None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:32.846902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcbc1ba1-9b9a-4893-9be6-d0a4ad05fcdd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:32.899416 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-dcbc1ba1-9b9a-4893-9be6-d0a4ad05fcdd None None] MFA Rules not processed for user `98b8b1664b8040dda741db07fab77317`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:32.901523 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dcbc1ba1-9b9a-4893-9be6-d0a4ad05fcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:32.928896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cbc7b-4df2-4c01-84f5-3b4463ca896d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:32.931366 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-196cbc7b-4df2-4c01-84f5-3b4463ca896d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:32.994193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1364/2682] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:32 2022] POST /identity/v3/auth/tokens => generated 3250 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:33.008055 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc1ba1-9b9a-4893-9be6-d0a4ad05fcdd None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:33.009953 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dcbc1ba1-9b9a-4893-9be6-d0a4ad05fcdd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:33.026385 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-196cbc7b-4df2-4c01-84f5-3b4463ca896d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:33.032457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-564b1164-07e8-492a-905a-734b1876e76d service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:33.034171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1164-07e8-492a-905a-734b1876e76d service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:33.034171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1164-07e8-492a-905a-734b1876e76d service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:33.034171 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-564b1164-07e8-492a-905a-734b1876e76d service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:33.036076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-564b1164-07e8-492a-905a-734b1876e76d service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:33.085554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcbc1ba1-9b9a-4893-9be6-d0a4ad05fcdd None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:33.089784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf61457-8256-4134-b11d-99cc3d843f09 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:33.090937 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf61457-8256-4134-b11d-99cc3d843f09 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:33.091742 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf61457-8256-4134-b11d-99cc3d843f09 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:33.092029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cf61457-8256-4134-b11d-99cc3d843f09 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:33.101866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf61457-8256-4134-b11d-99cc3d843f09 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:33.103531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cf61457-8256-4134-b11d-99cc3d843f09 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:33.109970 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b1164-07e8-492a-905a-734b1876e76d service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:33.111420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-564b1164-07e8-492a-905a-734b1876e76d service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:33.113858 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1365/2683] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:33 2022] GET /identity/v3/auth/tokens => generated 3250 bytes in 106 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:33.121478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1319/2684] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:32 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 194 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:33.139233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf61457-8256-4134-b11d-99cc3d843f09 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:33.179518 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:33.223721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cf61457-8256-4134-b11d-99cc3d843f09 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:33.229013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72802d-c24f-4f59-a0d2-d5fdc18e039d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:33.230401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72802d-c24f-4f59-a0d2-d5fdc18e039d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:33.230680 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72802d-c24f-4f59-a0d2-d5fdc18e039d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:33.230992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f72802d-c24f-4f59-a0d2-d5fdc18e039d admin admin] PATH_INFO: `/v3/users/98b8b1664b8040dda741db07fab77317` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:33.232465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72802d-c24f-4f59-a0d2-d5fdc18e039d admin admin] RBAC: Authorizing `identity:delete_user(user_id=98b8b1664b8040dda741db07fab77317)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:33.234786 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f72802d-c24f-4f59-a0d2-d5fdc18e039d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:33.291343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3f72802d-c24f-4f59-a0d2-d5fdc18e039d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '98b8b1664b8040dda741db07fab77317'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:33.292090 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3f72802d-c24f-4f59-a0d2-d5fdc18e039d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '98b8b1664b8040dda741db07fab77317'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:33.299869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3f72802d-c24f-4f59-a0d2-d5fdc18e039d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '98b8b1664b8040dda741db07fab77317'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:33.300672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3f72802d-c24f-4f59-a0d2-d5fdc18e039d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '98b8b1664b8040dda741db07fab77317'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:33.315926 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3f72802d-c24f-4f59-a0d2-d5fdc18e039d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '98b8b1664b8040dda741db07fab77317'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:33.332037 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1366/2685] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:33 2022] DELETE /identity/v3/users/98b8b1664b8040dda741db07fab77317 => generated 0 bytes in 194 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:33.337035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e1450-6851-416a-9496-e76a28e3a3d8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:33.337035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e1450-6851-416a-9496-e76a28e3a3d8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:33.337906 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-297e1450-6851-416a-9496-e76a28e3a3d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:33.360280 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-297e1450-6851-416a-9496-e76a28e3a3d8 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:33.361518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-297e1450-6851-416a-9496-e76a28e3a3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:33.437335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1320/2686] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:33 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:33.447929 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72802d-c24f-4f59-a0d2-d5fdc18e039d admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:33.449418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3f72802d-c24f-4f59-a0d2-d5fdc18e039d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:33.520943 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f72802d-c24f-4f59-a0d2-d5fdc18e039d admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:33.526682 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d33a89-1793-4bb5-b61d-b30a13ca78dc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:33.529118 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33a89-1793-4bb5-b61d-b30a13ca78dc service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:33.529411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33a89-1793-4bb5-b61d-b30a13ca78dc service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:33.529690 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8d33a89-1793-4bb5-b61d-b30a13ca78dc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:33.541526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d33a89-1793-4bb5-b61d-b30a13ca78dc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:33.543811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8d33a89-1793-4bb5-b61d-b30a13ca78dc service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:33.555605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1367/2687] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:33 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 108 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:33.775533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e1450-6851-416a-9496-e76a28e3a3d8 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:33.776941 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-297e1450-6851-416a-9496-e76a28e3a3d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:33.829140 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:33.842864 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-297e1450-6851-416a-9496-e76a28e3a3d8 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:33.848021 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-617024b6-7035-408b-b9c6-56d3c1ea4c44 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:33.848916 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617024b6-7035-408b-b9c6-56d3c1ea4c44 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:33.849406 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617024b6-7035-408b-b9c6-56d3c1ea4c44 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:33.849791 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-617024b6-7035-408b-b9c6-56d3c1ea4c44 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:33.851989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-617024b6-7035-408b-b9c6-56d3c1ea4c44 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:33.886301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d33a89-1793-4bb5-b61d-b30a13ca78dc service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:33.888267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-d8d33a89-1793-4bb5-b61d-b30a13ca78dc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:33.902664 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8d33a89-1793-4bb5-b61d-b30a13ca78dc service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:33.909193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e13dae7a-2286-4fcf-828f-99598864be49 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:33.910912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dae7a-2286-4fcf-828f-99598864be49 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:33.911207 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dae7a-2286-4fcf-828f-99598864be49 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:33.911603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e13dae7a-2286-4fcf-828f-99598864be49 admin admin] PATH_INFO: `/v3/projects/026a50bbe42f4a659bd75371f8adb377` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:33.912828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dae7a-2286-4fcf-828f-99598864be49 admin admin] RBAC: Authorizing `identity:delete_project(project_id=026a50bbe42f4a659bd75371f8adb377)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:33.915058 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e13dae7a-2286-4fcf-828f-99598864be49 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:33.935528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617024b6-7035-408b-b9c6-56d3c1ea4c44 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:33.937013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-617024b6-7035-408b-b9c6-56d3c1ea4c44 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:33.947604 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1321/2688] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:33 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 173 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:33.975461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=86,keystone:DELETE=13,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:33.979958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e13dae7a-2286-4fcf-828f-99598864be49 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '026a50bbe42f4a659bd75371f8adb377', 'request_id': 'req-e13dae7a-2286-4fcf-828f-99598864be49'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:33.990081 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e13dae7a-2286-4fcf-828f-99598864be49 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '026a50bbe42f4a659bd75371f8adb377', 'request_id': 'req-e13dae7a-2286-4fcf-828f-99598864be49'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:34.001310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e13dae7a-2286-4fcf-828f-99598864be49 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '026a50bbe42f4a659bd75371f8adb377', 'request_id': 'req-e13dae7a-2286-4fcf-828f-99598864be49'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:34.015877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e13dae7a-2286-4fcf-828f-99598864be49 admin admin] The token cache is being invalidate because project 026a50bbe42f4a659bd75371f8adb377 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:34.016162 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e13dae7a-2286-4fcf-828f-99598864be49 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:34.016890 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-e13dae7a-2286-4fcf-828f-99598864be49 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:34.018706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1368/2689] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:33 2022] DELETE /identity/v3/projects/026a50bbe42f4a659bd75371f8adb377 => generated 0 bytes in 133 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:34.023379 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76319e6-2937-4e0f-b820-be02a523d79a None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.023667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76319e6-2937-4e0f-b820-be02a523d79a None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.024025 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a76319e6-2937-4e0f-b820-be02a523d79a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.047338 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a76319e6-2937-4e0f-b820-be02a523d79a None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:34.048650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a76319e6-2937-4e0f-b820-be02a523d79a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:34.128919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1322/2690] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:34.136210 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93527c59-38c2-47b9-bc61-c64ac6b0000b None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.136878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93527c59-38c2-47b9-bc61-c64ac6b0000b None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.137254 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93527c59-38c2-47b9-bc61-c64ac6b0000b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.171191 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-93527c59-38c2-47b9-bc61-c64ac6b0000b None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:34.172463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-93527c59-38c2-47b9-bc61-c64ac6b0000b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:34.186668 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1369/2691] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:34 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:34.190092 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76319e6-2937-4e0f-b820-be02a523d79a None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:34.208589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a76319e6-2937-4e0f-b820-be02a523d79a None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:34.219857 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afed5cf-3057-480c-a603-784bb03b75d1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:34.220525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afed5cf-3057-480c-a603-784bb03b75d1 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.220800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afed5cf-3057-480c-a603-784bb03b75d1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.221162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afed5cf-3057-480c-a603-784bb03b75d1 admin admin] PATH_INFO: `/v3/domains` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.221995 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afed5cf-3057-480c-a603-784bb03b75d1 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80230) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:30:34.222228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afed5cf-3057-480c-a603-784bb03b75d1 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:34.223872 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afed5cf-3057-480c-a603-784bb03b75d1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:34.241583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1323/2692] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:30:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 53 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:30:34.246004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93527c59-38c2-47b9-bc61-c64ac6b0000b None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:34.255401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93527c59-38c2-47b9-bc61-c64ac6b0000b None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:34.260288 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a4a6-38f5-4c67-a78a-4c644ef3dba8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:34.260948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a4a6-38f5-4c67-a78a-4c644ef3dba8 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.261266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a4a6-38f5-4c67-a78a-4c644ef3dba8 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.261546 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a533a4a6-38f5-4c67-a78a-4c644ef3dba8 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.262238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533a4a6-38f5-4c67-a78a-4c644ef3dba8 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:34.268780 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a533a4a6-38f5-4c67-a78a-4c644ef3dba8 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:34.297318 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1370/2693] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:34 2022] POST /identity/v3/projects => generated 385 bytes in 52 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:34.301992 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afed5cf-3057-480c-a603-784bb03b75d1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:34.312139 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afed5cf-3057-480c-a603-784bb03b75d1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:34.369112 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f6b8d-4c54-4a7a-92be-120c4cb6ee06 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:34.369790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f6b8d-4c54-4a7a-92be-120c4cb6ee06 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.370076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f6b8d-4c54-4a7a-92be-120c4cb6ee06 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.370352 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa8f6b8d-4c54-4a7a-92be-120c4cb6ee06 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.371121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f6b8d-4c54-4a7a-92be-120c4cb6ee06 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:34.373158 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa8f6b8d-4c54-4a7a-92be-120c4cb6ee06 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:34.393075 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1324/2694] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:34 2022] POST /identity/v3/users => generated 293 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:34.396834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a4a6-38f5-4c67-a78a-4c644ef3dba8 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:34.408054 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a533a4a6-38f5-4c67-a78a-4c644ef3dba8 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:34.413112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019960e-23ad-416e-b78f-a7b5216f3041 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:34.413859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019960e-23ad-416e-b78f-a7b5216f3041 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.414203 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019960e-23ad-416e-b78f-a7b5216f3041 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.414486 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0019960e-23ad-416e-b78f-a7b5216f3041 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.415210 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019960e-23ad-416e-b78f-a7b5216f3041 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:34.416882 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0019960e-23ad-416e-b78f-a7b5216f3041 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:34.428402 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1371/2695] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:34.432620 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f6b8d-4c54-4a7a-92be-120c4cb6ee06 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:34.442797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa8f6b8d-4c54-4a7a-92be-120c4cb6ee06 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:34.448097 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e76cc5-5e71-41fd-aa61-a08d52188484 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:34.448759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e76cc5-5e71-41fd-aa61-a08d52188484 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.449193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e76cc5-5e71-41fd-aa61-a08d52188484 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.449475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e76cc5-5e71-41fd-aa61-a08d52188484 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.450699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e76cc5-5e71-41fd-aa61-a08d52188484 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:34.452339 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e76cc5-5e71-41fd-aa61-a08d52188484 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:34.458122 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:34.464733 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1325/2696] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:30:34.469263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019960e-23ad-416e-b78f-a7b5216f3041 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:34.479549 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0019960e-23ad-416e-b78f-a7b5216f3041 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:34.484291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d3086-6b3c-48a8-a101-5d7f59f7eee3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:34.485212 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d3086-6b3c-48a8-a101-5d7f59f7eee3 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.485493 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d3086-6b3c-48a8-a101-5d7f59f7eee3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.485768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf3d3086-6b3c-48a8-a101-5d7f59f7eee3 admin admin] PATH_INFO: `/v3/projects/02516e67206c43d18d31ca47e8901342/users/6eea559f0c494efe9c906ea00cd2ccbd/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.504806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d3086-6b3c-48a8-a101-5d7f59f7eee3 admin admin] RBAC: Authorizing `identity:create_grant(project_id=02516e67206c43d18d31ca47e8901342, user_id=6eea559f0c494efe9c906ea00cd2ccbd, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:34.507536 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf3d3086-6b3c-48a8-a101-5d7f59f7eee3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:34.521229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1372/2697] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:34 2022] PUT /identity/v3/projects/02516e67206c43d18d31ca47e8901342/users/6eea559f0c494efe9c906ea00cd2ccbd/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:34.531762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813f0ad-0662-4ffa-86dc-12ca03971acd None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.532054 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813f0ad-0662-4ffa-86dc-12ca03971acd None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.532337 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8813f0ad-0662-4ffa-86dc-12ca03971acd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.558627 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-8813f0ad-0662-4ffa-86dc-12ca03971acd None None] MFA Rules not processed for user `6eea559f0c494efe9c906ea00cd2ccbd`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:34.559887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8813f0ad-0662-4ffa-86dc-12ca03971acd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:34.626719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1326/2698] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:34.631154 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d3086-6b3c-48a8-a101-5d7f59f7eee3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:34.693762 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf3d3086-6b3c-48a8-a101-5d7f59f7eee3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:34.698475 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeb1de-f151-4114-86d3-98eaa9bb0328 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:34.699141 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeb1de-f151-4114-86d3-98eaa9bb0328 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.699426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeb1de-f151-4114-86d3-98eaa9bb0328 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.699701 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2eeb1de-f151-4114-86d3-98eaa9bb0328 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.700930 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeb1de-f151-4114-86d3-98eaa9bb0328 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:34.702908 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2eeb1de-f151-4114-86d3-98eaa9bb0328 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:34.730438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1373/2699] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:34 2022] POST /identity/v3/projects => generated 385 bytes in 100 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:34.734977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813f0ad-0662-4ffa-86dc-12ca03971acd None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:34.745758 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8813f0ad-0662-4ffa-86dc-12ca03971acd None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:34.803313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4d340-3944-4a5c-965a-4ea2931e626c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:34.803983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4d340-3944-4a5c-965a-4ea2931e626c admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.804265 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4d340-3944-4a5c-965a-4ea2931e626c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.804541 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3e4d340-3944-4a5c-965a-4ea2931e626c admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.805267 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4d340-3944-4a5c-965a-4ea2931e626c admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:34.807193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3e4d340-3944-4a5c-965a-4ea2931e626c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:34.828292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1327/2700] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:34 2022] POST /identity/v3/users => generated 293 bytes in 94 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:34.832337 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeb1de-f151-4114-86d3-98eaa9bb0328 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:34.844694 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2eeb1de-f151-4114-86d3-98eaa9bb0328 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:34.849715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948ed68-e790-4a66-8fda-9bcb05a581b4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:34.850385 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948ed68-e790-4a66-8fda-9bcb05a581b4 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.850696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948ed68-e790-4a66-8fda-9bcb05a581b4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.850973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a948ed68-e790-4a66-8fda-9bcb05a581b4 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.851695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948ed68-e790-4a66-8fda-9bcb05a581b4 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:34.853323 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a948ed68-e790-4a66-8fda-9bcb05a581b4 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:34.865135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1374/2701] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:34.869106 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4d340-3944-4a5c-965a-4ea2931e626c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:34.879530 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3e4d340-3944-4a5c-965a-4ea2931e626c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:34.884426 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbad1cc6-6909-41f8-acdc-78a8f4ee68e2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:34.885206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad1cc6-6909-41f8-acdc-78a8f4ee68e2 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.885554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad1cc6-6909-41f8-acdc-78a8f4ee68e2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.885897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbad1cc6-6909-41f8-acdc-78a8f4ee68e2 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.886723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad1cc6-6909-41f8-acdc-78a8f4ee68e2 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:34.888478 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbad1cc6-6909-41f8-acdc-78a8f4ee68e2 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:34.898950 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1328/2702] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:34 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:34.903156 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948ed68-e790-4a66-8fda-9bcb05a581b4 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:34.914111 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a948ed68-e790-4a66-8fda-9bcb05a581b4 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:34.919556 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6241f87-9ae9-49c7-9a59-aa1eac529a1b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:34.920558 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6241f87-9ae9-49c7-9a59-aa1eac529a1b admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.920845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6241f87-9ae9-49c7-9a59-aa1eac529a1b admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.921164 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6241f87-9ae9-49c7-9a59-aa1eac529a1b admin admin] PATH_INFO: `/v3/projects/2323c1b817bf466688d283a442150f96/users/85d149f9e6b94728bbd757fcd045f8b1/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.936420 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6241f87-9ae9-49c7-9a59-aa1eac529a1b admin admin] RBAC: Authorizing `identity:create_grant(project_id=2323c1b817bf466688d283a442150f96, user_id=85d149f9e6b94728bbd757fcd045f8b1, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:34.939185 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6241f87-9ae9-49c7-9a59-aa1eac529a1b admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:34.953223 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1375/2703] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:34 2022] PUT /identity/v3/projects/2323c1b817bf466688d283a442150f96/users/85d149f9e6b94728bbd757fcd045f8b1/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 51 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:34.964664 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a46ef-7b60-47f6-9fad-35e4289d38a5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:34.964955 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a46ef-7b60-47f6-9fad-35e4289d38a5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:34.965268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-565a46ef-7b60-47f6-9fad-35e4289d38a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:34.994702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-565a46ef-7b60-47f6-9fad-35e4289d38a5 None None] MFA Rules not processed for user `85d149f9e6b94728bbd757fcd045f8b1`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:34.996002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-565a46ef-7b60-47f6-9fad-35e4289d38a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:35.058333 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:35.064783 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1329/2704] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:34 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:35.069290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6241f87-9ae9-49c7-9a59-aa1eac529a1b admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:35.093606 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=91,keystone:DELETE=4,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:35.219708 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6241f87-9ae9-49c7-9a59-aa1eac529a1b admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:35.231776 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1beaa7-35e0-4c35-bd5f-1f4ddfb4175c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:35.233299 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1beaa7-35e0-4c35-bd5f-1f4ddfb4175c admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:35.233812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1beaa7-35e0-4c35-bd5f-1f4ddfb4175c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:35.234179 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b1beaa7-35e0-4c35-bd5f-1f4ddfb4175c admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:35.235042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1beaa7-35e0-4c35-bd5f-1f4ddfb4175c admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:35.237285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b1beaa7-35e0-4c35-bd5f-1f4ddfb4175c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:35.292441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1376/2705] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:35 2022] POST /identity/v3/projects => generated 383 bytes in 223 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:30:35.296712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a46ef-7b60-47f6-9fad-35e4289d38a5 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:35.315256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-565a46ef-7b60-47f6-9fad-35e4289d38a5 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:35.389104 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3627a5b-0d20-491d-8a30-5a1a712b2b81 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:35.389905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627a5b-0d20-491d-8a30-5a1a712b2b81 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:35.390276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627a5b-0d20-491d-8a30-5a1a712b2b81 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:35.390645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3627a5b-0d20-491d-8a30-5a1a712b2b81 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:35.391486 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3627a5b-0d20-491d-8a30-5a1a712b2b81 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:35.393827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d3627a5b-0d20-491d-8a30-5a1a712b2b81 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:35.436770 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1330/2706] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:35 2022] POST /identity/v3/users => generated 298 bytes in 136 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:30:35.437135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1beaa7-35e0-4c35-bd5f-1f4ddfb4175c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:35.447896 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b1beaa7-35e0-4c35-bd5f-1f4ddfb4175c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:35.459820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d73fe3-a795-4ff7-bf9a-bc645f26cea3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:35.460613 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d73fe3-a795-4ff7-bf9a-bc645f26cea3 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:35.461100 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d73fe3-a795-4ff7-bf9a-bc645f26cea3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:35.461577 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93d73fe3-a795-4ff7-bf9a-bc645f26cea3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:35.463089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d73fe3-a795-4ff7-bf9a-bc645f26cea3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:35.465612 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93d73fe3-a795-4ff7-bf9a-bc645f26cea3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:35.501597 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3627a5b-0d20-491d-8a30-5a1a712b2b81 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:35.505091 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1377/2707] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 61 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:35.512935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3627a5b-0d20-491d-8a30-5a1a712b2b81 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:35.518603 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e5218-5e7f-45e7-ad17-397b482db009 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:35.519839 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e5218-5e7f-45e7-ad17-397b482db009 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:35.520162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e5218-5e7f-45e7-ad17-397b482db009 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:35.520388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c7e5218-5e7f-45e7-ad17-397b482db009 admin admin] PATH_INFO: `/v3/projects/aef3f282623f4b18922ed077dcb57604/users/8262768bef134312b10c032e878acdd6/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:35.541990 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e5218-5e7f-45e7-ad17-397b482db009 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef3f282623f4b18922ed077dcb57604, user_id=8262768bef134312b10c032e878acdd6, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:35.545432 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c7e5218-5e7f-45e7-ad17-397b482db009 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:35.561295 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1331/2708] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:35 2022] PUT /identity/v3/projects/aef3f282623f4b18922ed077dcb57604/users/8262768bef134312b10c032e878acdd6/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 61 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:35.566505 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d73fe3-a795-4ff7-bf9a-bc645f26cea3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:35.577852 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93d73fe3-a795-4ff7-bf9a-bc645f26cea3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:35.637820 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2231fff6-ba6c-467d-8e97-8e793b5382ad admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:35.638632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231fff6-ba6c-467d-8e97-8e793b5382ad admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:35.638974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231fff6-ba6c-467d-8e97-8e793b5382ad admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:35.639320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2231fff6-ba6c-467d-8e97-8e793b5382ad admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:35.640104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231fff6-ba6c-467d-8e97-8e793b5382ad admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:35.641740 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2231fff6-ba6c-467d-8e97-8e793b5382ad admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:35.651841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1378/2709] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:35 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:35.656599 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e5218-5e7f-45e7-ad17-397b482db009 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:35.667744 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c7e5218-5e7f-45e7-ad17-397b482db009 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:35.673420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0d35c-324e-4980-9613-3f820d5ed7e9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:35.674411 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0d35c-324e-4980-9613-3f820d5ed7e9 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:35.674763 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0d35c-324e-4980-9613-3f820d5ed7e9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:35.675103 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ee0d35c-324e-4980-9613-3f820d5ed7e9 admin admin] PATH_INFO: `/v3/projects/aef3f282623f4b18922ed077dcb57604/users/8262768bef134312b10c032e878acdd6/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:35.677228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0d35c-324e-4980-9613-3f820d5ed7e9 admin admin] RBAC: Authorizing `identity:create_grant(project_id=aef3f282623f4b18922ed077dcb57604, user_id=8262768bef134312b10c032e878acdd6, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:35.679916 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ee0d35c-324e-4980-9613-3f820d5ed7e9 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:35.691155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1332/2710] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:35 2022] PUT /identity/v3/projects/aef3f282623f4b18922ed077dcb57604/users/8262768bef134312b10c032e878acdd6/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 35 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:35.701392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdeae99-9e66-4a31-8a1d-485f367542a9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:35.701917 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdeae99-9e66-4a31-8a1d-485f367542a9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:35.702268 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbdeae99-9e66-4a31-8a1d-485f367542a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:35.731137 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cbdeae99-9e66-4a31-8a1d-485f367542a9 None None] MFA Rules not processed for user `8262768bef134312b10c032e878acdd6`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:35.732946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cbdeae99-9e66-4a31-8a1d-485f367542a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:35.805859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1379/2711] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:35 2022] POST /identity/v3/auth/tokens => generated 3317 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:35.818190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0d35c-324e-4980-9613-3f820d5ed7e9 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:35.820112 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8ee0d35c-324e-4980-9613-3f820d5ed7e9 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:35.885256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ee0d35c-324e-4980-9613-3f820d5ed7e9 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:35.889518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6dc64-da92-4261-92c7-c67b40673991 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:35.890165 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6dc64-da92-4261-92c7-c67b40673991 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:35.890446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6dc64-da92-4261-92c7-c67b40673991 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:35.890720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ee6dc64-da92-4261-92c7-c67b40673991 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:35.953711 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6dc64-da92-4261-92c7-c67b40673991 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:35.955244 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ee6dc64-da92-4261-92c7-c67b40673991 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:35.965086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1333/2712] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:35 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 147 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:37.493947 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdeae99-9e66-4a31-8a1d-485f367542a9 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:37.505522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbdeae99-9e66-4a31-8a1d-485f367542a9 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:37.509229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ab550fd-f456-4390-8b1b-c787d57cbfa8 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:37.509958 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab550fd-f456-4390-8b1b-c787d57cbfa8 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:37.510307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab550fd-f456-4390-8b1b-c787d57cbfa8 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:37.510649 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ab550fd-f456-4390-8b1b-c787d57cbfa8 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:37.524344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:37.581368 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab550fd-f456-4390-8b1b-c787d57cbfa8 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:37.583056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ab550fd-f456-4390-8b1b-c787d57cbfa8 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:37.596939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1380/2713] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:37 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:38.011572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6dc64-da92-4261-92c7-c67b40673991 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:38.013737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4ee6dc64-da92-4261-92c7-c67b40673991 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:38.023426 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:38.130056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ee6dc64-da92-4261-92c7-c67b40673991 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:38.137020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10034e86-835c-461b-8739-6c632d5be9a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:38.137952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10034e86-835c-461b-8739-6c632d5be9a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:38.138175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10034e86-835c-461b-8739-6c632d5be9a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:38.141168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10034e86-835c-461b-8739-6c632d5be9a6 admin admin] PATH_INFO: `/v3/users/c11b3f3f205546a4818eb80b2c3279de` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:38.142687 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10034e86-835c-461b-8739-6c632d5be9a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c11b3f3f205546a4818eb80b2c3279de)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:38.144639 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-10034e86-835c-461b-8739-6c632d5be9a6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:38.240790 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10034e86-835c-461b-8739-6c632d5be9a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c11b3f3f205546a4818eb80b2c3279de'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:38.250657 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10034e86-835c-461b-8739-6c632d5be9a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c11b3f3f205546a4818eb80b2c3279de'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:38.252897 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10034e86-835c-461b-8739-6c632d5be9a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c11b3f3f205546a4818eb80b2c3279de'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:38.273922 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10034e86-835c-461b-8739-6c632d5be9a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c11b3f3f205546a4818eb80b2c3279de'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:38.284860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-10034e86-835c-461b-8739-6c632d5be9a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c11b3f3f205546a4818eb80b2c3279de'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:38.291702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1334/2714] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:38 2022] DELETE /identity/v3/users/c11b3f3f205546a4818eb80b2c3279de => generated 0 bytes in 280 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:38.296493 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b55d-ca4b-4e00-98e9-1080d1f32077 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:38.296864 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b55d-ca4b-4e00-98e9-1080d1f32077 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:38.297246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83b6b55d-ca4b-4e00-98e9-1080d1f32077 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:38.320826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-83b6b55d-ca4b-4e00-98e9-1080d1f32077 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:38.323006 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10034e86-835c-461b-8739-6c632d5be9a6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:38.323202 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-83b6b55d-ca4b-4e00-98e9-1080d1f32077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:38.325455 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-10034e86-835c-461b-8739-6c632d5be9a6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:38.406482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10034e86-835c-461b-8739-6c632d5be9a6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:38.407632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1381/2715] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:38 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:38.413221 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ee8dc-1a4d-4e65-b4a7-12ed0f9319a0 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:38.414088 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ee8dc-1a4d-4e65-b4a7-12ed0f9319a0 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:38.414376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ee8dc-1a4d-4e65-b4a7-12ed0f9319a0 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:38.414655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e6ee8dc-1a4d-4e65-b4a7-12ed0f9319a0 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:38.416600 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0e6ee8dc-1a4d-4e65-b4a7-12ed0f9319a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:38.419705 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6b55d-ca4b-4e00-98e9-1080d1f32077 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:38.422683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-83b6b55d-ca4b-4e00-98e9-1080d1f32077 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:38.469213 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:38.494267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83b6b55d-ca4b-4e00-98e9-1080d1f32077 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:38.501575 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc6fcb-2f5b-4af6-8181-f02ba76a2d7d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:38.502238 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc6fcb-2f5b-4af6-8181-f02ba76a2d7d service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:38.502523 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc6fcb-2f5b-4af6-8181-f02ba76a2d7d service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:38.502802 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4fc6fcb-2f5b-4af6-8181-f02ba76a2d7d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:38.514229 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ee8dc-1a4d-4e65-b4a7-12ed0f9319a0 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:38.515237 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc6fcb-2f5b-4af6-8181-f02ba76a2d7d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:38.516341 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e6ee8dc-1a4d-4e65-b4a7-12ed0f9319a0 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:38.516686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4fc6fcb-2f5b-4af6-8181-f02ba76a2d7d service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:38.527060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1335/2716] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:38 2022] GET /identity/v3/auth/tokens => generated 3317 bytes in 205 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:38.535805 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1382/2717] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:38 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:39.102301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ee8dc-1a4d-4e65-b4a7-12ed0f9319a0 service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:39.105031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-0e6ee8dc-1a4d-4e65-b4a7-12ed0f9319a0 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:39.132404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e6ee8dc-1a4d-4e65-b4a7-12ed0f9319a0 service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:39.142449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:39.143402 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:39.143787 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:39.144168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] PATH_INFO: `/v3/projects/0cf11b58ba3c442aa1bebcabf3f4b1c7` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:39.145494 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0cf11b58ba3c442aa1bebcabf3f4b1c7)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:39.147783 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:39.200404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0cf11b58ba3c442aa1bebcabf3f4b1c7', 'request_id': 'req-93e0ea97-86d3-4d61-b154-e221eedfb01f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.208671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0cf11b58ba3c442aa1bebcabf3f4b1c7', 'request_id': 'req-93e0ea97-86d3-4d61-b154-e221eedfb01f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.214905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0cf11b58ba3c442aa1bebcabf3f4b1c7', 'request_id': 'req-93e0ea97-86d3-4d61-b154-e221eedfb01f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.226573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] The token cache is being invalidate because project 0cf11b58ba3c442aa1bebcabf3f4b1c7 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:39.226861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.227491 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.229084 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1336/2718] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:39 2022] DELETE /identity/v3/projects/0cf11b58ba3c442aa1bebcabf3f4b1c7 => generated 0 bytes in 127 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:39.233108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc6fcb-2f5b-4af6-8181-f02ba76a2d7d service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:39.242731 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4fc6fcb-2f5b-4af6-8181-f02ba76a2d7d service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:39.295686 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:39.304169 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5597d9-b683-45f4-9916-506b6eb99b95 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:39.305135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5597d9-b683-45f4-9916-506b6eb99b95 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:39.305421 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5597d9-b683-45f4-9916-506b6eb99b95 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:39.305699 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f5597d9-b683-45f4-9916-506b6eb99b95 admin admin] PATH_INFO: `/v3/users/84c2fd005c7d4782817c78942438dbe4` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:39.306880 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5597d9-b683-45f4-9916-506b6eb99b95 admin admin] RBAC: Authorizing `identity:delete_user(user_id=84c2fd005c7d4782817c78942438dbe4)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:39.308860 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f5597d9-b683-45f4-9916-506b6eb99b95 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:39.363522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6f5597d9-b683-45f4-9916-506b6eb99b95 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '84c2fd005c7d4782817c78942438dbe4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.364263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6f5597d9-b683-45f4-9916-506b6eb99b95 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '84c2fd005c7d4782817c78942438dbe4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.373872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6f5597d9-b683-45f4-9916-506b6eb99b95 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '84c2fd005c7d4782817c78942438dbe4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.373872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6f5597d9-b683-45f4-9916-506b6eb99b95 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '84c2fd005c7d4782817c78942438dbe4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.386632 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-6f5597d9-b683-45f4-9916-506b6eb99b95 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '84c2fd005c7d4782817c78942438dbe4'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.402133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1383/2719] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:39 2022] DELETE /identity/v3/users/84c2fd005c7d4782817c78942438dbe4 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:39.739626 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:39.741655 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:39.758798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93e0ea97-86d3-4d61-b154-e221eedfb01f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:39.834469 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:39.835254 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:39.835541 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:39.835814 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] PATH_INFO: `/v3/projects/69e53af8d1dd4e899d92c15f102ecc2f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:39.837230 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] RBAC: Authorizing `identity:delete_project(project_id=69e53af8d1dd4e899d92c15f102ecc2f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:39.839406 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:39.890536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '69e53af8d1dd4e899d92c15f102ecc2f', 'request_id': 'req-00ba258d-0fb8-43cd-aa72-60a950a5251c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.899391 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '69e53af8d1dd4e899d92c15f102ecc2f', 'request_id': 'req-00ba258d-0fb8-43cd-aa72-60a950a5251c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.902109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=85,keystone:DELETE=13,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:39.910516 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '69e53af8d1dd4e899d92c15f102ecc2f', 'request_id': 'req-00ba258d-0fb8-43cd-aa72-60a950a5251c'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.925878 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] The token cache is being invalidate because project 69e53af8d1dd4e899d92c15f102ecc2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:39.926310 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.926988 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:39.931670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1337/2720] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:39 2022] DELETE /identity/v3/projects/69e53af8d1dd4e899d92c15f102ecc2f => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:39.932672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5597d9-b683-45f4-9916-506b6eb99b95 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:39.942123 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6f5597d9-b683-45f4-9916-506b6eb99b95 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:39.974764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f5597d9-b683-45f4-9916-506b6eb99b95 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:40.045639 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5287ffc6-5ccb-4d7d-a8ba-61c58c82a630 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:40.046529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287ffc6-5ccb-4d7d-a8ba-61c58c82a630 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:40.046810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287ffc6-5ccb-4d7d-a8ba-61c58c82a630 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:40.047079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5287ffc6-5ccb-4d7d-a8ba-61c58c82a630 admin admin] PATH_INFO: `/v3/users/70d1877f3ad64540b6b513c550fcf3c5` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:40.048463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287ffc6-5ccb-4d7d-a8ba-61c58c82a630 admin admin] RBAC: Authorizing `identity:delete_user(user_id=70d1877f3ad64540b6b513c550fcf3c5)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:40.050657 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5287ffc6-5ccb-4d7d-a8ba-61c58c82a630 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:40.114869 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5287ffc6-5ccb-4d7d-a8ba-61c58c82a630 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '70d1877f3ad64540b6b513c550fcf3c5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:40.116128 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5287ffc6-5ccb-4d7d-a8ba-61c58c82a630 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '70d1877f3ad64540b6b513c550fcf3c5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:40.129537 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5287ffc6-5ccb-4d7d-a8ba-61c58c82a630 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '70d1877f3ad64540b6b513c550fcf3c5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:40.130527 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5287ffc6-5ccb-4d7d-a8ba-61c58c82a630 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '70d1877f3ad64540b6b513c550fcf3c5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:40.157753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-5287ffc6-5ccb-4d7d-a8ba-61c58c82a630 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '70d1877f3ad64540b6b513c550fcf3c5'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:40.166043 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=79,keystone:DELETE=19,keystone:INSERT=2 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:40.195698 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1384/2721] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:39 2022] DELETE /identity/v3/users/70d1877f3ad64540b6b513c550fcf3c5 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:40.497783 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:40.499918 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:40.512883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ba258d-0fb8-43cd-aa72-60a950a5251c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:40.571294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-412b9842-4028-499b-b4bf-128fde1dc0ba admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:40.572153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b9842-4028-499b-b4bf-128fde1dc0ba admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:40.572472 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b9842-4028-499b-b4bf-128fde1dc0ba admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:40.572754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-412b9842-4028-499b-b4bf-128fde1dc0ba admin admin] PATH_INFO: `/v3/projects/ec7ad0d795ba440682681979525be456` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:40.573989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b9842-4028-499b-b4bf-128fde1dc0ba admin admin] RBAC: Authorizing `identity:delete_project(project_id=ec7ad0d795ba440682681979525be456)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:40.575907 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-412b9842-4028-499b-b4bf-128fde1dc0ba admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:40.624361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-412b9842-4028-499b-b4bf-128fde1dc0ba admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'ec7ad0d795ba440682681979525be456', 'request_id': 'req-412b9842-4028-499b-b4bf-128fde1dc0ba'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:40.631672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-412b9842-4028-499b-b4bf-128fde1dc0ba admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'ec7ad0d795ba440682681979525be456', 'request_id': 'req-412b9842-4028-499b-b4bf-128fde1dc0ba'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:40.637777 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-412b9842-4028-499b-b4bf-128fde1dc0ba admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'ec7ad0d795ba440682681979525be456', 'request_id': 'req-412b9842-4028-499b-b4bf-128fde1dc0ba'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:40.650697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-412b9842-4028-499b-b4bf-128fde1dc0ba admin admin] The token cache is being invalidate because project ec7ad0d795ba440682681979525be456 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:40.650990 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-412b9842-4028-499b-b4bf-128fde1dc0ba admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:40.651621 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-412b9842-4028-499b-b4bf-128fde1dc0ba admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:40.653394 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1338/2722] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:40 2022] DELETE /identity/v3/projects/ec7ad0d795ba440682681979525be456 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:40.658885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2285f-ccf2-4002-a66b-1b489112cb44 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:40.659183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2285f-ccf2-4002-a66b-1b489112cb44 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:40.659469 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c2285f-ccf2-4002-a66b-1b489112cb44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:40.679206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-f2c2285f-ccf2-4002-a66b-1b489112cb44 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:40.680415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f2c2285f-ccf2-4002-a66b-1b489112cb44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:40.740400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1385/2723] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:40.748724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa581b17-3f4a-4e24-a051-9ff7307881d7 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:40.749027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa581b17-3f4a-4e24-a051-9ff7307881d7 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:40.749306 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa581b17-3f4a-4e24-a051-9ff7307881d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:40.767393 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-aa581b17-3f4a-4e24-a051-9ff7307881d7 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:40.768584 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-aa581b17-3f4a-4e24-a051-9ff7307881d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:40.776388 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1339/2724] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:40 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:40.781057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2285f-ccf2-4002-a66b-1b489112cb44 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:40.790563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c2285f-ccf2-4002-a66b-1b489112cb44 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:40.795841 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323978a-820a-4b8e-a14b-e1b4f665e94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:40.796485 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323978a-820a-4b8e-a14b-e1b4f665e94e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:40.796764 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323978a-820a-4b8e-a14b-e1b4f665e94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:40.797082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0323978a-820a-4b8e-a14b-e1b4f665e94e admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:40.797800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323978a-820a-4b8e-a14b-e1b4f665e94e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:30:40.798104 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323978a-820a-4b8e-a14b-e1b4f665e94e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:40.799676 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0323978a-820a-4b8e-a14b-e1b4f665e94e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:40.813058 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1386/2725] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:30:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:30:40.815443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa581b17-3f4a-4e24-a051-9ff7307881d7 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:40.824673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa581b17-3f4a-4e24-a051-9ff7307881d7 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:40.829520 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91120d68-0fed-4d55-b603-cb7c382749e1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:40.830170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91120d68-0fed-4d55-b603-cb7c382749e1 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:40.830458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91120d68-0fed-4d55-b603-cb7c382749e1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:40.830740 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91120d68-0fed-4d55-b603-cb7c382749e1 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:40.831437 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91120d68-0fed-4d55-b603-cb7c382749e1 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:40.833456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-91120d68-0fed-4d55-b603-cb7c382749e1 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:40.859688 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1340/2726] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:40 2022] POST /identity/v3/projects => generated 363 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:40.863835 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323978a-820a-4b8e-a14b-e1b4f665e94e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:40.873759 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0323978a-820a-4b8e-a14b-e1b4f665e94e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:40.929223 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75c75f-95a6-48b0-986c-e98daf174934 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:40.929878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75c75f-95a6-48b0-986c-e98daf174934 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:40.930159 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75c75f-95a6-48b0-986c-e98daf174934 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:40.930436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad75c75f-95a6-48b0-986c-e98daf174934 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:40.931106 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75c75f-95a6-48b0-986c-e98daf174934 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:40.933033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad75c75f-95a6-48b0-986c-e98daf174934 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:40.951675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1387/2727] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:40 2022] POST /identity/v3/users => generated 282 bytes in 88 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:40.955696 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91120d68-0fed-4d55-b603-cb7c382749e1 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:40.966087 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-91120d68-0fed-4d55-b603-cb7c382749e1 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:40.971071 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65486608-9d37-42e9-bbae-b9d83c500d9b admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:40.971751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65486608-9d37-42e9-bbae-b9d83c500d9b admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:40.972037 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65486608-9d37-42e9-bbae-b9d83c500d9b admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:40.972313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65486608-9d37-42e9-bbae-b9d83c500d9b admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:40.973083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65486608-9d37-42e9-bbae-b9d83c500d9b admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:40.974691 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65486608-9d37-42e9-bbae-b9d83c500d9b admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:40.986718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1341/2728] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:40.990608 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75c75f-95a6-48b0-986c-e98daf174934 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:41.000495 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad75c75f-95a6-48b0-986c-e98daf174934 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:41.005056 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d128ecd2-e30f-448b-b2a2-ca836362abe0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:41.005710 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128ecd2-e30f-448b-b2a2-ca836362abe0 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:41.005995 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128ecd2-e30f-448b-b2a2-ca836362abe0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:41.006273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d128ecd2-e30f-448b-b2a2-ca836362abe0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:41.006981 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128ecd2-e30f-448b-b2a2-ca836362abe0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:41.008569 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d128ecd2-e30f-448b-b2a2-ca836362abe0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:41.018436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1388/2729] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:40 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:41.022115 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65486608-9d37-42e9-bbae-b9d83c500d9b admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:41.032921 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65486608-9d37-42e9-bbae-b9d83c500d9b admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:41.037784 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78baae-2b6a-450b-b3f0-e597004a3422 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:41.038667 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78baae-2b6a-450b-b3f0-e597004a3422 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:41.038943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78baae-2b6a-450b-b3f0-e597004a3422 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:41.039215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e78baae-2b6a-450b-b3f0-e597004a3422 admin admin] PATH_INFO: `/v3/projects/4bff7a31383544bd99123e01868cbbc6/users/9a8d7c9980ae4862bd57fbf17060662e/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:41.055629 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78baae-2b6a-450b-b3f0-e597004a3422 admin admin] RBAC: Authorizing `identity:create_grant(project_id=4bff7a31383544bd99123e01868cbbc6, user_id=9a8d7c9980ae4862bd57fbf17060662e, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:41.058633 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e78baae-2b6a-450b-b3f0-e597004a3422 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:41.072088 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1342/2730] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:41 2022] PUT /identity/v3/projects/4bff7a31383544bd99123e01868cbbc6/users/9a8d7c9980ae4862bd57fbf17060662e/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:41.082531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486319f-c430-401e-8af2-c5b8523c8e19 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:41.082822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486319f-c430-401e-8af2-c5b8523c8e19 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:41.083103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b486319f-c430-401e-8af2-c5b8523c8e19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:41.112503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b486319f-c430-401e-8af2-c5b8523c8e19 None None] MFA Rules not processed for user `9a8d7c9980ae4862bd57fbf17060662e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:41.118159 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b486319f-c430-401e-8af2-c5b8523c8e19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:41.160335 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:DELETE=1,keystone:SELECT=96,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:41.180732 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1389/2731] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:41 2022] POST /identity/v3/auth/tokens => generated 3230 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:41.191858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78baae-2b6a-450b-b3f0-e597004a3422 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:41.194562 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-3e78baae-2b6a-450b-b3f0-e597004a3422 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:41.209726 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=8,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:41.255430 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e78baae-2b6a-450b-b3f0-e597004a3422 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:41.259013 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748dcb4-e593-4772-918b-16f1d4c626af service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:41.259656 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748dcb4-e593-4772-918b-16f1d4c626af service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:41.259944 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748dcb4-e593-4772-918b-16f1d4c626af service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:41.260207 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2748dcb4-e593-4772-918b-16f1d4c626af service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:41.269220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748dcb4-e593-4772-918b-16f1d4c626af service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:41.270445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2748dcb4-e593-4772-918b-16f1d4c626af service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:41.281838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1343/2732] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:41 2022] GET /identity/v3/auth/tokens => generated 3230 bytes in 90 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:42.106085 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0b996-a5e4-4c71-a98b-1fbf087cdf85 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:42.106547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0b996-a5e4-4c71-a98b-1fbf087cdf85 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:42.106670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f0b996-a5e4-4c71-a98b-1fbf087cdf85 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:42.131409 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-27f0b996-a5e4-4c71-a98b-1fbf087cdf85 None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:42.132907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-27f0b996-a5e4-4c71-a98b-1fbf087cdf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:42.195817 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1390/2733] 10.222.0.64 () {58 vars in 967 bytes} [Thu May 26 18:30:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:30:42.208718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748dcb4-e593-4772-918b-16f1d4c626af service cinder] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:42.210194 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2748dcb4-e593-4772-918b-16f1d4c626af service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:42.282229 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2748dcb4-e593-4772-918b-16f1d4c626af service cinder] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:42.287256 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad89100a-297f-4c72-948f-ecb5563bc14b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:42.287898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89100a-297f-4c72-948f-ecb5563bc14b service swift] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:42.288181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89100a-297f-4c72-948f-ecb5563bc14b service swift] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:42.288456 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad89100a-297f-4c72-948f-ecb5563bc14b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:42.297151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89100a-297f-4c72-948f-ecb5563bc14b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:42.298747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad89100a-297f-4c72-948f-ecb5563bc14b service swift] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:42.314763 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1344/2734] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:30:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 107 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:30:42.498746 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0b996-a5e4-4c71-a98b-1fbf087cdf85 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:42.500310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-27f0b996-a5e4-4c71-a98b-1fbf087cdf85 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:42.581092 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f0b996-a5e4-4c71-a98b-1fbf087cdf85 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:42.585531 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d52f45-9943-43e0-9ba5-af4f8e5f0660 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:42.586414 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d52f45-9943-43e0-9ba5-af4f8e5f0660 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:42.586736 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d52f45-9943-43e0-9ba5-af4f8e5f0660 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:42.586962 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48d52f45-9943-43e0-9ba5-af4f8e5f0660 admin admin] PATH_INFO: `/v3/users/6eea559f0c494efe9c906ea00cd2ccbd` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:42.588471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d52f45-9943-43e0-9ba5-af4f8e5f0660 admin admin] RBAC: Authorizing `identity:delete_user(user_id=6eea559f0c494efe9c906ea00cd2ccbd)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:42.590457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48d52f45-9943-43e0-9ba5-af4f8e5f0660 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:42.657684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-48d52f45-9943-43e0-9ba5-af4f8e5f0660 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '6eea559f0c494efe9c906ea00cd2ccbd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:42.658344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-48d52f45-9943-43e0-9ba5-af4f8e5f0660 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '6eea559f0c494efe9c906ea00cd2ccbd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:42.666975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-48d52f45-9943-43e0-9ba5-af4f8e5f0660 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '6eea559f0c494efe9c906ea00cd2ccbd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:42.667660 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-48d52f45-9943-43e0-9ba5-af4f8e5f0660 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '6eea559f0c494efe9c906ea00cd2ccbd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:42.685258 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-48d52f45-9943-43e0-9ba5-af4f8e5f0660 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '6eea559f0c494efe9c906ea00cd2ccbd'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:42.709950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1391/2735] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:42 2022] DELETE /identity/v3/users/6eea559f0c494efe9c906ea00cd2ccbd => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:42.715337 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3cc0-4499-48e3-b913-f422e47dc074 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:42.715961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3cc0-4499-48e3-b913-f422e47dc074 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:42.716450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bcb3cc0-4499-48e3-b913-f422e47dc074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:42.744550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-4bcb3cc0-4499-48e3-b913-f422e47dc074 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:42.744550 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4bcb3cc0-4499-48e3-b913-f422e47dc074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:42.800699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1345/2736] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:42 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:42.810882 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d52f45-9943-43e0-9ba5-af4f8e5f0660 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:42.813645 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-48d52f45-9943-43e0-9ba5-af4f8e5f0660 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:42.830783 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:42.883843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48d52f45-9943-43e0-9ba5-af4f8e5f0660 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:42.887948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e3e45-c19e-484a-91bc-f6266b60a716 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:42.889359 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3e45-c19e-484a-91bc-f6266b60a716 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:42.889715 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3e45-c19e-484a-91bc-f6266b60a716 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:42.890103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-470e3e45-c19e-484a-91bc-f6266b60a716 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:42.910751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e3e45-c19e-484a-91bc-f6266b60a716 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:42.912834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-470e3e45-c19e-484a-91bc-f6266b60a716 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:42.923607 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1392/2737] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:42 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 113 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:43.238008 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb3cc0-4499-48e3-b913-f422e47dc074 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:43.239423 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-4bcb3cc0-4499-48e3-b913-f422e47dc074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:43.253774 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bcb3cc0-4499-48e3-b913-f422e47dc074 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:43.258408 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:43.259266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:43.259547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:43.259858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] PATH_INFO: `/v3/projects/02516e67206c43d18d31ca47e8901342` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:43.260974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=02516e67206c43d18d31ca47e8901342)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:43.262892 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:43.304832 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=97,keystone:DELETE=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:43.312742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '02516e67206c43d18d31ca47e8901342', 'request_id': 'req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.319754 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '02516e67206c43d18d31ca47e8901342', 'request_id': 'req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.325910 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '02516e67206c43d18d31ca47e8901342', 'request_id': 'req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.337817 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] The token cache is being invalidate because project 02516e67206c43d18d31ca47e8901342 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:43.338042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.338674 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.340270 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1346/2738] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:43 2022] DELETE /identity/v3/projects/02516e67206c43d18d31ca47e8901342 => generated 0 bytes in 103 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:43.344457 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e3e45-c19e-484a-91bc-f6266b60a716 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:43.354018 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-470e3e45-c19e-484a-91bc-f6266b60a716 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:43.410217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534a982-d091-4c4c-8495-e261da6087d5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:43.411089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534a982-d091-4c4c-8495-e261da6087d5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:43.411377 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534a982-d091-4c4c-8495-e261da6087d5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:43.411659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b534a982-d091-4c4c-8495-e261da6087d5 admin admin] PATH_INFO: `/v3/users/85d149f9e6b94728bbd757fcd045f8b1` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:43.412837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534a982-d091-4c4c-8495-e261da6087d5 admin admin] RBAC: Authorizing `identity:delete_user(user_id=85d149f9e6b94728bbd757fcd045f8b1)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:43.414805 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b534a982-d091-4c4c-8495-e261da6087d5 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:43.468903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b534a982-d091-4c4c-8495-e261da6087d5 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '85d149f9e6b94728bbd757fcd045f8b1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.469579 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b534a982-d091-4c4c-8495-e261da6087d5 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '85d149f9e6b94728bbd757fcd045f8b1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.476444 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b534a982-d091-4c4c-8495-e261da6087d5 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '85d149f9e6b94728bbd757fcd045f8b1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.477108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b534a982-d091-4c4c-8495-e261da6087d5 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '85d149f9e6b94728bbd757fcd045f8b1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.490227 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-b534a982-d091-4c4c-8495-e261da6087d5 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '85d149f9e6b94728bbd757fcd045f8b1'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.503514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1393/2739] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:43 2022] DELETE /identity/v3/users/85d149f9e6b94728bbd757fcd045f8b1 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:43.772365 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:43.775133 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:43.800014 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b5258c-af53-4b81-b2a5-7c03db8fd5b5 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:43.859611 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:43.860471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:43.860751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:43.861061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] PATH_INFO: `/v3/projects/2323c1b817bf466688d283a442150f96` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:43.862429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2323c1b817bf466688d283a442150f96)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:43.864364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:43.911507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2323c1b817bf466688d283a442150f96', 'request_id': 'req-e192783d-b9ef-42de-8311-fed07461d7f4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.923755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2323c1b817bf466688d283a442150f96', 'request_id': 'req-e192783d-b9ef-42de-8311-fed07461d7f4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.929443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2323c1b817bf466688d283a442150f96', 'request_id': 'req-e192783d-b9ef-42de-8311-fed07461d7f4'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.940146 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] The token cache is being invalidate because project 2323c1b817bf466688d283a442150f96 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:43.940426 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.941073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:43.942591 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1347/2740] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:43 2022] DELETE /identity/v3/projects/2323c1b817bf466688d283a442150f96 => generated 0 bytes in 171 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:43.946535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534a982-d091-4c4c-8495-e261da6087d5 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:43.947920 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b534a982-d091-4c4c-8495-e261da6087d5 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:43.960386 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b534a982-d091-4c4c-8495-e261da6087d5 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:43.993328 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:44.019050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f16a337-4045-4603-85e8-2811a80c362d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:44.019912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16a337-4045-4603-85e8-2811a80c362d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:44.020192 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16a337-4045-4603-85e8-2811a80c362d admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:44.020465 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f16a337-4045-4603-85e8-2811a80c362d admin admin] PATH_INFO: `/v3/users/8262768bef134312b10c032e878acdd6` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:44.021611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16a337-4045-4603-85e8-2811a80c362d admin admin] RBAC: Authorizing `identity:delete_user(user_id=8262768bef134312b10c032e878acdd6)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:44.023513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f16a337-4045-4603-85e8-2811a80c362d admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:44.066861 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f16a337-4045-4603-85e8-2811a80c362d admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '8262768bef134312b10c032e878acdd6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:44.067494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f16a337-4045-4603-85e8-2811a80c362d admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '8262768bef134312b10c032e878acdd6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:44.074188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f16a337-4045-4603-85e8-2811a80c362d admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '8262768bef134312b10c032e878acdd6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:44.074823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f16a337-4045-4603-85e8-2811a80c362d admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '8262768bef134312b10c032e878acdd6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:44.086249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0f16a337-4045-4603-85e8-2811a80c362d admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '8262768bef134312b10c032e878acdd6'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:44.098846 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1394/2741] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:30:43 2022] DELETE /identity/v3/users/8262768bef134312b10c032e878acdd6 => generated 0 bytes in 153 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:44.609873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:44.611330 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:44.624530 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e192783d-b9ef-42de-8311-fed07461d7f4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:44.682912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a194094-c192-4e40-9f77-1e3e77bbb1d7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:44.683773 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194094-c192-4e40-9f77-1e3e77bbb1d7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:44.684060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194094-c192-4e40-9f77-1e3e77bbb1d7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:44.684344 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a194094-c192-4e40-9f77-1e3e77bbb1d7 admin admin] PATH_INFO: `/v3/projects/aef3f282623f4b18922ed077dcb57604` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:44.686085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a194094-c192-4e40-9f77-1e3e77bbb1d7 admin admin] RBAC: Authorizing `identity:delete_project(project_id=aef3f282623f4b18922ed077dcb57604)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:44.688016 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a194094-c192-4e40-9f77-1e3e77bbb1d7 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:44.689539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=87,keystone:DELETE=11,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:44.746368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a194094-c192-4e40-9f77-1e3e77bbb1d7 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'aef3f282623f4b18922ed077dcb57604', 'request_id': 'req-4a194094-c192-4e40-9f77-1e3e77bbb1d7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:44.754094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a194094-c192-4e40-9f77-1e3e77bbb1d7 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'aef3f282623f4b18922ed077dcb57604', 'request_id': 'req-4a194094-c192-4e40-9f77-1e3e77bbb1d7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:44.759719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a194094-c192-4e40-9f77-1e3e77bbb1d7 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'aef3f282623f4b18922ed077dcb57604', 'request_id': 'req-4a194094-c192-4e40-9f77-1e3e77bbb1d7'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:44.771101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a194094-c192-4e40-9f77-1e3e77bbb1d7 admin admin] The token cache is being invalidate because project aef3f282623f4b18922ed077dcb57604 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:30:44.771386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a194094-c192-4e40-9f77-1e3e77bbb1d7 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:44.772006 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-4a194094-c192-4e40-9f77-1e3e77bbb1d7 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:30:44.773577 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1348/2742] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:30:44 2022] DELETE /identity/v3/projects/aef3f282623f4b18922ed077dcb57604 => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:30:44.778394 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed767e4-2702-4343-86ba-59f3251848eb None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:44.778903 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed767e4-2702-4343-86ba-59f3251848eb None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:44.779000 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed767e4-2702-4343-86ba-59f3251848eb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:44.796934 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-eed767e4-2702-4343-86ba-59f3251848eb None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:44.798150 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-eed767e4-2702-4343-86ba-59f3251848eb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:44.856495 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1395/2743] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:44.864177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c354bf-5637-4bde-bd13-9c26e393e173 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:44.864485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c354bf-5637-4bde-bd13-9c26e393e173 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:44.864763 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56c354bf-5637-4bde-bd13-9c26e393e173 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:44.882948 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-56c354bf-5637-4bde-bd13-9c26e393e173 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:44.884125 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-56c354bf-5637-4bde-bd13-9c26e393e173 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:44.892423 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1349/2744] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:44 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:44.896582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed767e4-2702-4343-86ba-59f3251848eb None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:44.906386 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eed767e4-2702-4343-86ba-59f3251848eb None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:44.910872 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc7573-6944-44fc-acf1-29449a5030a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:44.911514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc7573-6944-44fc-acf1-29449a5030a6 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:44.911813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc7573-6944-44fc-acf1-29449a5030a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:44.912089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ecc7573-6944-44fc-acf1-29449a5030a6 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:44.912960 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc7573-6944-44fc-acf1-29449a5030a6 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:30:44.913297 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc7573-6944-44fc-acf1-29449a5030a6 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:44.914890 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ecc7573-6944-44fc-acf1-29449a5030a6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:44.926737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1396/2745] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:30:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:30:44.930671 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c354bf-5637-4bde-bd13-9c26e393e173 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:44.940281 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56c354bf-5637-4bde-bd13-9c26e393e173 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:44.945086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805004d-d958-473c-a894-8ff484ec004a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:44.945751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805004d-d958-473c-a894-8ff484ec004a admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:44.946030 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805004d-d958-473c-a894-8ff484ec004a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:44.946301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5805004d-d958-473c-a894-8ff484ec004a admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:44.946985 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805004d-d958-473c-a894-8ff484ec004a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:44.948874 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5805004d-d958-473c-a894-8ff484ec004a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:44.978012 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1350/2746] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:30:44 2022] POST /identity/v3/projects => generated 369 bytes in 45 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:44.979330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc7573-6944-44fc-acf1-29449a5030a6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:44.993693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ecc7573-6944-44fc-acf1-29449a5030a6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:45.033412 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:45.051924 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a5a34-50b3-48bd-9eec-a6902249f7b0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:45.052595 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a5a34-50b3-48bd-9eec-a6902249f7b0 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:45.052885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a5a34-50b3-48bd-9eec-a6902249f7b0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:45.053233 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-162a5a34-50b3-48bd-9eec-a6902249f7b0 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:45.054170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a5a34-50b3-48bd-9eec-a6902249f7b0 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:45.056615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-162a5a34-50b3-48bd-9eec-a6902249f7b0 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:45.076768 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1397/2747] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:30:44 2022] POST /identity/v3/users => generated 285 bytes in 98 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:30:45.080868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805004d-d958-473c-a894-8ff484ec004a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:45.091616 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5805004d-d958-473c-a894-8ff484ec004a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:45.096585 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5d887-6dce-46cb-b2a2-dc7df818f387 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:45.097271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5d887-6dce-46cb-b2a2-dc7df818f387 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:45.097556 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5d887-6dce-46cb-b2a2-dc7df818f387 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:45.097837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d5d887-6dce-46cb-b2a2-dc7df818f387 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:45.098561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5d887-6dce-46cb-b2a2-dc7df818f387 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:45.100188 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d5d887-6dce-46cb-b2a2-dc7df818f387 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:45.110989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1351/2748] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:45.114823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a5a34-50b3-48bd-9eec-a6902249f7b0 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:45.125310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-162a5a34-50b3-48bd-9eec-a6902249f7b0 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:45.129910 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97df94c0-893b-4c91-a29a-8ac1628cd56c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:45.130567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df94c0-893b-4c91-a29a-8ac1628cd56c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:45.130855 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df94c0-893b-4c91-a29a-8ac1628cd56c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:45.131132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97df94c0-893b-4c91-a29a-8ac1628cd56c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:45.131845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df94c0-893b-4c91-a29a-8ac1628cd56c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:45.133515 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97df94c0-893b-4c91-a29a-8ac1628cd56c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:45.143463 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1398/2749] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:30:45 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:30:45.147290 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5d887-6dce-46cb-b2a2-dc7df818f387 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:45.158035 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d5d887-6dce-46cb-b2a2-dc7df818f387 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:45.162987 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d49fb1-a888-4f66-9d81-156ad8da72ec admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:45.163871 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d49fb1-a888-4f66-9d81-156ad8da72ec admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:45.164177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d49fb1-a888-4f66-9d81-156ad8da72ec admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:45.164450 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47d49fb1-a888-4f66-9d81-156ad8da72ec admin admin] PATH_INFO: `/v3/projects/0b354722936b49a48e844071839870ac/users/39f6d242dd9f475b8a8e41e3e1de2d38/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:45.180457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d49fb1-a888-4f66-9d81-156ad8da72ec admin admin] RBAC: Authorizing `identity:create_grant(project_id=0b354722936b49a48e844071839870ac, user_id=39f6d242dd9f475b8a8e41e3e1de2d38, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:45.183152 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47d49fb1-a888-4f66-9d81-156ad8da72ec admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:45.196485 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1352/2750] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:30:45 2022] PUT /identity/v3/projects/0b354722936b49a48e844071839870ac/users/39f6d242dd9f475b8a8e41e3e1de2d38/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 50 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) May 26 18:30:45.260188 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbc3bb-44a4-4705-817f-997aa9be6ea5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:45.260478 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbc3bb-44a4-4705-817f-997aa9be6ea5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:45.260756 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cecbc3bb-44a4-4705-817f-997aa9be6ea5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:45.287132 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-cecbc3bb-44a4-4705-817f-997aa9be6ea5 None None] MFA Rules not processed for user `39f6d242dd9f475b8a8e41e3e1de2d38`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:30:45.288332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cecbc3bb-44a4-4705-817f-997aa9be6ea5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:45.360494 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1399/2751] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:30:45 2022] POST /identity/v3/auth/tokens => generated 3236 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:30:45.371808 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d49fb1-a888-4f66-9d81-156ad8da72ec admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:30:45.373545 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-47d49fb1-a888-4f66-9d81-156ad8da72ec admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:30:45.432787 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47d49fb1-a888-4f66-9d81-156ad8da72ec admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:30:45.436458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a839420-e932-423a-8859-101de3bc2e4f service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbb5beba8a45a5b0a9b0beba0e0d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:30:45.437142 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a839420-e932-423a-8859-101de3bc2e4f service glance] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:30:45.437428 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a839420-e932-423a-8859-101de3bc2e4f service glance] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:30:45.437704 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a839420-e932-423a-8859-101de3bc2e4f service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:30:45.446320 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a839420-e932-423a-8859-101de3bc2e4f service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:30:45.447800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a839420-e932-423a-8859-101de3bc2e4f service glance] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:30:45.456764 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1353/2752] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:30:45 2022] GET /identity/v3/auth/tokens => generated 3236 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:30:55.356445 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=47,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:30:55.452814 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=77,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:31:17.324916 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbc3bb-44a4-4705-817f-997aa9be6ea5 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:17.386842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cecbc3bb-44a4-4705-817f-997aa9be6ea5 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:17.391826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d2eef-5de7-4b86-9342-81ce59df2efd admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:17.392717 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d2eef-5de7-4b86-9342-81ce59df2efd admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:17.393001 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d2eef-5de7-4b86-9342-81ce59df2efd admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:17.393282 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599d2eef-5de7-4b86-9342-81ce59df2efd admin admin] PATH_INFO: `/v3/users/39f6d242dd9f475b8a8e41e3e1de2d38` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:17.394459 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d2eef-5de7-4b86-9342-81ce59df2efd admin admin] RBAC: Authorizing `identity:delete_user(user_id=39f6d242dd9f475b8a8e41e3e1de2d38)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:17.396380 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599d2eef-5de7-4b86-9342-81ce59df2efd admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:17.442512 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-599d2eef-5de7-4b86-9342-81ce59df2efd admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '39f6d242dd9f475b8a8e41e3e1de2d38'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:17.443153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-599d2eef-5de7-4b86-9342-81ce59df2efd admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '39f6d242dd9f475b8a8e41e3e1de2d38'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:17.450201 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-599d2eef-5de7-4b86-9342-81ce59df2efd admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '39f6d242dd9f475b8a8e41e3e1de2d38'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:17.450824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-599d2eef-5de7-4b86-9342-81ce59df2efd admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '39f6d242dd9f475b8a8e41e3e1de2d38'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:17.462760 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-599d2eef-5de7-4b86-9342-81ce59df2efd admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '39f6d242dd9f475b8a8e41e3e1de2d38'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:17.474758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1400/2753] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:31:17 2022] DELETE /identity/v3/users/39f6d242dd9f475b8a8e41e3e1de2d38 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:31:17.479789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df0af3-15d7-4832-85e1-317b748678a3 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:17.480293 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df0af3-15d7-4832-85e1-317b748678a3 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:17.480393 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13df0af3-15d7-4832-85e1-317b748678a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:17.497803 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-13df0af3-15d7-4832-85e1-317b748678a3 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:17.499002 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-13df0af3-15d7-4832-85e1-317b748678a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:17.555943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1354/2754] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:31:17 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:31:17.565611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d2eef-5de7-4b86-9342-81ce59df2efd admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:17.566998 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-599d2eef-5de7-4b86-9342-81ce59df2efd admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:17.623572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599d2eef-5de7-4b86-9342-81ce59df2efd admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:17.627252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d755a84-fd84-48fd-8c22-daf584f44334 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:17.627893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d755a84-fd84-48fd-8c22-daf584f44334 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:17.628173 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d755a84-fd84-48fd-8c22-daf584f44334 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:17.628449 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d755a84-fd84-48fd-8c22-daf584f44334 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:17.637669 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d755a84-fd84-48fd-8c22-daf584f44334 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:17.639100 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d755a84-fd84-48fd-8c22-daf584f44334 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:17.648517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1401/2755] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:31:17 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:31:17.906573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df0af3-15d7-4832-85e1-317b748678a3 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:17.907968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-13df0af3-15d7-4832-85e1-317b748678a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:17.919924 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13df0af3-15d7-4832-85e1-317b748678a3 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:17.924555 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bd20a3b-8d84-40a4-901c-8c59d934d00d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:17.925443 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd20a3b-8d84-40a4-901c-8c59d934d00d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:17.925727 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd20a3b-8d84-40a4-901c-8c59d934d00d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:17.926024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bd20a3b-8d84-40a4-901c-8c59d934d00d admin admin] PATH_INFO: `/v3/projects/0b354722936b49a48e844071839870ac` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:17.927243 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd20a3b-8d84-40a4-901c-8c59d934d00d admin admin] RBAC: Authorizing `identity:delete_project(project_id=0b354722936b49a48e844071839870ac)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:17.929184 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bd20a3b-8d84-40a4-901c-8c59d934d00d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:17.980923 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6bd20a3b-8d84-40a4-901c-8c59d934d00d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0b354722936b49a48e844071839870ac', 'request_id': 'req-6bd20a3b-8d84-40a4-901c-8c59d934d00d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:17.987997 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6bd20a3b-8d84-40a4-901c-8c59d934d00d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0b354722936b49a48e844071839870ac', 'request_id': 'req-6bd20a3b-8d84-40a4-901c-8c59d934d00d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:17.994063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6bd20a3b-8d84-40a4-901c-8c59d934d00d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0b354722936b49a48e844071839870ac', 'request_id': 'req-6bd20a3b-8d84-40a4-901c-8c59d934d00d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:18.004723 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6bd20a3b-8d84-40a4-901c-8c59d934d00d admin admin] The token cache is being invalidate because project 0b354722936b49a48e844071839870ac was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:31:18.005027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6bd20a3b-8d84-40a4-901c-8c59d934d00d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:18.005645 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-6bd20a3b-8d84-40a4-901c-8c59d934d00d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:18.007433 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1355/2756] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:31:17 2022] DELETE /identity/v3/projects/0b354722936b49a48e844071839870ac => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:31:18.012260 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e314f8b-4742-4ccb-be64-73b8626dd8e8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:18.012552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e314f8b-4742-4ccb-be64-73b8626dd8e8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:18.012834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e314f8b-4742-4ccb-be64-73b8626dd8e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:18.030013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-8e314f8b-4742-4ccb-be64-73b8626dd8e8 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:18.031215 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-8e314f8b-4742-4ccb-be64-73b8626dd8e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:18.048275 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:31:18.092084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1402/2757] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:31:18.099746 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19d8e4-d251-4de9-9b73-f62c243d27da None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:18.100043 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19d8e4-d251-4de9-9b73-f62c243d27da None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:18.100330 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f19d8e4-d251-4de9-9b73-f62c243d27da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:18.119533 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-1f19d8e4-d251-4de9-9b73-f62c243d27da None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:18.120720 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-1f19d8e4-d251-4de9-9b73-f62c243d27da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:18.128439 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1356/2758] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:31:18.132354 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e314f8b-4742-4ccb-be64-73b8626dd8e8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:18.141680 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e314f8b-4742-4ccb-be64-73b8626dd8e8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:18.146183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b3d03-947f-4c9d-91a7-c311b87f8eef admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:18.146832 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b3d03-947f-4c9d-91a7-c311b87f8eef admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:18.147112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b3d03-947f-4c9d-91a7-c311b87f8eef admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:18.147387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-142b3d03-947f-4c9d-91a7-c311b87f8eef admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:18.148398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b3d03-947f-4c9d-91a7-c311b87f8eef admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:31:18.148398 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b3d03-947f-4c9d-91a7-c311b87f8eef admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:18.150033 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-142b3d03-947f-4c9d-91a7-c311b87f8eef admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:18.161600 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1403/2759] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:31:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:31:18.166258 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19d8e4-d251-4de9-9b73-f62c243d27da None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:18.175217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f19d8e4-d251-4de9-9b73-f62c243d27da None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:18.181384 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78d119-a263-40eb-ba47-1480cd218d4a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:18.182056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78d119-a263-40eb-ba47-1480cd218d4a admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:18.182342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78d119-a263-40eb-ba47-1480cd218d4a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:18.182618 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df78d119-a263-40eb-ba47-1480cd218d4a admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:18.183307 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78d119-a263-40eb-ba47-1480cd218d4a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:18.185321 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df78d119-a263-40eb-ba47-1480cd218d4a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:18.222161 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1357/2760] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:31:18 2022] POST /identity/v3/projects => generated 373 bytes in 53 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:31:18.223252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b3d03-947f-4c9d-91a7-c311b87f8eef admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:18.234330 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-142b3d03-947f-4c9d-91a7-c311b87f8eef admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:18.296721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51235c-dd3d-43f0-b513-2caa023936d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:18.297442 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51235c-dd3d-43f0-b513-2caa023936d2 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:18.297728 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51235c-dd3d-43f0-b513-2caa023936d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:18.298057 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd51235c-dd3d-43f0-b513-2caa023936d2 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:18.298705 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51235c-dd3d-43f0-b513-2caa023936d2 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:18.300609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd51235c-dd3d-43f0-b513-2caa023936d2 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:18.321626 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1404/2761] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:31:18 2022] POST /identity/v3/users => generated 287 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:31:18.325817 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78d119-a263-40eb-ba47-1480cd218d4a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:18.336393 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df78d119-a263-40eb-ba47-1480cd218d4a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:18.340976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda9908-6108-45fe-955f-f45ae794f60c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:18.341676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda9908-6108-45fe-955f-f45ae794f60c admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:18.341961 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda9908-6108-45fe-955f-f45ae794f60c admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:18.342301 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cda9908-6108-45fe-955f-f45ae794f60c admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:18.342982 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda9908-6108-45fe-955f-f45ae794f60c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:18.344579 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cda9908-6108-45fe-955f-f45ae794f60c admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:18.355254 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1358/2762] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:31:18.359168 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51235c-dd3d-43f0-b513-2caa023936d2 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:18.369473 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd51235c-dd3d-43f0-b513-2caa023936d2 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:18.374094 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aef9bd1-641f-47b2-b85a-3dad33e774f1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:18.374743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef9bd1-641f-47b2-b85a-3dad33e774f1 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:18.375024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef9bd1-641f-47b2-b85a-3dad33e774f1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:18.375301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aef9bd1-641f-47b2-b85a-3dad33e774f1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:18.376013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef9bd1-641f-47b2-b85a-3dad33e774f1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:18.377648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aef9bd1-641f-47b2-b85a-3dad33e774f1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:18.387824 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1405/2763] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:31:18 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:31:18.392288 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda9908-6108-45fe-955f-f45ae794f60c admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:18.402553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cda9908-6108-45fe-955f-f45ae794f60c admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:18.407564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d0b84-2ede-4262-b6c7-64659909c68d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:18.408452 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d0b84-2ede-4262-b6c7-64659909c68d admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:18.408736 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d0b84-2ede-4262-b6c7-64659909c68d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:18.409042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-165d0b84-2ede-4262-b6c7-64659909c68d admin admin] PATH_INFO: `/v3/projects/4e3c79f07f9f4882b4df96c9b342c60c/users/c9ea995f9000416ebe923ebb5b171189/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:18.424670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d0b84-2ede-4262-b6c7-64659909c68d admin admin] RBAC: Authorizing `identity:create_grant(project_id=4e3c79f07f9f4882b4df96c9b342c60c, user_id=c9ea995f9000416ebe923ebb5b171189, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:18.427447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-165d0b84-2ede-4262-b6c7-64659909c68d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:18.439595 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1359/2764] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:31:18 2022] PUT /identity/v3/projects/4e3c79f07f9f4882b4df96c9b342c60c/users/c9ea995f9000416ebe923ebb5b171189/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:31:18.445246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f14fd-0af7-4082-b6eb-d5c4cfcceef8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:18.445538 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f14fd-0af7-4082-b6eb-d5c4cfcceef8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:18.445842 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-287f14fd-0af7-4082-b6eb-d5c4cfcceef8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:18.464055 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-287f14fd-0af7-4082-b6eb-d5c4cfcceef8 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:18.465284 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-287f14fd-0af7-4082-b6eb-d5c4cfcceef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:18.524554 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1406/2765] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:31:18 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:31:18.534217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d0b84-2ede-4262-b6c7-64659909c68d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:18.535920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-165d0b84-2ede-4262-b6c7-64659909c68d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:18.557619 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:31:18.595079 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-165d0b84-2ede-4262-b6c7-64659909c68d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:18.598633 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c421787b-7b59-432f-b7f7-28a695a2e983 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:18.599276 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421787b-7b59-432f-b7f7-28a695a2e983 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:18.599560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421787b-7b59-432f-b7f7-28a695a2e983 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:18.599834 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c421787b-7b59-432f-b7f7-28a695a2e983 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:18.609350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421787b-7b59-432f-b7f7-28a695a2e983 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:18.610792 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c421787b-7b59-432f-b7f7-28a695a2e983 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:18.620128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1360/2766] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:31:18 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:31:19.335404 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f14fd-0af7-4082-b6eb-d5c4cfcceef8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:19.338396 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-287f14fd-0af7-4082-b6eb-d5c4cfcceef8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:19.351065 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-287f14fd-0af7-4082-b6eb-d5c4cfcceef8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:19.356231 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97eadd1-8d17-4f1b-828c-63415cc082e3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:19.357130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eadd1-8d17-4f1b-828c-63415cc082e3 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:19.357411 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eadd1-8d17-4f1b-828c-63415cc082e3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:19.357695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f97eadd1-8d17-4f1b-828c-63415cc082e3 admin admin] PATH_INFO: `/v3/users/9a8d7c9980ae4862bd57fbf17060662e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:19.358878 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97eadd1-8d17-4f1b-828c-63415cc082e3 admin admin] RBAC: Authorizing `identity:delete_user(user_id=9a8d7c9980ae4862bd57fbf17060662e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:19.360760 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f97eadd1-8d17-4f1b-828c-63415cc082e3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:19.383821 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:INSERT=3,keystone:DELETE=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:31:19.416363 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f97eadd1-8d17-4f1b-828c-63415cc082e3 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '9a8d7c9980ae4862bd57fbf17060662e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:19.417060 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f97eadd1-8d17-4f1b-828c-63415cc082e3 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '9a8d7c9980ae4862bd57fbf17060662e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:19.425310 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f97eadd1-8d17-4f1b-828c-63415cc082e3 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '9a8d7c9980ae4862bd57fbf17060662e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:19.429193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f97eadd1-8d17-4f1b-828c-63415cc082e3 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '9a8d7c9980ae4862bd57fbf17060662e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:19.443401 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-f97eadd1-8d17-4f1b-828c-63415cc082e3 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '9a8d7c9980ae4862bd57fbf17060662e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:19.461038 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1407/2767] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:31:19 2022] DELETE /identity/v3/users/9a8d7c9980ae4862bd57fbf17060662e => generated 0 bytes in 126 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:31:19.465448 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92b66b-7d5d-4566-98b5-e6b2721ea5ae None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:19.465930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92b66b-7d5d-4566-98b5-e6b2721ea5ae None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:19.466214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d92b66b-7d5d-4566-98b5-e6b2721ea5ae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:19.486779 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7d92b66b-7d5d-4566-98b5-e6b2721ea5ae None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:19.488175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7d92b66b-7d5d-4566-98b5-e6b2721ea5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:19.558861 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1361/2768] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:31:19 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:31:19.567931 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97eadd1-8d17-4f1b-828c-63415cc082e3 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:19.569471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f97eadd1-8d17-4f1b-828c-63415cc082e3 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:19.640303 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f97eadd1-8d17-4f1b-828c-63415cc082e3 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:19.646116 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-571cf28c-c94c-451c-9a37-2ca83dc9261d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:19.647735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cf28c-c94c-451c-9a37-2ca83dc9261d service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:19.648931 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cf28c-c94c-451c-9a37-2ca83dc9261d service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:19.649400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-571cf28c-c94c-451c-9a37-2ca83dc9261d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:19.667703 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571cf28c-c94c-451c-9a37-2ca83dc9261d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:19.669805 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-571cf28c-c94c-451c-9a37-2ca83dc9261d service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:19.682658 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1408/2769] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:31:19 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 115 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:31:20.012459 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92b66b-7d5d-4566-98b5-e6b2721ea5ae None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:20.014719 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7d92b66b-7d5d-4566-98b5-e6b2721ea5ae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:20.040691 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d92b66b-7d5d-4566-98b5-e6b2721ea5ae None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:20.058378 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50afe0be-1a93-46fd-abb7-60fa3f521dbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:20.059554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe0be-1a93-46fd-abb7-60fa3f521dbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:20.059999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe0be-1a93-46fd-abb7-60fa3f521dbe admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:20.060474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50afe0be-1a93-46fd-abb7-60fa3f521dbe admin admin] PATH_INFO: `/v3/projects/4bff7a31383544bd99123e01868cbbc6` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:20.062614 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afe0be-1a93-46fd-abb7-60fa3f521dbe admin admin] RBAC: Authorizing `identity:delete_project(project_id=4bff7a31383544bd99123e01868cbbc6)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:20.065147 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50afe0be-1a93-46fd-abb7-60fa3f521dbe admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:20.129859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-50afe0be-1a93-46fd-abb7-60fa3f521dbe admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4bff7a31383544bd99123e01868cbbc6', 'request_id': 'req-50afe0be-1a93-46fd-abb7-60fa3f521dbe'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:20.139137 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-50afe0be-1a93-46fd-abb7-60fa3f521dbe admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4bff7a31383544bd99123e01868cbbc6', 'request_id': 'req-50afe0be-1a93-46fd-abb7-60fa3f521dbe'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:20.151062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-50afe0be-1a93-46fd-abb7-60fa3f521dbe admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4bff7a31383544bd99123e01868cbbc6', 'request_id': 'req-50afe0be-1a93-46fd-abb7-60fa3f521dbe'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:20.164156 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-50afe0be-1a93-46fd-abb7-60fa3f521dbe admin admin] The token cache is being invalidate because project 4bff7a31383544bd99123e01868cbbc6 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:31:20.164935 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-50afe0be-1a93-46fd-abb7-60fa3f521dbe admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:20.165629 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-50afe0be-1a93-46fd-abb7-60fa3f521dbe admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:20.167597 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1362/2770] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:31:20 2022] DELETE /identity/v3/projects/4bff7a31383544bd99123e01868cbbc6 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:31:20.172220 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffbe7a-a9cf-42ca-b65f-e1d51603e8c0 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:20.172436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffbe7a-a9cf-42ca-b65f-e1d51603e8c0 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:20.172716 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19ffbe7a-a9cf-42ca-b65f-e1d51603e8c0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:20.194543 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-19ffbe7a-a9cf-42ca-b65f-e1d51603e8c0 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:20.195792 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-19ffbe7a-a9cf-42ca-b65f-e1d51603e8c0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:20.287361 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1409/2771] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 116 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:31:20.295187 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaed227-922a-47a8-bb27-0e31d220fd3c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:20.295473 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaed227-922a-47a8-bb27-0e31d220fd3c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:20.295750 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7aaed227-922a-47a8-bb27-0e31d220fd3c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:20.315285 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-7aaed227-922a-47a8-bb27-0e31d220fd3c None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:20.316807 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-7aaed227-922a-47a8-bb27-0e31d220fd3c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:20.326460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1363/2772] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:31:20 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:31:20.330839 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffbe7a-a9cf-42ca-b65f-e1d51603e8c0 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:20.342174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19ffbe7a-a9cf-42ca-b65f-e1d51603e8c0 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:20.347160 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca898de-53a7-4769-bf99-f9ba368929df admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:20.347859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca898de-53a7-4769-bf99-f9ba368929df admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:20.348113 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca898de-53a7-4769-bf99-f9ba368929df admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:20.348388 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aca898de-53a7-4769-bf99-f9ba368929df admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:20.349159 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca898de-53a7-4769-bf99-f9ba368929df admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:31:20.349474 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca898de-53a7-4769-bf99-f9ba368929df admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:20.351083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aca898de-53a7-4769-bf99-f9ba368929df admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:20.368774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1410/2773] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:31:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 38 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:31:20.370359 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaed227-922a-47a8-bb27-0e31d220fd3c None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:20.380233 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7aaed227-922a-47a8-bb27-0e31d220fd3c None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:20.385508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d24a0-5897-4068-95b8-2195c589be64 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:20.386552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d24a0-5897-4068-95b8-2195c589be64 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:20.386552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d24a0-5897-4068-95b8-2195c589be64 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:20.386882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc3d24a0-5897-4068-95b8-2195c589be64 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:20.387383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d24a0-5897-4068-95b8-2195c589be64 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:20.389371 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc3d24a0-5897-4068-95b8-2195c589be64 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:20.421027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1364/2774] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:31:20 2022] POST /identity/v3/projects => generated 375 bytes in 49 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:31:20.422427 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca898de-53a7-4769-bf99-f9ba368929df admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:20.433533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aca898de-53a7-4769-bf99-f9ba368929df admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:20.465393 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=93,keystone:DELETE=6,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:31:20.496319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075af30e-be68-48f8-bf6d-642fb04cbafb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:20.497011 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075af30e-be68-48f8-bf6d-642fb04cbafb admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:20.497340 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075af30e-be68-48f8-bf6d-642fb04cbafb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:20.497661 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-075af30e-be68-48f8-bf6d-642fb04cbafb admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:20.498446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075af30e-be68-48f8-bf6d-642fb04cbafb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:20.500408 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-075af30e-be68-48f8-bf6d-642fb04cbafb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:20.525044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1411/2775] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:31:20 2022] POST /identity/v3/users => generated 288 bytes in 99 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:31:20.526270 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d24a0-5897-4068-95b8-2195c589be64 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:20.537101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc3d24a0-5897-4068-95b8-2195c589be64 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:20.542181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553da37-4092-4bc5-9f8a-6f7e110ddcbf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:20.542867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553da37-4092-4bc5-9f8a-6f7e110ddcbf admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:20.543154 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553da37-4092-4bc5-9f8a-6f7e110ddcbf admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:20.543441 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6553da37-4092-4bc5-9f8a-6f7e110ddcbf admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:20.544172 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553da37-4092-4bc5-9f8a-6f7e110ddcbf admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:20.545850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6553da37-4092-4bc5-9f8a-6f7e110ddcbf admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:20.558274 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1365/2776] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:31:20.562434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075af30e-be68-48f8-bf6d-642fb04cbafb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:20.573368 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-075af30e-be68-48f8-bf6d-642fb04cbafb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:20.578319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d3b21-0927-41fe-8184-0b7804e2f1b9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:20.579002 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3b21-0927-41fe-8184-0b7804e2f1b9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:20.579284 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3b21-0927-41fe-8184-0b7804e2f1b9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:20.579564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d3b21-0927-41fe-8184-0b7804e2f1b9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:20.580293 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d3b21-0927-41fe-8184-0b7804e2f1b9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:20.582004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d3b21-0927-41fe-8184-0b7804e2f1b9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:20.594914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1412/2777] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:31:20 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:31:20.599272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553da37-4092-4bc5-9f8a-6f7e110ddcbf admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:20.609607 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6553da37-4092-4bc5-9f8a-6f7e110ddcbf admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:20.614367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ee5b4-a0ee-4e57-948b-b37ca352444a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:20.615284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ee5b4-a0ee-4e57-948b-b37ca352444a admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:20.615565 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ee5b4-a0ee-4e57-948b-b37ca352444a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:20.615838 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67ee5b4-a0ee-4e57-948b-b37ca352444a admin admin] PATH_INFO: `/v3/projects/2457c1667aa44df18c9b675529016ed8/users/def480386c474f23a202c67c60ac6984/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:20.618936 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:31:20.635440 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ee5b4-a0ee-4e57-948b-b37ca352444a admin admin] RBAC: Authorizing `identity:create_grant(project_id=2457c1667aa44df18c9b675529016ed8, user_id=def480386c474f23a202c67c60ac6984, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:20.638156 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67ee5b4-a0ee-4e57-948b-b37ca352444a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:20.652004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1366/2778] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:31:20 2022] PUT /identity/v3/projects/2457c1667aa44df18c9b675529016ed8/users/def480386c474f23a202c67c60ac6984/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:31:20.662603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1e43d-1ef6-4926-a8fe-4efdd4e2d6be None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:20.662895 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1e43d-1ef6-4926-a8fe-4efdd4e2d6be None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:20.663174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ef1e43d-1ef6-4926-a8fe-4efdd4e2d6be None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:20.691983 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-4ef1e43d-1ef6-4926-a8fe-4efdd4e2d6be None None] MFA Rules not processed for user `def480386c474f23a202c67c60ac6984`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:20.693314 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-4ef1e43d-1ef6-4926-a8fe-4efdd4e2d6be None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:20.768287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1413/2779] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:31:20 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 107 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:31:20.780894 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ee5b4-a0ee-4e57-948b-b37ca352444a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:20.782749 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d67ee5b4-a0ee-4e57-948b-b37ca352444a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:20.848007 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67ee5b4-a0ee-4e57-948b-b37ca352444a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:20.854136 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d77489-4fbe-4834-93b0-4eade1968332 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:20.854800 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d77489-4fbe-4834-93b0-4eade1968332 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:20.855082 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d77489-4fbe-4834-93b0-4eade1968332 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:20.855360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d77489-4fbe-4834-93b0-4eade1968332 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:20.864976 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d77489-4fbe-4834-93b0-4eade1968332 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:20.866508 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d77489-4fbe-4834-93b0-4eade1968332 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:20.876469 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1367/2780] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:31:20 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:31:22.364560 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e47f-c8e7-4c6d-aa2a-e9a301875762 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:22.365069 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e47f-c8e7-4c6d-aa2a-e9a301875762 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:22.365346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f9e47f-c8e7-4c6d-aa2a-e9a301875762 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:22.384289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-e0f9e47f-c8e7-4c6d-aa2a-e9a301875762 None None] MFA Rules not processed for user `def480386c474f23a202c67c60ac6984`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:22.385713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e0f9e47f-c8e7-4c6d-aa2a-e9a301875762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:22.397080 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1414/2781] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:31:22 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:31:22.732524 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9fed9-1366-42aa-ab1e-3d92677a6884 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:22.734335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9fed9-1366-42aa-ab1e-3d92677a6884 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:22.734694 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdc9fed9-1366-42aa-ab1e-3d92677a6884 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:22.768446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-cdc9fed9-1366-42aa-ab1e-3d92677a6884 None None] MFA Rules not processed for user `c9ea995f9000416ebe923ebb5b171189`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:22.769777 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cdc9fed9-1366-42aa-ab1e-3d92677a6884 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:22.848746 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1368/2782] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:31:22 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:31:22.854305 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9e47f-c8e7-4c6d-aa2a-e9a301875762 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:22.856735 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-e0f9e47f-c8e7-4c6d-aa2a-e9a301875762 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:22.933547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f9e47f-c8e7-4c6d-aa2a-e9a301875762 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:22.938153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e690b-9b4a-4f8c-bd9f-c06c12d7e906 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:22.938829 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e690b-9b4a-4f8c-bd9f-c06c12d7e906 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:22.939115 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e690b-9b4a-4f8c-bd9f-c06c12d7e906 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:22.939450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-087e690b-9b4a-4f8c-bd9f-c06c12d7e906 admin admin] PATH_INFO: `/v3/projects` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:22.940151 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e690b-9b4a-4f8c-bd9f-c06c12d7e906 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:22.942303 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-087e690b-9b4a-4f8c-bd9f-c06c12d7e906 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:22.973028 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1415/2783] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:31:22 2022] POST /identity/v3/projects => generated 371 bytes in 118 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:31:22.974896 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9fed9-1366-42aa-ab1e-3d92677a6884 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:22.987206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdc9fed9-1366-42aa-ab1e-3d92677a6884 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:23.049653 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2780e5f-5a55-4053-975b-47f8a3ebd926 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:23.050326 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2780e5f-5a55-4053-975b-47f8a3ebd926 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:23.050609 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2780e5f-5a55-4053-975b-47f8a3ebd926 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:23.050882 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2780e5f-5a55-4053-975b-47f8a3ebd926 admin admin] PATH_INFO: `/v3/users` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:23.051588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2780e5f-5a55-4053-975b-47f8a3ebd926 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:23.053823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2780e5f-5a55-4053-975b-47f8a3ebd926 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:23.078037 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1369/2784] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:31:22 2022] POST /identity/v3/users => generated 292 bytes in 104 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:31:23.082000 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e690b-9b4a-4f8c-bd9f-c06c12d7e906 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:23.094092 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-087e690b-9b4a-4f8c-bd9f-c06c12d7e906 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:23.098821 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc868481-7257-4400-9ac3-fffafeef0297 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:23.099495 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc868481-7257-4400-9ac3-fffafeef0297 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:23.099774 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc868481-7257-4400-9ac3-fffafeef0297 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:23.100071 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc868481-7257-4400-9ac3-fffafeef0297 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:23.100837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc868481-7257-4400-9ac3-fffafeef0297 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:23.103183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc868481-7257-4400-9ac3-fffafeef0297 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:23.114557 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1416/2785] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 33 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:31:23.118709 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2780e5f-5a55-4053-975b-47f8a3ebd926 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:23.125149 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:31:23.129663 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2780e5f-5a55-4053-975b-47f8a3ebd926 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:23.135612 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d749846-0f13-4bf7-bc0f-b4516837013a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:23.136505 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749846-0f13-4bf7-bc0f-b4516837013a admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:23.136786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749846-0f13-4bf7-bc0f-b4516837013a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:23.137099 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d749846-0f13-4bf7-bc0f-b4516837013a admin admin] PATH_INFO: `/v3/projects/b3cc7af656244e4a8316605e4ac0f218/users/5957f80f6aae4d059face3c811c1202e/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:23.155067 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d749846-0f13-4bf7-bc0f-b4516837013a admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cc7af656244e4a8316605e4ac0f218, user_id=5957f80f6aae4d059face3c811c1202e, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:23.157819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d749846-0f13-4bf7-bc0f-b4516837013a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:23.171315 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1370/2786] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:31:23 2022] PUT /identity/v3/projects/b3cc7af656244e4a8316605e4ac0f218/users/5957f80f6aae4d059face3c811c1202e/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 53 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:31:23.175307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc868481-7257-4400-9ac3-fffafeef0297 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:23.186210 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc868481-7257-4400-9ac3-fffafeef0297 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:23.190901 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=96,keystone:INSERT=4 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:31:23.255705 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f99c9cfa-27a2-40b1-aff7-f1bea5c3fcc9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:23.256381 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c9cfa-27a2-40b1-aff7-f1bea5c3fcc9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:23.256670 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c9cfa-27a2-40b1-aff7-f1bea5c3fcc9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:23.256951 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f99c9cfa-27a2-40b1-aff7-f1bea5c3fcc9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:23.258230 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c9cfa-27a2-40b1-aff7-f1bea5c3fcc9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:23.259858 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f99c9cfa-27a2-40b1-aff7-f1bea5c3fcc9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:23.269753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1417/2787] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:31:23 2022] GET /identity/v3/roles => generated 1420 bytes in 95 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:31:23.274542 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d749846-0f13-4bf7-bc0f-b4516837013a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:23.284792 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d749846-0f13-4bf7-bc0f-b4516837013a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:23.289673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04433-c062-4697-a05d-05b6a87ed426 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:23.290565 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04433-c062-4697-a05d-05b6a87ed426 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:23.290847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04433-c062-4697-a05d-05b6a87ed426 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:23.291124 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fb04433-c062-4697-a05d-05b6a87ed426 admin admin] PATH_INFO: `/v3/projects/b3cc7af656244e4a8316605e4ac0f218/users/5957f80f6aae4d059face3c811c1202e/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:23.293174 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb04433-c062-4697-a05d-05b6a87ed426 admin admin] RBAC: Authorizing `identity:create_grant(project_id=b3cc7af656244e4a8316605e4ac0f218, user_id=5957f80f6aae4d059face3c811c1202e, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:23.295876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fb04433-c062-4697-a05d-05b6a87ed426 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:23.306065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1371/2788] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:31:23 2022] PUT /identity/v3/projects/b3cc7af656244e4a8316605e4ac0f218/users/5957f80f6aae4d059face3c811c1202e/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 33 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:31:29.223767 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454cce4-f0d9-4b46-b1a6-56fe2247cae6 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:29.224228 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454cce4-f0d9-4b46-b1a6-56fe2247cae6 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:29.224323 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b454cce4-f0d9-4b46-b1a6-56fe2247cae6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:29.259038 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b454cce4-f0d9-4b46-b1a6-56fe2247cae6 None None] MFA Rules not processed for user `5957f80f6aae4d059face3c811c1202e`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:29.260376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b454cce4-f0d9-4b46-b1a6-56fe2247cae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:29.336359 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1418/2789] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:31:29 2022] POST /identity/v3/auth/tokens => generated 3305 bytes in 114 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:31:29.351217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04433-c062-4697-a05d-05b6a87ed426 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:29.353361 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6fb04433-c062-4697-a05d-05b6a87ed426 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:29.431518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fb04433-c062-4697-a05d-05b6a87ed426 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:29.437266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d847d7-106a-4b1a-94f6-6ae484858456 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:29.437928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d847d7-106a-4b1a-94f6-6ae484858456 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:29.438217 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d847d7-106a-4b1a-94f6-6ae484858456 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:29.438670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56d847d7-106a-4b1a-94f6-6ae484858456 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:29.497779 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d847d7-106a-4b1a-94f6-6ae484858456 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:29.499414 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56d847d7-106a-4b1a-94f6-6ae484858456 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:29.509823 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1372/2790] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:31:29 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:31:30.562777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3264d-7a93-4f0b-b98b-486f4bfa0cd5 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:30.563308 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3264d-7a93-4f0b-b98b-486f4bfa0cd5 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:30.563407 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f3264d-7a93-4f0b-b98b-486f4bfa0cd5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:30.580870 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-49f3264d-7a93-4f0b-b98b-486f4bfa0cd5 None None] MFA Rules not processed for user `c9ea995f9000416ebe923ebb5b171189`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:30.582108 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-49f3264d-7a93-4f0b-b98b-486f4bfa0cd5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:30.589939 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1419/2791] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:31:30 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:31:39.506434 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=69,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:31:40.575446 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=63 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:31:41.202934 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d847d7-106a-4b1a-94f6-6ae484858456 service nova] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:41.204539 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-56d847d7-106a-4b1a-94f6-6ae484858456 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:41.285658 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56d847d7-106a-4b1a-94f6-6ae484858456 service nova] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:41.289812 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234b738-43d2-4c8a-a8b1-aafbed1cda04 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:41.290458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234b738-43d2-4c8a-a8b1-aafbed1cda04 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:41.290735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234b738-43d2-4c8a-a8b1-aafbed1cda04 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:41.291006 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9234b738-43d2-4c8a-a8b1-aafbed1cda04 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:41.292831 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9234b738-43d2-4c8a-a8b1-aafbed1cda04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:41.308323 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234b738-43d2-4c8a-a8b1-aafbed1cda04 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:41.309895 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9234b738-43d2-4c8a-a8b1-aafbed1cda04 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:41.321406 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1373/2792] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:31:41 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:31:42.516922 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3265cb-c30d-431d-a5f8-9f8ecf935980 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:42.517379 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3265cb-c30d-431d-a5f8-9f8ecf935980 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:42.517529 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d3265cb-c30d-431d-a5f8-9f8ecf935980 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:42.535272 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-7d3265cb-c30d-431d-a5f8-9f8ecf935980 None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:42.536477 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-7d3265cb-c30d-431d-a5f8-9f8ecf935980 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:42.608152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1420/2793] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:31:42 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:31:42.654332 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234b738-43d2-4c8a-a8b1-aafbed1cda04 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:42.655755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9234b738-43d2-4c8a-a8b1-aafbed1cda04 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:42.704545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3265cb-c30d-431d-a5f8-9f8ecf935980 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:42.728297 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9234b738-43d2-4c8a-a8b1-aafbed1cda04 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:42.733447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34016ed9-f074-49e4-92c5-c562faae23ec service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:42.734098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34016ed9-f074-49e4-92c5-c562faae23ec service swift] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:42.734386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34016ed9-f074-49e4-92c5-c562faae23ec service swift] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:42.734666 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34016ed9-f074-49e4-92c5-c562faae23ec service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:42.742998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34016ed9-f074-49e4-92c5-c562faae23ec service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:42.744583 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34016ed9-f074-49e4-92c5-c562faae23ec service swift] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:42.752752 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1374/2794] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:31:42 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 99 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:31:42.762055 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d3265cb-c30d-431d-a5f8-9f8ecf935980 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:42.767145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0ad5e-56a8-4e21-b735-3c0503e84694 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:42.767826 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0ad5e-56a8-4e21-b735-3c0503e84694 service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:42.768107 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0ad5e-56a8-4e21-b735-3c0503e84694 service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:42.768382 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f0ad5e-56a8-4e21-b735-3c0503e84694 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:42.770240 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-f8f0ad5e-56a8-4e21-b735-3c0503e84694 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:42.785291 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0ad5e-56a8-4e21-b735-3c0503e84694 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:42.786954 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8f0ad5e-56a8-4e21-b735-3c0503e84694 service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:42.800453 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1421/2795] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:31:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 96 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:31:43.268782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be99b-daba-482c-8313-2013867da2a8 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:43.269116 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be99b-daba-482c-8313-2013867da2a8 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:43.269404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793be99b-daba-482c-8313-2013867da2a8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:43.286628 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-793be99b-daba-482c-8313-2013867da2a8 None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:43.287826 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-793be99b-daba-482c-8313-2013867da2a8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:43.294955 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1375/2796] 10.222.0.64 () {58 vars in 967 bytes} [Thu May 26 18:31:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 27 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:31:43.307332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0ad5e-56a8-4e21-b735-3c0503e84694 service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:43.318471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8f0ad5e-56a8-4e21-b735-3c0503e84694 service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:43.324078 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57178905-c27f-47bf-9a8f-6ded8fb5edc8 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:43.324710 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57178905-c27f-47bf-9a8f-6ded8fb5edc8 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:43.325007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57178905-c27f-47bf-9a8f-6ded8fb5edc8 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:43.325300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57178905-c27f-47bf-9a8f-6ded8fb5edc8 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:43.333372 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57178905-c27f-47bf-9a8f-6ded8fb5edc8 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:43.335259 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57178905-c27f-47bf-9a8f-6ded8fb5edc8 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:43.343448 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1422/2797] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:31:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:31:43.526219 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8e58f-5a87-4689-bd04-cee1e919c074 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:43.526512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8e58f-5a87-4689-bd04-cee1e919c074 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:43.526797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4b8e58f-5a87-4689-bd04-cee1e919c074 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:43.546928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f4b8e58f-5a87-4689-bd04-cee1e919c074 None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:43.548151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f4b8e58f-5a87-4689-bd04-cee1e919c074 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:43.555974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1376/2798] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:31:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:31:43.568839 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57178905-c27f-47bf-9a8f-6ded8fb5edc8 service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:43.579479 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57178905-c27f-47bf-9a8f-6ded8fb5edc8 service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:43.584944 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65524f9e-2ef0-4ab1-a6a1-a3b11fdc4f0f service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:43.585713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65524f9e-2ef0-4ab1-a6a1-a3b11fdc4f0f service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:43.586008 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65524f9e-2ef0-4ab1-a6a1-a3b11fdc4f0f service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:43.586287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65524f9e-2ef0-4ab1-a6a1-a3b11fdc4f0f service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:43.595005 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65524f9e-2ef0-4ab1-a6a1-a3b11fdc4f0f service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:43.596602 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65524f9e-2ef0-4ab1-a6a1-a3b11fdc4f0f service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:43.605760 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1423/2799] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:31:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:31:43.942187 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe97cdb-3f91-462d-918d-ee87ca95f74d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:43.942643 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe97cdb-3f91-462d-918d-ee87ca95f74d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:43.942755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fe97cdb-3f91-462d-918d-ee87ca95f74d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:43.965098 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-6fe97cdb-3f91-462d-918d-ee87ca95f74d None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:43.966737 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-6fe97cdb-3f91-462d-918d-ee87ca95f74d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:43.976246 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1377/2800] 10.222.0.64 () {58 vars in 967 bytes} [Thu May 26 18:31:43 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:31:43.988798 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65524f9e-2ef0-4ab1-a6a1-a3b11fdc4f0f service swift] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:43.999193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65524f9e-2ef0-4ab1-a6a1-a3b11fdc4f0f service swift] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:44.004382 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a1e78a-5e3f-4ecb-bb13-f3e2ad72f68d service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:44.005036 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1e78a-5e3f-4ecb-bb13-f3e2ad72f68d service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:44.005320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1e78a-5e3f-4ecb-bb13-f3e2ad72f68d service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:44.005597 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a1e78a-5e3f-4ecb-bb13-f3e2ad72f68d service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:44.014016 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1e78a-5e3f-4ecb-bb13-f3e2ad72f68d service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:44.015663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9a1e78a-5e3f-4ecb-bb13-f3e2ad72f68d service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:44.024464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1424/2801] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:31:43 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:31:46.063975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe97cdb-3f91-462d-918d-ee87ca95f74d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:46.125216 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fe97cdb-3f91-462d-918d-ee87ca95f74d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:46.129647 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed0054-a075-4202-a4e9-00cfb84a572e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:46.130507 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed0054-a075-4202-a4e9-00cfb84a572e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:46.130787 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed0054-a075-4202-a4e9-00cfb84a572e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:46.131062 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82ed0054-a075-4202-a4e9-00cfb84a572e admin admin] PATH_INFO: `/v3/users/def480386c474f23a202c67c60ac6984` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:46.132215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed0054-a075-4202-a4e9-00cfb84a572e admin admin] RBAC: Authorizing `identity:delete_user(user_id=def480386c474f23a202c67c60ac6984)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:46.134722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82ed0054-a075-4202-a4e9-00cfb84a572e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:46.148622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=99,keystone:DELETE=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:31:46.190181 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-82ed0054-a075-4202-a4e9-00cfb84a572e admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'def480386c474f23a202c67c60ac6984'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:46.197542 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-82ed0054-a075-4202-a4e9-00cfb84a572e admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'def480386c474f23a202c67c60ac6984'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:46.198205 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-82ed0054-a075-4202-a4e9-00cfb84a572e admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'def480386c474f23a202c67c60ac6984'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:46.210573 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-82ed0054-a075-4202-a4e9-00cfb84a572e admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'def480386c474f23a202c67c60ac6984'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:46.217631 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-82ed0054-a075-4202-a4e9-00cfb84a572e admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'def480386c474f23a202c67c60ac6984'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:46.223622 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1378/2802] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:31:46 2022] DELETE /identity/v3/users/def480386c474f23a202c67c60ac6984 => generated 0 bytes in 160 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:31:46.228205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f47b88-ca12-442f-9389-00fc5d1e854e None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:46.228692 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f47b88-ca12-442f-9389-00fc5d1e854e None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:46.228793 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93f47b88-ca12-442f-9389-00fc5d1e854e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:46.246461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-93f47b88-ca12-442f-9389-00fc5d1e854e None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:46.247643 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-93f47b88-ca12-442f-9389-00fc5d1e854e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:46.305751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1425/2803] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:31:46 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:31:46.315020 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed0054-a075-4202-a4e9-00cfb84a572e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:46.316475 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-82ed0054-a075-4202-a4e9-00cfb84a572e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:46.390447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82ed0054-a075-4202-a4e9-00cfb84a572e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:46.395019 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfbaa7-7da9-454c-9677-4603039cfe88 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:46.395954 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfbaa7-7da9-454c-9677-4603039cfe88 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:46.396372 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfbaa7-7da9-454c-9677-4603039cfe88 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:46.396780 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84cfbaa7-7da9-454c-9677-4603039cfe88 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:46.407313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfbaa7-7da9-454c-9677-4603039cfe88 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:46.408735 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84cfbaa7-7da9-454c-9677-4603039cfe88 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:46.417962 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1379/2804] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:31:46 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 103 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:31:46.581713 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f47b88-ca12-442f-9389-00fc5d1e854e None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:46.583152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-93f47b88-ca12-442f-9389-00fc5d1e854e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:46.607567 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93f47b88-ca12-442f-9389-00fc5d1e854e None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:46.612336 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfb6203c-6eec-4100-b223-132f31f30853 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:46.613294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6203c-6eec-4100-b223-132f31f30853 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:46.613574 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6203c-6eec-4100-b223-132f31f30853 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:46.613844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfb6203c-6eec-4100-b223-132f31f30853 admin admin] PATH_INFO: `/v3/projects/2457c1667aa44df18c9b675529016ed8` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:46.615009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6203c-6eec-4100-b223-132f31f30853 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2457c1667aa44df18c9b675529016ed8)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:46.617564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfb6203c-6eec-4100-b223-132f31f30853 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:46.620079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=100 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:31:46.673032 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bfb6203c-6eec-4100-b223-132f31f30853 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2457c1667aa44df18c9b675529016ed8', 'request_id': 'req-bfb6203c-6eec-4100-b223-132f31f30853'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:46.682370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bfb6203c-6eec-4100-b223-132f31f30853 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2457c1667aa44df18c9b675529016ed8', 'request_id': 'req-bfb6203c-6eec-4100-b223-132f31f30853'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:46.695152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bfb6203c-6eec-4100-b223-132f31f30853 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2457c1667aa44df18c9b675529016ed8', 'request_id': 'req-bfb6203c-6eec-4100-b223-132f31f30853'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:46.708573 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bfb6203c-6eec-4100-b223-132f31f30853 admin admin] The token cache is being invalidate because project 2457c1667aa44df18c9b675529016ed8 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80231) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:31:46.708862 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bfb6203c-6eec-4100-b223-132f31f30853 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:46.710548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-bfb6203c-6eec-4100-b223-132f31f30853 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:31:46.712163 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1426/2805] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:31:46 2022] DELETE /identity/v3/projects/2457c1667aa44df18c9b675529016ed8 => generated 0 bytes in 131 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:31:48.179265 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfbaa7-7da9-454c-9677-4603039cfe88 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:31:48.188913 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84cfbaa7-7da9-454c-9677-4603039cfe88 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:31:48.244321 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e0e35-d1e0-4034-b1ad-5135b55afa56 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:31:48.244975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e0e35-d1e0-4034-b1ad-5135b55afa56 service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:48.245309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e0e35-d1e0-4034-b1ad-5135b55afa56 service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:48.245589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d4e0e35-d1e0-4034-b1ad-5135b55afa56 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:48.247424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8d4e0e35-d1e0-4034-b1ad-5135b55afa56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:48.257526 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e0e35-d1e0-4034-b1ad-5135b55afa56 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:31:48.258989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d4e0e35-d1e0-4034-b1ad-5135b55afa56 service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:31:48.267868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1380/2806] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:31:48 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:31:51.819131 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4898d2-0845-4e4e-af8c-d735a9d0ab64 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:31:51.820171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4898d2-0845-4e4e-af8c-d735a9d0ab64 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:31:51.820171 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4898d2-0845-4e4e-af8c-d735a9d0ab64 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:31:51.838782 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-6b4898d2-0845-4e4e-af8c-d735a9d0ab64 None None] MFA Rules not processed for user `555fa6f76d2d4b2b98c1322046f56bc0`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:31:51.839993 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6b4898d2-0845-4e4e-af8c-d735a9d0ab64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:31:51.895526 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1427/2807] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:31:51 2022] POST /identity/v3/auth/tokens => generated 3254 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:31:58.263777 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=73,keystone:DELETE=9,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:32:01.888234 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:32:02.370526 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e0e35-d1e0-4034-b1ad-5135b55afa56 service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:32:02.371936 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8d4e0e35-d1e0-4034-b1ad-5135b55afa56 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:32:02.382201 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d4e0e35-d1e0-4034-b1ad-5135b55afa56 service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:32:02.385829 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009bb86-d8a6-460d-aefc-68f24a709aaa service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:32:02.386468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009bb86-d8a6-460d-aefc-68f24a709aaa service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:32:02.386759 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009bb86-d8a6-460d-aefc-68f24a709aaa service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:32:02.387050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9009bb86-d8a6-460d-aefc-68f24a709aaa service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:32:02.388751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9009bb86-d8a6-460d-aefc-68f24a709aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:32:02.456164 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009bb86-d8a6-460d-aefc-68f24a709aaa service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:32:02.457633 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9009bb86-d8a6-460d-aefc-68f24a709aaa service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:32:02.467283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1381/2808] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:32:02 2022] GET /identity/v3/auth/tokens => generated 3305 bytes in 97 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:32:12.463061 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=30 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:32:40.468883 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4898d2-0845-4e4e-af8c-d735a9d0ab64 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:32:40.470259 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-6b4898d2-0845-4e4e-af8c-d735a9d0ab64 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:32:40.482433 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4898d2-0845-4e4e-af8c-d735a9d0ab64 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:32:40.485944 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b2d6b-a9a3-4ffe-8df0-58bdd2a50dbd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:32:40.486582 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b2d6b-a9a3-4ffe-8df0-58bdd2a50dbd service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:32:40.486863 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b2d6b-a9a3-4ffe-8df0-58bdd2a50dbd service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:32:40.487134 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc1b2d6b-a9a3-4ffe-8df0-58bdd2a50dbd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:32:40.488815 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-dc1b2d6b-a9a3-4ffe-8df0-58bdd2a50dbd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:32:40.498536 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b2d6b-a9a3-4ffe-8df0-58bdd2a50dbd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:32:40.499946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc1b2d6b-a9a3-4ffe-8df0-58bdd2a50dbd service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:32:40.508122 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1428/2809] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:32:40 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:32:50.504317 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:33:12.474462 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009bb86-d8a6-460d-aefc-68f24a709aaa service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:33:12.476418 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9009bb86-d8a6-460d-aefc-68f24a709aaa service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:33:12.559938 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9009bb86-d8a6-460d-aefc-68f24a709aaa service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:33:12.566113 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7772935-0dc9-452b-b79a-72d6e2a75379 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:33:12.566755 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7772935-0dc9-452b-b79a-72d6e2a75379 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:33:12.567036 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7772935-0dc9-452b-b79a-72d6e2a75379 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:33:12.567318 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7772935-0dc9-452b-b79a-72d6e2a75379 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:33:12.569102 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a7772935-0dc9-452b-b79a-72d6e2a75379 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:33:12.579304 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7772935-0dc9-452b-b79a-72d6e2a75379 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:33:12.580874 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7772935-0dc9-452b-b79a-72d6e2a75379 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:33:12.589927 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1382/2810] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:33:12 2022] GET /identity/v3/auth/tokens => generated 3254 bytes in 116 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:33:22.585887 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=34 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:33:30.403775 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b2d6b-a9a3-4ffe-8df0-58bdd2a50dbd service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:33:30.419593 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc1b2d6b-a9a3-4ffe-8df0-58bdd2a50dbd service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:33:30.426140 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f20df-5202-4b77-94e0-0d16cca4714b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:33:30.426796 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f20df-5202-4b77-94e0-0d16cca4714b service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:33:30.427079 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f20df-5202-4b77-94e0-0d16cca4714b service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:33:30.427358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed3f20df-5202-4b77-94e0-0d16cca4714b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:33:30.429217 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ed3f20df-5202-4b77-94e0-0d16cca4714b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:33:30.441418 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f20df-5202-4b77-94e0-0d16cca4714b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:33:30.442987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed3f20df-5202-4b77-94e0-0d16cca4714b service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:33:30.453587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1429/2811] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:33:30 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 50 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:33:32.410601 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a68e6b-62c6-47fb-b24e-bc94f31cc376 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:33:32.411097 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a68e6b-62c6-47fb-b24e-bc94f31cc376 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:33:32.411236 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72a68e6b-62c6-47fb-b24e-bc94f31cc376 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:33:32.428404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-72a68e6b-62c6-47fb-b24e-bc94f31cc376 None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:33:32.429712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-72a68e6b-62c6-47fb-b24e-bc94f31cc376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:33:32.485050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1383/2812] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:33:32 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 75 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:33:32.529611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f20df-5202-4b77-94e0-0d16cca4714b service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:33:32.531034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-ed3f20df-5202-4b77-94e0-0d16cca4714b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:33:32.605441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed3f20df-5202-4b77-94e0-0d16cca4714b service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:33:32.610358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22c6aec-fba2-44a7-9e8a-a3525ddd7b56 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:33:32.611009 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c6aec-fba2-44a7-9e8a-a3525ddd7b56 service swift] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:33:32.611293 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c6aec-fba2-44a7-9e8a-a3525ddd7b56 service swift] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:33:32.611570 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22c6aec-fba2-44a7-9e8a-a3525ddd7b56 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:33:32.619609 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c6aec-fba2-44a7-9e8a-a3525ddd7b56 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:33:32.621214 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22c6aec-fba2-44a7-9e8a-a3525ddd7b56 service swift] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:33:32.630508 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1430/2813] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:33:32 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 102 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:33:42.478642 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=25 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:33:42.625975 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=38 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:33:47.641512 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a68e6b-62c6-47fb-b24e-bc94f31cc376 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:33:47.642905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-72a68e6b-62c6-47fb-b24e-bc94f31cc376 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:33:47.760292 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-72a68e6b-62c6-47fb-b24e-bc94f31cc376 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:33:47.765294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57a199-b05e-436b-a808-9090186808d7 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab4efe6f79d4b3ca5618c089c5f3d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:33:47.765932 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57a199-b05e-436b-a808-9090186808d7 service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:33:47.766213 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57a199-b05e-436b-a808-9090186808d7 service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:33:47.766488 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf57a199-b05e-436b-a808-9090186808d7 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:33:47.768244 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-cf57a199-b05e-436b-a808-9090186808d7 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:33:47.780340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57a199-b05e-436b-a808-9090186808d7 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:33:47.781966 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf57a199-b05e-436b-a808-9090186808d7 service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:33:47.792545 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1384/2814] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:33:47 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 151 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:33:49.273032 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8820e-8a26-491b-9635-e38eacdbdc5d None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:33:49.273503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8820e-8a26-491b-9635-e38eacdbdc5d None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:33:49.273598 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7a8820e-8a26-491b-9635-e38eacdbdc5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:33:49.290370 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-b7a8820e-8a26-491b-9635-e38eacdbdc5d None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:33:49.291555 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b7a8820e-8a26-491b-9635-e38eacdbdc5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:33:49.305542 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1431/2815] 10.222.0.64 () {58 vars in 1009 bytes} [Thu May 26 18:33:49 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:33:49.316805 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57a199-b05e-436b-a808-9090186808d7 service placement] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:33:49.328405 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf57a199-b05e-436b-a808-9090186808d7 service placement] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:33:49.333386 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f9ce0-4abc-427c-a241-334761996d0c service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:33:49.334024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f9ce0-4abc-427c-a241-334761996d0c service swift] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:33:49.334309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f9ce0-4abc-427c-a241-334761996d0c service swift] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:33:49.334589 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef1f9ce0-4abc-427c-a241-334761996d0c service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:33:49.343445 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f9ce0-4abc-427c-a241-334761996d0c service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:33:49.345198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef1f9ce0-4abc-427c-a241-334761996d0c service swift] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:33:49.353316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1385/2816] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:33:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 37 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:33:59.299641 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=6 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:33:59.350122 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=60 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:34:06.263751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977ec85-4077-4029-804e-1906714589a9 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:34:06.264264 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977ec85-4077-4029-804e-1906714589a9 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:34:06.264374 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c977ec85-4077-4029-804e-1906714589a9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:34:06.283581 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c977ec85-4077-4029-804e-1906714589a9 None None] MFA Rules not processed for user `438d065f5ec6446c824cdc4642c4ec06`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:34:06.284811 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c977ec85-4077-4029-804e-1906714589a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:34:06.292089 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1432/2817] 10.222.0.64 () {58 vars in 967 bytes} [Thu May 26 18:34:06 2022] POST /identity/v3/auth/tokens => generated 3185 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:34:06.304271 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f9ce0-4abc-427c-a241-334761996d0c service swift] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:34:06.314565 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef1f9ce0-4abc-427c-a241-334761996d0c service swift] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:34:06.320168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bb38bed-390c-4b38-9a2c-67869e18f019 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '9cb21a6eef0e418182b2dd755096ca77', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:34:06.320920 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb38bed-390c-4b38-9a2c-67869e18f019 service swift] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:34:06.321306 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb38bed-390c-4b38-9a2c-67869e18f019 service swift] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:34:06.321649 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bb38bed-390c-4b38-9a2c-67869e18f019 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:34:06.329974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb38bed-390c-4b38-9a2c-67869e18f019 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:34:06.331570 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bb38bed-390c-4b38-9a2c-67869e18f019 service swift] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:34:06.340222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1386/2818] 10.222.0.64 () {60 vars in 1384 bytes} [Thu May 26 18:34:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) May 26 18:34:16.278357 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:34:16.336945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=6 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:34:42.346704 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6243ea-307d-413a-8d99-0baef57f2289 None None] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:34:42.347293 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6243ea-307d-413a-8d99-0baef57f2289 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:34:42.347293 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef6243ea-307d-413a-8d99-0baef57f2289 None None] PATH_INFO: `/` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:34:42.348963 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1433/2819] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 26 18:34:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) May 26 18:34:42.354932 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f407bc-e157-450f-a5e6-3e1da3113a8c None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:34:42.355410 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f407bc-e157-450f-a5e6-3e1da3113a8c None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:34:42.355519 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8f407bc-e157-450f-a5e6-3e1da3113a8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:34:42.414762 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f8f407bc-e157-450f-a5e6-3e1da3113a8c None None] MFA Rules not processed for user `1b725c28490f4f90b5eec565cd0fb603`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:34:42.415967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f8f407bc-e157-450f-a5e6-3e1da3113a8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:34:42.432299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1387/2820] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 26 18:34:42 2022] POST /identity/v3/auth/tokens => generated 3111 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:34:42.445136 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6243ea-307d-413a-8d99-0baef57f2289 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:34:42.456898 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef6243ea-307d-413a-8d99-0baef57f2289 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:34:42.460498 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7546779f-e2be-4343-8695-0ae7f9c8d591 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:34:42.461176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546779f-e2be-4343-8695-0ae7f9c8d591 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:34:42.461675 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546779f-e2be-4343-8695-0ae7f9c8d591 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:34:42.461956 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7546779f-e2be-4343-8695-0ae7f9c8d591 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:34:42.472590 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546779f-e2be-4343-8695-0ae7f9c8d591 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:34:42.474332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7546779f-e2be-4343-8695-0ae7f9c8d591 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:34:42.482248 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1434/2821] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:34:42 2022] GET /identity/v3/auth/tokens => generated 3111 bytes in 38 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:34:42.561753 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb6f8-1727-497c-ae0e-e6bc71c9cd7f None None] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:34:42.562045 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb6f8-1727-497c-ae0e-e6bc71c9cd7f None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:34:42.562850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c61eb6f8-1727-497c-ae0e-e6bc71c9cd7f None None] PATH_INFO: `/` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:34:42.564299 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1388/2822] 10.222.0.64 () {54 vars in 921 bytes} [Thu May 26 18:34:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) May 26 18:34:42.569083 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0debf8d-d0d1-4f6c-8efd-629ce08a54d7 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:34:42.569376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0debf8d-d0d1-4f6c-8efd-629ce08a54d7 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:34:42.569655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0debf8d-d0d1-4f6c-8efd-629ce08a54d7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:34:42.599524 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a0debf8d-d0d1-4f6c-8efd-629ce08a54d7 None None] MFA Rules not processed for user `97f259ac2eb4425f8b4dcffeccdcd439`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:34:42.600724 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a0debf8d-d0d1-4f6c-8efd-629ce08a54d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:34:42.619371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1435/2823] 10.222.0.64 () {58 vars in 1018 bytes} [Thu May 26 18:34:42 2022] POST /identity/v3/auth/tokens => generated 3362 bytes in 51 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:34:42.630094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb6f8-1727-497c-ae0e-e6bc71c9cd7f None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:34:42.642150 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c61eb6f8-1727-497c-ae0e-e6bc71c9cd7f None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:34:42.645621 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138f325-b9bb-48d3-b79e-651bd81019ef service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:34:42.646244 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f325-b9bb-48d3-b79e-651bd81019ef service neutron] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:34:42.646525 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f325-b9bb-48d3-b79e-651bd81019ef service neutron] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:34:42.646797 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0138f325-b9bb-48d3-b79e-651bd81019ef service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:34:42.656767 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138f325-b9bb-48d3-b79e-651bd81019ef service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:34:42.658175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0138f325-b9bb-48d3-b79e-651bd81019ef service neutron] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:34:42.668535 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1389/2824] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:34:42 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:34:52.616436 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=18 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:34:52.663993 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=28 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:34:57.963287 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0debf8d-d0d1-4f6c-8efd-629ce08a54d7 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:34:57.978521 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0debf8d-d0d1-4f6c-8efd-629ce08a54d7 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:34:57.985042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447108e2-067d-4b33-9793-181e7c4f8467 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:34:57.985879 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447108e2-067d-4b33-9793-181e7c4f8467 service nova] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:34:57.986027 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447108e2-067d-4b33-9793-181e7c4f8467 service nova] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:34:57.986252 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-447108e2-067d-4b33-9793-181e7c4f8467 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:34:57.988074 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-447108e2-067d-4b33-9793-181e7c4f8467 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:34:58.011874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447108e2-067d-4b33-9793-181e7c4f8467 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:34:58.013912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-447108e2-067d-4b33-9793-181e7c4f8467 service nova] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:34:58.027301 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1436/2825] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:34:57 2022] GET /identity/v3/auth/tokens => generated 3362 bytes in 65 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:34:58.129401 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138f325-b9bb-48d3-b79e-651bd81019ef service neutron] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:34:58.154278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0138f325-b9bb-48d3-b79e-651bd81019ef service neutron] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:34:58.159877 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19318b-6d10-417e-a9b4-61149c1bbbbc service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab4efe6f79d4b3ca5618c089c5f3d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:34:58.160698 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19318b-6d10-417e-a9b4-61149c1bbbbc service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:34:58.161699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19318b-6d10-417e-a9b4-61149c1bbbbc service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:34:58.162090 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d19318b-6d10-417e-a9b4-61149c1bbbbc service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:34:58.163991 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2d19318b-6d10-417e-a9b4-61149c1bbbbc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:34:58.194053 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19318b-6d10-417e-a9b4-61149c1bbbbc service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:34:58.195708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d19318b-6d10-417e-a9b4-61149c1bbbbc service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:34:58.207395 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1390/2826] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:34:58 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:35:02.544281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447108e2-067d-4b33-9793-181e7c4f8467 service nova] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:02.554098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-447108e2-067d-4b33-9793-181e7c4f8467 service nova] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:02.557620 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f61e0d-0615-41f0-9dd6-a2171c020aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:02.558250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f61e0d-0615-41f0-9dd6-a2171c020aec service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:02.558530 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f61e0d-0615-41f0-9dd6-a2171c020aec service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:02.558806 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60f61e0d-0615-41f0-9dd6-a2171c020aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:02.560638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-60f61e0d-0615-41f0-9dd6-a2171c020aec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:02.642314 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f61e0d-0615-41f0-9dd6-a2171c020aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:02.643734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60f61e0d-0615-41f0-9dd6-a2171c020aec service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:02.662892 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1437/2827] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:35:02 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 119 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:35:05.370503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19318b-6d10-417e-a9b4-61149c1bbbbc service placement] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:05.372565 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-2d19318b-6d10-417e-a9b4-61149c1bbbbc service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:05.385943 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d19318b-6d10-417e-a9b4-61149c1bbbbc service placement] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:05.391335 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5a580-c0c9-41ed-883e-78941a1dda19 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab4efe6f79d4b3ca5618c089c5f3d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:05.391999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5a580-c0c9-41ed-883e-78941a1dda19 service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:05.392284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5a580-c0c9-41ed-883e-78941a1dda19 service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:05.392560 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa5a580-c0c9-41ed-883e-78941a1dda19 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:05.395091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-9aa5a580-c0c9-41ed-883e-78941a1dda19 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:05.407621 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5a580-c0c9-41ed-883e-78941a1dda19 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:05.409995 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa5a580-c0c9-41ed-883e-78941a1dda19 service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:05.422447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1391/2828] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:35:05 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:35:05.438556 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f61e0d-0615-41f0-9dd6-a2171c020aec service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:05.440004 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-60f61e0d-0615-41f0-9dd6-a2171c020aec service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:05.452392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60f61e0d-0615-41f0-9dd6-a2171c020aec service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:05.457486 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5dab58e-2d6f-476d-a20e-102217757dfb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:05.458564 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab58e-2d6f-476d-a20e-102217757dfb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:05.458856 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab58e-2d6f-476d-a20e-102217757dfb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:05.459109 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5dab58e-2d6f-476d-a20e-102217757dfb admin admin] PATH_INFO: `/v3/users/555fa6f76d2d4b2b98c1322046f56bc0` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:05.460284 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dab58e-2d6f-476d-a20e-102217757dfb admin admin] RBAC: Authorizing `identity:delete_user(user_id=555fa6f76d2d4b2b98c1322046f56bc0)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:05.463187 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5dab58e-2d6f-476d-a20e-102217757dfb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:05.510711 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d5dab58e-2d6f-476d-a20e-102217757dfb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '555fa6f76d2d4b2b98c1322046f56bc0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:05.511372 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d5dab58e-2d6f-476d-a20e-102217757dfb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '555fa6f76d2d4b2b98c1322046f56bc0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:05.519046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d5dab58e-2d6f-476d-a20e-102217757dfb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '555fa6f76d2d4b2b98c1322046f56bc0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:05.519706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d5dab58e-2d6f-476d-a20e-102217757dfb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '555fa6f76d2d4b2b98c1322046f56bc0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:05.531290 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-d5dab58e-2d6f-476d-a20e-102217757dfb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '555fa6f76d2d4b2b98c1322046f56bc0'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:05.544697 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1438/2829] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:35:05 2022] DELETE /identity/v3/users/555fa6f76d2d4b2b98c1322046f56bc0 => generated 0 bytes in 107 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:05.715730 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5a580-c0c9-41ed-883e-78941a1dda19 service placement] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:05.726945 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa5a580-c0c9-41ed-883e-78941a1dda19 service placement] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:05.783633 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aafd514b-bd20-4154-844d-6d91a368dee5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:05.784517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd514b-bd20-4154-844d-6d91a368dee5 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:05.784802 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd514b-bd20-4154-844d-6d91a368dee5 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:05.785109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aafd514b-bd20-4154-844d-6d91a368dee5 admin admin] PATH_INFO: `/v3/projects/80d75b673c6547b1876cc7820d24c05a` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:05.786274 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd514b-bd20-4154-844d-6d91a368dee5 admin admin] RBAC: Authorizing `identity:delete_project(project_id=80d75b673c6547b1876cc7820d24c05a)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:05.788179 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aafd514b-bd20-4154-844d-6d91a368dee5 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:05.832551 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-aafd514b-bd20-4154-844d-6d91a368dee5 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '80d75b673c6547b1876cc7820d24c05a', 'request_id': 'req-aafd514b-bd20-4154-844d-6d91a368dee5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:05.841381 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-aafd514b-bd20-4154-844d-6d91a368dee5 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '80d75b673c6547b1876cc7820d24c05a', 'request_id': 'req-aafd514b-bd20-4154-844d-6d91a368dee5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:05.846951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-aafd514b-bd20-4154-844d-6d91a368dee5 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '80d75b673c6547b1876cc7820d24c05a', 'request_id': 'req-aafd514b-bd20-4154-844d-6d91a368dee5'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:05.859313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-aafd514b-bd20-4154-844d-6d91a368dee5 admin admin] The token cache is being invalidate because project 80d75b673c6547b1876cc7820d24c05a was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:35:05.859603 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-aafd514b-bd20-4154-844d-6d91a368dee5 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:05.860265 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-aafd514b-bd20-4154-844d-6d91a368dee5 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:05.862235 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1392/2830] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:35:05 2022] DELETE /identity/v3/projects/80d75b673c6547b1876cc7820d24c05a => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:05.867045 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1efc4-4de5-43fe-96a5-3ab576bfb883 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:05.867344 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1efc4-4de5-43fe-96a5-3ab576bfb883 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:05.867630 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd1efc4-4de5-43fe-96a5-3ab576bfb883 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:05.908823 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:05.919888 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-edd1efc4-4de5-43fe-96a5-3ab576bfb883 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:05.921497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-edd1efc4-4de5-43fe-96a5-3ab576bfb883 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:05.983102 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1439/2831] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:05.991132 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d72801-26fa-4cb5-9d28-73a855aca174 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:05.991424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d72801-26fa-4cb5-9d28-73a855aca174 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:05.991701 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04d72801-26fa-4cb5-9d28-73a855aca174 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:06.010482 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-04d72801-26fa-4cb5-9d28-73a855aca174 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:06.011670 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-04d72801-26fa-4cb5-9d28-73a855aca174 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:06.019370 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1393/2832] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:05 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:06.023552 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1efc4-4de5-43fe-96a5-3ab576bfb883 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:06.033062 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd1efc4-4de5-43fe-96a5-3ab576bfb883 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:06.037548 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6f063-a483-4e8a-b735-f3db74aaef01 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:06.038197 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6f063-a483-4e8a-b735-f3db74aaef01 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:06.038481 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6f063-a483-4e8a-b735-f3db74aaef01 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:06.038758 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b6f063-a483-4e8a-b735-f3db74aaef01 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:06.039477 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6f063-a483-4e8a-b735-f3db74aaef01 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:35:06.039785 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6f063-a483-4e8a-b735-f3db74aaef01 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:06.041432 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b6f063-a483-4e8a-b735-f3db74aaef01 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:06.053263 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1440/2833] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:35:06 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:35:06.057428 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d72801-26fa-4cb5-9d28-73a855aca174 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:06.067279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04d72801-26fa-4cb5-9d28-73a855aca174 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:06.071928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b45792-0973-40a0-90d3-c642be8eb644 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:06.072603 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b45792-0973-40a0-90d3-c642be8eb644 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:06.072890 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b45792-0973-40a0-90d3-c642be8eb644 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:06.073193 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7b45792-0973-40a0-90d3-c642be8eb644 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:06.073883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b45792-0973-40a0-90d3-c642be8eb644 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:06.075905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7b45792-0973-40a0-90d3-c642be8eb644 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:06.100699 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1394/2834] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:35:06 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:35:06.104974 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6f063-a483-4e8a-b735-f3db74aaef01 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:06.115198 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b6f063-a483-4e8a-b735-f3db74aaef01 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:06.171277 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d326804-be0c-4209-bb90-fabb88d0c036 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:06.171950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d326804-be0c-4209-bb90-fabb88d0c036 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:06.172237 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d326804-be0c-4209-bb90-fabb88d0c036 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:06.172517 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d326804-be0c-4209-bb90-fabb88d0c036 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:06.173274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d326804-be0c-4209-bb90-fabb88d0c036 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:06.175250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d326804-be0c-4209-bb90-fabb88d0c036 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:06.197365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1441/2835] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:35:06 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:35:06.199705 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b45792-0973-40a0-90d3-c642be8eb644 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:06.210342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7b45792-0973-40a0-90d3-c642be8eb644 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:06.214930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e891b-2aaf-4012-91f6-ca9bec30daa0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:06.215566 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e891b-2aaf-4012-91f6-ca9bec30daa0 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:06.215853 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e891b-2aaf-4012-91f6-ca9bec30daa0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:06.216131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d96e891b-2aaf-4012-91f6-ca9bec30daa0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:06.216898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e891b-2aaf-4012-91f6-ca9bec30daa0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:06.218484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d96e891b-2aaf-4012-91f6-ca9bec30daa0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:06.229503 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1395/2836] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:35:06.233351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d326804-be0c-4209-bb90-fabb88d0c036 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:06.243013 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d326804-be0c-4209-bb90-fabb88d0c036 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:06.247513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-beebb0bc-361c-4725-9da0-32581ac38c6c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:06.248195 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb0bc-361c-4725-9da0-32581ac38c6c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:06.248440 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb0bc-361c-4725-9da0-32581ac38c6c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:06.248709 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-beebb0bc-361c-4725-9da0-32581ac38c6c admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:06.249461 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebb0bc-361c-4725-9da0-32581ac38c6c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:06.251155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-beebb0bc-361c-4725-9da0-32581ac38c6c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:06.261352 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1442/2837] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:35:06 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:35:06.265303 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e891b-2aaf-4012-91f6-ca9bec30daa0 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:06.272024 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:DELETE=7,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:06.275865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d96e891b-2aaf-4012-91f6-ca9bec30daa0 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:06.281868 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21801b-31d6-4f34-a5cb-cc69e3986429 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:06.282905 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21801b-31d6-4f34-a5cb-cc69e3986429 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:06.283367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21801b-31d6-4f34-a5cb-cc69e3986429 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:06.284393 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c21801b-31d6-4f34-a5cb-cc69e3986429 admin admin] PATH_INFO: `/v3/projects/cb26f1ec68814e7c8f55d39b804264a5/users/34727874bf2549ec9fa9351380b7f886/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:06.298557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21801b-31d6-4f34-a5cb-cc69e3986429 admin admin] RBAC: Authorizing `identity:create_grant(project_id=cb26f1ec68814e7c8f55d39b804264a5, user_id=34727874bf2549ec9fa9351380b7f886, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:06.301220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c21801b-31d6-4f34-a5cb-cc69e3986429 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:06.313661 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1396/2838] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:35:06 2022] PUT /identity/v3/projects/cb26f1ec68814e7c8f55d39b804264a5/users/34727874bf2549ec9fa9351380b7f886/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 49 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:06.325244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40eb8a-54e8-4c73-99c5-12acbd61a1ea None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:06.325532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40eb8a-54e8-4c73-99c5-12acbd61a1ea None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:06.325812 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d40eb8a-54e8-4c73-99c5-12acbd61a1ea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:06.352648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5d40eb8a-54e8-4c73-99c5-12acbd61a1ea None None] MFA Rules not processed for user `34727874bf2549ec9fa9351380b7f886`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:06.353866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5d40eb8a-54e8-4c73-99c5-12acbd61a1ea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:06.411372 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:06.418024 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1443/2839] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:06 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 94 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:06.428368 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21801b-31d6-4f34-a5cb-cc69e3986429 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:06.430129 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-8c21801b-31d6-4f34-a5cb-cc69e3986429 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:06.503100 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c21801b-31d6-4f34-a5cb-cc69e3986429 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:06.508545 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed401d87-2421-497b-ae3f-88a32cf2e208 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:06.509220 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed401d87-2421-497b-ae3f-88a32cf2e208 service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:06.509502 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed401d87-2421-497b-ae3f-88a32cf2e208 service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:06.509780 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed401d87-2421-497b-ae3f-88a32cf2e208 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:06.517427 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed401d87-2421-497b-ae3f-88a32cf2e208 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:06.519650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed401d87-2421-497b-ae3f-88a32cf2e208 service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:06.528471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1397/2840] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:35:06 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 101 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:35:09.166497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40eb8a-54e8-4c73-99c5-12acbd61a1ea None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:09.225656 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d40eb8a-54e8-4c73-99c5-12acbd61a1ea None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:09.230348 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88835fa-00f6-4e74-a888-39df48c6ad5c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:09.231205 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88835fa-00f6-4e74-a888-39df48c6ad5c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:09.231484 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88835fa-00f6-4e74-a888-39df48c6ad5c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:09.231753 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a88835fa-00f6-4e74-a888-39df48c6ad5c admin admin] PATH_INFO: `/v3/users/34727874bf2549ec9fa9351380b7f886` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:09.232907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88835fa-00f6-4e74-a888-39df48c6ad5c admin admin] RBAC: Authorizing `identity:delete_user(user_id=34727874bf2549ec9fa9351380b7f886)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:09.234893 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a88835fa-00f6-4e74-a888-39df48c6ad5c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:09.279459 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a88835fa-00f6-4e74-a888-39df48c6ad5c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '34727874bf2549ec9fa9351380b7f886'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:09.280095 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a88835fa-00f6-4e74-a888-39df48c6ad5c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '34727874bf2549ec9fa9351380b7f886'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:09.286904 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a88835fa-00f6-4e74-a888-39df48c6ad5c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '34727874bf2549ec9fa9351380b7f886'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:09.287514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a88835fa-00f6-4e74-a888-39df48c6ad5c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '34727874bf2549ec9fa9351380b7f886'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:09.298920 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-a88835fa-00f6-4e74-a888-39df48c6ad5c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '34727874bf2549ec9fa9351380b7f886'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:09.310942 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1444/2841] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:35:09 2022] DELETE /identity/v3/users/34727874bf2549ec9fa9351380b7f886 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:09.315530 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a303c9-2899-4a9a-abbb-8c879b6a3fab None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:09.316564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a303c9-2899-4a9a-abbb-8c879b6a3fab None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:09.316564 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a303c9-2899-4a9a-abbb-8c879b6a3fab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:09.333500 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-f7a303c9-2899-4a9a-abbb-8c879b6a3fab None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:09.334682 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f7a303c9-2899-4a9a-abbb-8c879b6a3fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:09.393867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1398/2842] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:09.403269 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88835fa-00f6-4e74-a888-39df48c6ad5c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:09.404680 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a88835fa-00f6-4e74-a888-39df48c6ad5c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:09.460319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a88835fa-00f6-4e74-a888-39df48c6ad5c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:09.463870 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1e3ed3c-6c3d-4def-a46f-1b88b0180c2a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:09.464497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3ed3c-6c3d-4def-a46f-1b88b0180c2a service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:09.464777 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3ed3c-6c3d-4def-a46f-1b88b0180c2a service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:09.465082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1e3ed3c-6c3d-4def-a46f-1b88b0180c2a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:09.474933 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3ed3c-6c3d-4def-a46f-1b88b0180c2a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:09.476365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1e3ed3c-6c3d-4def-a46f-1b88b0180c2a service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:09.486121 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1445/2843] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:35:09 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:35:09.749732 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a303c9-2899-4a9a-abbb-8c879b6a3fab None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:09.751284 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f7a303c9-2899-4a9a-abbb-8c879b6a3fab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:09.763998 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a303c9-2899-4a9a-abbb-8c879b6a3fab None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:09.769286 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:09.770424 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:09.770708 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:09.771007 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa admin admin] PATH_INFO: `/v3/projects/cb26f1ec68814e7c8f55d39b804264a5` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:09.772254 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa admin admin] RBAC: Authorizing `identity:delete_project(project_id=cb26f1ec68814e7c8f55d39b804264a5)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:09.774120 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:09.821226 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'cb26f1ec68814e7c8f55d39b804264a5', 'request_id': 'req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:09.828448 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'cb26f1ec68814e7c8f55d39b804264a5', 'request_id': 'req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:09.832353 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:INSERT=2,keystone:DELETE=6 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:09.834860 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'cb26f1ec68814e7c8f55d39b804264a5', 'request_id': 'req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:09.847787 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa admin admin] The token cache is being invalidate because project cb26f1ec68814e7c8f55d39b804264a5 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:35:09.848094 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:09.848722 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-9a3e3c77-62e4-4a52-9c8b-a3d99099befa admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:09.850266 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1399/2844] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:35:09 2022] DELETE /identity/v3/projects/cb26f1ec68814e7c8f55d39b804264a5 => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:09.855514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085e7c1-cb73-4365-af36-f8471ffef3ad None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:09.855751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085e7c1-cb73-4365-af36-f8471ffef3ad None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:09.856062 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c085e7c1-cb73-4365-af36-f8471ffef3ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:09.875573 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c085e7c1-cb73-4365-af36-f8471ffef3ad None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:09.876814 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c085e7c1-cb73-4365-af36-f8471ffef3ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:09.889588 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:09.939513 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1446/2845] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:09.947058 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127052dd-a179-4320-b36c-76124f0c7939 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:09.947345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127052dd-a179-4320-b36c-76124f0c7939 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:09.947619 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-127052dd-a179-4320-b36c-76124f0c7939 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:09.965222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-127052dd-a179-4320-b36c-76124f0c7939 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:09.966406 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-127052dd-a179-4320-b36c-76124f0c7939 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:09.974500 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1400/2846] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:09 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:09.978700 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085e7c1-cb73-4365-af36-f8471ffef3ad None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:09.988636 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c085e7c1-cb73-4365-af36-f8471ffef3ad None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:09.993153 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac2bc8-4d9e-465c-bbd6-6a90e0a2004c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:09.993818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac2bc8-4d9e-465c-bbd6-6a90e0a2004c admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:09.994098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac2bc8-4d9e-465c-bbd6-6a90e0a2004c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:09.994371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6fac2bc8-4d9e-465c-bbd6-6a90e0a2004c admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:09.995082 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac2bc8-4d9e-465c-bbd6-6a90e0a2004c admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:35:09.995387 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac2bc8-4d9e-465c-bbd6-6a90e0a2004c admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:09.996967 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6fac2bc8-4d9e-465c-bbd6-6a90e0a2004c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:10.008347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1447/2847] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:35:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:35:10.012552 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127052dd-a179-4320-b36c-76124f0c7939 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:10.021876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-127052dd-a179-4320-b36c-76124f0c7939 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:10.026530 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18964ad5-5e89-4fe0-baa5-07c824016a7d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:10.027175 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964ad5-5e89-4fe0-baa5-07c824016a7d admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:10.027463 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964ad5-5e89-4fe0-baa5-07c824016a7d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:10.027745 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18964ad5-5e89-4fe0-baa5-07c824016a7d admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:10.028431 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18964ad5-5e89-4fe0-baa5-07c824016a7d admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:10.030376 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18964ad5-5e89-4fe0-baa5-07c824016a7d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:10.056092 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1401/2848] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:35:10 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:35:10.060193 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac2bc8-4d9e-465c-bbd6-6a90e0a2004c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:10.070354 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6fac2bc8-4d9e-465c-bbd6-6a90e0a2004c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:10.126415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611d2c2-470c-4f6a-a382-1e6173628617 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:10.127071 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611d2c2-470c-4f6a-a382-1e6173628617 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:10.127351 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611d2c2-470c-4f6a-a382-1e6173628617 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:10.127627 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7611d2c2-470c-4f6a-a382-1e6173628617 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:10.128312 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611d2c2-470c-4f6a-a382-1e6173628617 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:10.130281 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7611d2c2-470c-4f6a-a382-1e6173628617 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:10.150772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1448/2849] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:35:10 2022] POST /identity/v3/users => generated 287 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:35:10.155214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18964ad5-5e89-4fe0-baa5-07c824016a7d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:10.165792 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18964ad5-5e89-4fe0-baa5-07c824016a7d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:10.170319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e11d7-e9b1-4229-aa8c-31926399ec27 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:10.170965 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e11d7-e9b1-4229-aa8c-31926399ec27 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:10.171244 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e11d7-e9b1-4229-aa8c-31926399ec27 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:10.171518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b19e11d7-e9b1-4229-aa8c-31926399ec27 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:10.172236 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e11d7-e9b1-4229-aa8c-31926399ec27 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:10.173865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b19e11d7-e9b1-4229-aa8c-31926399ec27 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:10.184151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1402/2850] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:35:10.188349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611d2c2-470c-4f6a-a382-1e6173628617 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:10.198183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7611d2c2-470c-4f6a-a382-1e6173628617 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:10.202655 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc86387-ec39-44e4-9977-aaa6fca94cb1 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:10.203300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc86387-ec39-44e4-9977-aaa6fca94cb1 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:10.203583 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc86387-ec39-44e4-9977-aaa6fca94cb1 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:10.203859 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc86387-ec39-44e4-9977-aaa6fca94cb1 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:10.204572 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc86387-ec39-44e4-9977-aaa6fca94cb1 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:10.206176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc86387-ec39-44e4-9977-aaa6fca94cb1 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:10.216885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1449/2851] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:35:10 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:35:10.220554 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e11d7-e9b1-4229-aa8c-31926399ec27 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:10.231297 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b19e11d7-e9b1-4229-aa8c-31926399ec27 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:10.235859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a093df-4df1-4ef4-8723-5ae954420d43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:10.236724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a093df-4df1-4ef4-8723-5ae954420d43 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:10.237039 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a093df-4df1-4ef4-8723-5ae954420d43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:10.237322 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a093df-4df1-4ef4-8723-5ae954420d43 admin admin] PATH_INFO: `/v3/projects/3c74ef95dbca4c8094926ffd82841c2f/users/38509a494e9341cab9bfd9c1263e3088/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:10.252383 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a093df-4df1-4ef4-8723-5ae954420d43 admin admin] RBAC: Authorizing `identity:create_grant(project_id=3c74ef95dbca4c8094926ffd82841c2f, user_id=38509a494e9341cab9bfd9c1263e3088, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:10.255059 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a093df-4df1-4ef4-8723-5ae954420d43 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:10.268265 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1403/2852] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:35:10 2022] PUT /identity/v3/projects/3c74ef95dbca4c8094926ffd82841c2f/users/38509a494e9341cab9bfd9c1263e3088/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:10.278874 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf456f7-c036-4c28-91a0-54b1437db299 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:10.279167 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf456f7-c036-4c28-91a0-54b1437db299 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:10.279450 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cf456f7-c036-4c28-91a0-54b1437db299 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:10.306077 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5cf456f7-c036-4c28-91a0-54b1437db299 None None] MFA Rules not processed for user `38509a494e9341cab9bfd9c1263e3088`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:10.307350 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5cf456f7-c036-4c28-91a0-54b1437db299 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:10.371471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1450/2853] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:10 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:10.382518 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a093df-4df1-4ef4-8723-5ae954420d43 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:10.384176 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-d8a093df-4df1-4ef4-8723-5ae954420d43 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:10.455510 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a093df-4df1-4ef4-8723-5ae954420d43 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:10.462050 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5bf6bf-5a80-4742-88be-f3dab8627a8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '97f259ac2eb4425f8b4dcffeccdcd439', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service', 'admin', 'member', 'reader', 'ResellerAdmin'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:10.462685 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bf6bf-5a80-4742-88be-f3dab8627a8c service nova] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:10.462989 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bf6bf-5a80-4742-88be-f3dab8627a8c service nova] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:10.463265 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5bf6bf-5a80-4742-88be-f3dab8627a8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:10.471003 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bf6bf-5a80-4742-88be-f3dab8627a8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:10.473214 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5bf6bf-5a80-4742-88be-f3dab8627a8c service nova] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:10.482085 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1404/2854] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:35:10 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 100 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:35:10.673316 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf456f7-c036-4c28-91a0-54b1437db299 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:10.690044 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:10.736503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cf456f7-c036-4c28-91a0-54b1437db299 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:10.740877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eccb2b-c7d6-4e46-99a3-b700b22f0f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:10.741771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eccb2b-c7d6-4e46-99a3-b700b22f0f60 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:10.742051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eccb2b-c7d6-4e46-99a3-b700b22f0f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:10.742324 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68eccb2b-c7d6-4e46-99a3-b700b22f0f60 admin admin] PATH_INFO: `/v3/users/38509a494e9341cab9bfd9c1263e3088` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:10.743483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eccb2b-c7d6-4e46-99a3-b700b22f0f60 admin admin] RBAC: Authorizing `identity:delete_user(user_id=38509a494e9341cab9bfd9c1263e3088)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:10.745438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68eccb2b-c7d6-4e46-99a3-b700b22f0f60 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:10.791032 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-68eccb2b-c7d6-4e46-99a3-b700b22f0f60 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '38509a494e9341cab9bfd9c1263e3088'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:10.791683 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-68eccb2b-c7d6-4e46-99a3-b700b22f0f60 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '38509a494e9341cab9bfd9c1263e3088'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:10.798701 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-68eccb2b-c7d6-4e46-99a3-b700b22f0f60 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '38509a494e9341cab9bfd9c1263e3088'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:10.799347 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-68eccb2b-c7d6-4e46-99a3-b700b22f0f60 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '38509a494e9341cab9bfd9c1263e3088'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:10.810873 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-68eccb2b-c7d6-4e46-99a3-b700b22f0f60 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '38509a494e9341cab9bfd9c1263e3088'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:10.823042 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1451/2855] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:35:10 2022] DELETE /identity/v3/users/38509a494e9341cab9bfd9c1263e3088 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:10.827683 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da50dc-e788-44be-8f00-7ab2e8f0b7a5 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:10.827975 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da50dc-e788-44be-8f00-7ab2e8f0b7a5 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:10.828257 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0da50dc-e788-44be-8f00-7ab2e8f0b7a5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:10.845336 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-a0da50dc-e788-44be-8f00-7ab2e8f0b7a5 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:10.846526 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a0da50dc-e788-44be-8f00-7ab2e8f0b7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:10.904298 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1405/2856] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:10 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 78 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:10.914266 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eccb2b-c7d6-4e46-99a3-b700b22f0f60 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:10.915662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-68eccb2b-c7d6-4e46-99a3-b700b22f0f60 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:10.972029 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68eccb2b-c7d6-4e46-99a3-b700b22f0f60 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:10.975642 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02833802-cb9f-4e2f-99e2-6526b20d7578 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:10.976267 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02833802-cb9f-4e2f-99e2-6526b20d7578 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:10.976545 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02833802-cb9f-4e2f-99e2-6526b20d7578 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:10.976818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02833802-cb9f-4e2f-99e2-6526b20d7578 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:10.985959 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02833802-cb9f-4e2f-99e2-6526b20d7578 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:10.987403 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02833802-cb9f-4e2f-99e2-6526b20d7578 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:10.997259 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1452/2857] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:35:10 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 83 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) May 26 18:35:11.255294 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da50dc-e788-44be-8f00-7ab2e8f0b7a5 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:11.256718 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-a0da50dc-e788-44be-8f00-7ab2e8f0b7a5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:11.269575 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0da50dc-e788-44be-8f00-7ab2e8f0b7a5 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:11.274313 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55946fe3-2290-42dc-897d-0310accb2320 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:11.275859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55946fe3-2290-42dc-897d-0310accb2320 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:11.276155 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55946fe3-2290-42dc-897d-0310accb2320 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:11.276579 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55946fe3-2290-42dc-897d-0310accb2320 admin admin] PATH_INFO: `/v3/projects/3c74ef95dbca4c8094926ffd82841c2f` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:11.277835 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55946fe3-2290-42dc-897d-0310accb2320 admin admin] RBAC: Authorizing `identity:delete_project(project_id=3c74ef95dbca4c8094926ffd82841c2f)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:11.279809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55946fe3-2290-42dc-897d-0310accb2320 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:11.287056 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=1,keystone:SELECT=97,keystone:INSERT=2 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:11.327834 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-55946fe3-2290-42dc-897d-0310accb2320 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '3c74ef95dbca4c8094926ffd82841c2f', 'request_id': 'req-55946fe3-2290-42dc-897d-0310accb2320'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:11.334796 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-55946fe3-2290-42dc-897d-0310accb2320 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '3c74ef95dbca4c8094926ffd82841c2f', 'request_id': 'req-55946fe3-2290-42dc-897d-0310accb2320'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:11.340865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-55946fe3-2290-42dc-897d-0310accb2320 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '3c74ef95dbca4c8094926ffd82841c2f', 'request_id': 'req-55946fe3-2290-42dc-897d-0310accb2320'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:11.352967 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-55946fe3-2290-42dc-897d-0310accb2320 admin admin] The token cache is being invalidate because project 3c74ef95dbca4c8094926ffd82841c2f was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:35:11.353281 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-55946fe3-2290-42dc-897d-0310accb2320 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:11.353999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-55946fe3-2290-42dc-897d-0310accb2320 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:11.355574 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1406/2858] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:35:11 2022] DELETE /identity/v3/projects/3c74ef95dbca4c8094926ffd82841c2f => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:11.360706 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc36bd-f4d0-4049-a62a-c0448fe6bb1f None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:11.361226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc36bd-f4d0-4049-a62a-c0448fe6bb1f None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:11.361354 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bc36bd-f4d0-4049-a62a-c0448fe6bb1f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:11.379035 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-c7bc36bd-f4d0-4049-a62a-c0448fe6bb1f None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:11.380228 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-c7bc36bd-f4d0-4049-a62a-c0448fe6bb1f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:11.411834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:11.440441 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1453/2859] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 81 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:11.449484 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fdcde-4075-4a4f-8208-0d7765211335 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:11.449954 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fdcde-4075-4a4f-8208-0d7765211335 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:11.450072 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284fdcde-4075-4a4f-8208-0d7765211335 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:11.467412 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-284fdcde-4075-4a4f-8208-0d7765211335 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:11.468606 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-284fdcde-4075-4a4f-8208-0d7765211335 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:11.477207 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1407/2860] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:11 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 29 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:11.481208 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc36bd-f4d0-4049-a62a-c0448fe6bb1f None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:11.491641 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bc36bd-f4d0-4049-a62a-c0448fe6bb1f None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:11.496187 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ea665-062b-4e09-a52e-b7f4a6a1a42e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:11.496837 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ea665-062b-4e09-a52e-b7f4a6a1a42e admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:11.497156 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ea665-062b-4e09-a52e-b7f4a6a1a42e admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:11.497434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b37ea665-062b-4e09-a52e-b7f4a6a1a42e admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:11.498209 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ea665-062b-4e09-a52e-b7f4a6a1a42e admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:35:11.498471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ea665-062b-4e09-a52e-b7f4a6a1a42e admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:11.500075 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b37ea665-062b-4e09-a52e-b7f4a6a1a42e admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:11.511624 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1454/2861] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:35:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:35:11.515684 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fdcde-4075-4a4f-8208-0d7765211335 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:11.524665 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284fdcde-4075-4a4f-8208-0d7765211335 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:11.529228 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99f2f2-3aca-48b3-80d2-e771ccce7664 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:11.529867 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99f2f2-3aca-48b3-80d2-e771ccce7664 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:11.530152 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99f2f2-3aca-48b3-80d2-e771ccce7664 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:11.530429 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a99f2f2-3aca-48b3-80d2-e771ccce7664 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:11.531118 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99f2f2-3aca-48b3-80d2-e771ccce7664 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:11.533033 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a99f2f2-3aca-48b3-80d2-e771ccce7664 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:11.559168 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1408/2862] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:35:11 2022] POST /identity/v3/projects => generated 373 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:35:11.563199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ea665-062b-4e09-a52e-b7f4a6a1a42e admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:11.573163 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b37ea665-062b-4e09-a52e-b7f4a6a1a42e admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:11.628496 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e33d47-c50a-437a-b7c0-192f38ee1f61 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:11.629183 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e33d47-c50a-437a-b7c0-192f38ee1f61 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:11.629470 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e33d47-c50a-437a-b7c0-192f38ee1f61 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:11.629750 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59e33d47-c50a-437a-b7c0-192f38ee1f61 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:11.630427 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e33d47-c50a-437a-b7c0-192f38ee1f61 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:11.632358 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-59e33d47-c50a-437a-b7c0-192f38ee1f61 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:11.652530 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1455/2863] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:35:11 2022] POST /identity/v3/users => generated 287 bytes in 90 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:35:11.656812 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99f2f2-3aca-48b3-80d2-e771ccce7664 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:11.667689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a99f2f2-3aca-48b3-80d2-e771ccce7664 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:11.672350 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8885658-cdbf-4a8d-9bd3-1ba6ec93d94e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:11.673060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8885658-cdbf-4a8d-9bd3-1ba6ec93d94e admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:11.673352 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8885658-cdbf-4a8d-9bd3-1ba6ec93d94e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:11.673650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8885658-cdbf-4a8d-9bd3-1ba6ec93d94e admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:11.674371 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8885658-cdbf-4a8d-9bd3-1ba6ec93d94e admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:11.675971 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8885658-cdbf-4a8d-9bd3-1ba6ec93d94e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:11.685686 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1409/2864] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) May 26 18:35:11.689458 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e33d47-c50a-437a-b7c0-192f38ee1f61 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:11.699150 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59e33d47-c50a-437a-b7c0-192f38ee1f61 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:11.703695 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc299cff-bb64-49e9-959c-90e576d435a9 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:11.704340 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc299cff-bb64-49e9-959c-90e576d435a9 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:11.704626 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc299cff-bb64-49e9-959c-90e576d435a9 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:11.704905 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc299cff-bb64-49e9-959c-90e576d435a9 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:11.705663 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc299cff-bb64-49e9-959c-90e576d435a9 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:11.707772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc299cff-bb64-49e9-959c-90e576d435a9 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:11.717522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1456/2865] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:35:11 2022] GET /identity/v3/roles => generated 1420 bytes in 28 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:35:11.721369 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8885658-cdbf-4a8d-9bd3-1ba6ec93d94e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:11.731806 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8885658-cdbf-4a8d-9bd3-1ba6ec93d94e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:11.736279 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219476f-708d-4f00-a5a0-cd4fac2adf1f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:11.737180 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219476f-708d-4f00-a5a0-cd4fac2adf1f admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:11.737460 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219476f-708d-4f00-a5a0-cd4fac2adf1f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:11.737734 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c219476f-708d-4f00-a5a0-cd4fac2adf1f admin admin] PATH_INFO: `/v3/projects/33bddc4bccd646f19a46c490038a090e/users/2772476e10b949ae97fbef80115ab8d7/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:11.752315 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219476f-708d-4f00-a5a0-cd4fac2adf1f admin admin] RBAC: Authorizing `identity:create_grant(project_id=33bddc4bccd646f19a46c490038a090e, user_id=2772476e10b949ae97fbef80115ab8d7, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:11.755545 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c219476f-708d-4f00-a5a0-cd4fac2adf1f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:11.767953 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1410/2866] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:35:11 2022] PUT /identity/v3/projects/33bddc4bccd646f19a46c490038a090e/users/2772476e10b949ae97fbef80115ab8d7/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:11.777879 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edff3b-f4e1-4202-92dc-1d358962df4c None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:11.778175 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edff3b-f4e1-4202-92dc-1d358962df4c None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:11.778460 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6edff3b-f4e1-4202-92dc-1d358962df4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:11.804737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-a6edff3b-f4e1-4202-92dc-1d358962df4c None None] MFA Rules not processed for user `2772476e10b949ae97fbef80115ab8d7`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:11.805986 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-a6edff3b-f4e1-4202-92dc-1d358962df4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:11.869135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1457/2867] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:11 2022] POST /identity/v3/auth/tokens => generated 3240 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:11.873538 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219476f-708d-4f00-a5a0-cd4fac2adf1f admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:11.932952 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c219476f-708d-4f00-a5a0-cd4fac2adf1f admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:11.937530 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf1fcb-ddf1-4f52-a1c9-5af1f9b5d7a4 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:11.938177 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf1fcb-ddf1-4f52-a1c9-5af1f9b5d7a4 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:11.938457 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf1fcb-ddf1-4f52-a1c9-5af1f9b5d7a4 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:11.938729 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7bf1fcb-ddf1-4f52-a1c9-5af1f9b5d7a4 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:11.939404 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf1fcb-ddf1-4f52-a1c9-5af1f9b5d7a4 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:11.941345 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7bf1fcb-ddf1-4f52-a1c9-5af1f9b5d7a4 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:11.965788 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1411/2868] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:35:11 2022] POST /identity/v3/projects => generated 375 bytes in 93 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:35:11.969792 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edff3b-f4e1-4202-92dc-1d358962df4c None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:11.980834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6edff3b-f4e1-4202-92dc-1d358962df4c None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:12.010174 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:12.036921 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ba2e3-a973-42b7-9109-09054ecf4a43 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:12.037611 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ba2e3-a973-42b7-9109-09054ecf4a43 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:12.037899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ba2e3-a973-42b7-9109-09054ecf4a43 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:12.038177 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-403ba2e3-a973-42b7-9109-09054ecf4a43 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:12.038857 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ba2e3-a973-42b7-9109-09054ecf4a43 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:12.040755 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-403ba2e3-a973-42b7-9109-09054ecf4a43 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:12.060907 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1458/2869] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:35:11 2022] POST /identity/v3/users => generated 294 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:35:12.064786 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf1fcb-ddf1-4f52-a1c9-5af1f9b5d7a4 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:12.075225 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7bf1fcb-ddf1-4f52-a1c9-5af1f9b5d7a4 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:12.080086 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9ba5b-e66d-4b5d-9a11-95a5abf9ca3d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:12.080780 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9ba5b-e66d-4b5d-9a11-95a5abf9ca3d admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:12.081215 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9ba5b-e66d-4b5d-9a11-95a5abf9ca3d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:12.081498 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7c9ba5b-e66d-4b5d-9a11-95a5abf9ca3d admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:12.082222 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9ba5b-e66d-4b5d-9a11-95a5abf9ca3d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:12.084374 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7c9ba5b-e66d-4b5d-9a11-95a5abf9ca3d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:12.095029 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1412/2870] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:35:12.099155 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ba2e3-a973-42b7-9109-09054ecf4a43 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:12.109135 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-403ba2e3-a973-42b7-9109-09054ecf4a43 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:12.113721 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa78bf-3a2c-4577-90bb-c97bdb6b472c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:12.114615 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa78bf-3a2c-4577-90bb-c97bdb6b472c admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:12.114897 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa78bf-3a2c-4577-90bb-c97bdb6b472c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:12.115176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08aa78bf-3a2c-4577-90bb-c97bdb6b472c admin admin] PATH_INFO: `/v3/projects/0afc56f906c645408311c3878d478def/users/da6a2bcaf4754c6a92f31eadb67fef64/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:12.129206 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa78bf-3a2c-4577-90bb-c97bdb6b472c admin admin] RBAC: Authorizing `identity:create_grant(project_id=0afc56f906c645408311c3878d478def, user_id=da6a2bcaf4754c6a92f31eadb67fef64, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:12.132356 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08aa78bf-3a2c-4577-90bb-c97bdb6b472c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:12.144868 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1459/2871] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:35:12 2022] PUT /identity/v3/projects/0afc56f906c645408311c3878d478def/users/da6a2bcaf4754c6a92f31eadb67fef64/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 46 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:12.149254 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9ba5b-e66d-4b5d-9a11-95a5abf9ca3d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:12.155588 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=89,keystone:DELETE=7,keystone:INSERT=4 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:12.159420 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7c9ba5b-e66d-4b5d-9a11-95a5abf9ca3d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:12.221042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-532e41b3-2ccd-452b-a9a1-ec06cd8b8df0 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:12.221712 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e41b3-2ccd-452b-a9a1-ec06cd8b8df0 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:12.221993 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e41b3-2ccd-452b-a9a1-ec06cd8b8df0 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:12.222275 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-532e41b3-2ccd-452b-a9a1-ec06cd8b8df0 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:12.222995 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e41b3-2ccd-452b-a9a1-ec06cd8b8df0 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:12.224641 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-532e41b3-2ccd-452b-a9a1-ec06cd8b8df0 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:12.234680 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1413/2872] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:35:12 2022] GET /identity/v3/roles => generated 1420 bytes in 86 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:35:12.238840 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa78bf-3a2c-4577-90bb-c97bdb6b472c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:12.248885 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08aa78bf-3a2c-4577-90bb-c97bdb6b472c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:12.253476 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf27242-a7e8-498e-8530-af295dae74d6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:12.254345 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf27242-a7e8-498e-8530-af295dae74d6 admin admin] REQUEST_METHOD: `PUT` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:12.255149 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf27242-a7e8-498e-8530-af295dae74d6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:12.255427 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbf27242-a7e8-498e-8530-af295dae74d6 admin admin] PATH_INFO: `/v3/projects/0afc56f906c645408311c3878d478def/users/da6a2bcaf4754c6a92f31eadb67fef64/roles/a66ff4069aae49baac5f96c0b4657894` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:12.257376 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf27242-a7e8-498e-8530-af295dae74d6 admin admin] RBAC: Authorizing `identity:create_grant(project_id=0afc56f906c645408311c3878d478def, user_id=da6a2bcaf4754c6a92f31eadb67fef64, role_id=a66ff4069aae49baac5f96c0b4657894)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:12.259986 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbf27242-a7e8-498e-8530-af295dae74d6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:12.269928 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1460/2873] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:35:12 2022] PUT /identity/v3/projects/0afc56f906c645408311c3878d478def/users/da6a2bcaf4754c6a92f31eadb67fef64/roles/a66ff4069aae49baac5f96c0b4657894 => generated 0 bytes in 31 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:12.280091 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0a25f-095e-4ecb-ad19-3088c8f8026b None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:12.280389 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0a25f-095e-4ecb-ad19-3088c8f8026b None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:12.280673 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04f0a25f-095e-4ecb-ad19-3088c8f8026b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:12.306051 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-04f0a25f-095e-4ecb-ad19-3088c8f8026b None None] MFA Rules not processed for user `da6a2bcaf4754c6a92f31eadb67fef64`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:12.307243 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-04f0a25f-095e-4ecb-ad19-3088c8f8026b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:12.375763 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1414/2874] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:12 2022] POST /identity/v3/auth/tokens => generated 3309 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:12.386877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf27242-a7e8-498e-8530-af295dae74d6 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:12.388565 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-cbf27242-a7e8-498e-8530-af295dae74d6 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:12.465225 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbf27242-a7e8-498e-8530-af295dae74d6 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:12.468840 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c31226-51c9-4d69-a5df-845a9eb960bb service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:12.469514 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c31226-51c9-4d69-a5df-845a9eb960bb service cinder] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:12.469796 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c31226-51c9-4d69-a5df-845a9eb960bb service cinder] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:12.470073 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2c31226-51c9-4d69-a5df-845a9eb960bb service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:12.525112 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c31226-51c9-4d69-a5df-845a9eb960bb service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:12.526482 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2c31226-51c9-4d69-a5df-845a9eb960bb service cinder] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:12.535426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1461/2875] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:35:12 2022] GET /identity/v3/auth/tokens => generated 3240 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:35:15.055446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0a25f-095e-4ecb-ad19-3088c8f8026b None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:15.065027 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04f0a25f-095e-4ecb-ad19-3088c8f8026b None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:15.068702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647b7350-72a5-45ef-9f03-a1ad9be22574 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:15.069367 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b7350-72a5-45ef-9f03-a1ad9be22574 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:15.069652 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b7350-72a5-45ef-9f03-a1ad9be22574 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:15.069930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647b7350-72a5-45ef-9f03-a1ad9be22574 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:15.079826 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b7350-72a5-45ef-9f03-a1ad9be22574 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:15.081364 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-647b7350-72a5-45ef-9f03-a1ad9be22574 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:15.090700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1415/2876] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:35:15 2022] GET /identity/v3/auth/tokens => generated 3309 bytes in 36 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:35:22.531273 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=86,keystone:INSERT=5 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:25.086530 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=67 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:27.465195 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c31226-51c9-4d69-a5df-845a9eb960bb service cinder] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:27.527425 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2c31226-51c9-4d69-a5df-845a9eb960bb service cinder] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:27.531909 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4773ce-9b9d-44c0-b8bb-583b795dbd0c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:27.532771 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4773ce-9b9d-44c0-b8bb-583b795dbd0c admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:27.533086 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4773ce-9b9d-44c0-b8bb-583b795dbd0c admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:27.533361 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e4773ce-9b9d-44c0-b8bb-583b795dbd0c admin admin] PATH_INFO: `/v3/users/2772476e10b949ae97fbef80115ab8d7` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:27.534518 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4773ce-9b9d-44c0-b8bb-583b795dbd0c admin admin] RBAC: Authorizing `identity:delete_user(user_id=2772476e10b949ae97fbef80115ab8d7)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:27.536439 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e4773ce-9b9d-44c0-b8bb-583b795dbd0c admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:27.581535 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e4773ce-9b9d-44c0-b8bb-583b795dbd0c admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '2772476e10b949ae97fbef80115ab8d7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:27.582189 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e4773ce-9b9d-44c0-b8bb-583b795dbd0c admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '2772476e10b949ae97fbef80115ab8d7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:27.589503 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e4773ce-9b9d-44c0-b8bb-583b795dbd0c admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '2772476e10b949ae97fbef80115ab8d7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:27.590130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e4773ce-9b9d-44c0-b8bb-583b795dbd0c admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '2772476e10b949ae97fbef80115ab8d7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:27.601719 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-1e4773ce-9b9d-44c0-b8bb-583b795dbd0c admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '2772476e10b949ae97fbef80115ab8d7'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:27.615099 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1462/2877] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:35:27 2022] DELETE /identity/v3/users/2772476e10b949ae97fbef80115ab8d7 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:27.619563 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8bb97-70ca-420c-8919-6a2af835b5bc None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:27.620048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8bb97-70ca-420c-8919-6a2af835b5bc None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:27.620153 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51b8bb97-70ca-420c-8919-6a2af835b5bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:27.638658 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-51b8bb97-70ca-420c-8919-6a2af835b5bc None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:27.639844 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-51b8bb97-70ca-420c-8919-6a2af835b5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:27.697572 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1416/2878] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:27 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:27.706931 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4773ce-9b9d-44c0-b8bb-583b795dbd0c admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:27.708361 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-1e4773ce-9b9d-44c0-b8bb-583b795dbd0c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:27.765080 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e4773ce-9b9d-44c0-b8bb-583b795dbd0c admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:27.768743 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca00bcf-b333-45cf-b177-322a30ffadf1 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:27.769410 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca00bcf-b333-45cf-b177-322a30ffadf1 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:27.769696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca00bcf-b333-45cf-b177-322a30ffadf1 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:27.769976 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ca00bcf-b333-45cf-b177-322a30ffadf1 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:27.780365 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca00bcf-b333-45cf-b177-322a30ffadf1 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:27.781828 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ca00bcf-b333-45cf-b177-322a30ffadf1 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:27.791181 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1463/2879] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:35:27 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 85 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:35:28.049063 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8bb97-70ca-420c-8919-6a2af835b5bc None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:28.050585 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-51b8bb97-70ca-420c-8919-6a2af835b5bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:28.064557 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51b8bb97-70ca-420c-8919-6a2af835b5bc None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:28.069283 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:28.070162 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:28.070446 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:28.071536 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] PATH_INFO: `/v3/projects/33bddc4bccd646f19a46c490038a090e` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:28.073083 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] RBAC: Authorizing `identity:delete_project(project_id=33bddc4bccd646f19a46c490038a090e)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:28.075817 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:28.122574 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '33bddc4bccd646f19a46c490038a090e', 'request_id': 'req-93fa9395-15e5-4815-9577-4b47cf04fb7a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.129640 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '33bddc4bccd646f19a46c490038a090e', 'request_id': 'req-93fa9395-15e5-4815-9577-4b47cf04fb7a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.135866 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '33bddc4bccd646f19a46c490038a090e', 'request_id': 'req-93fa9395-15e5-4815-9577-4b47cf04fb7a'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.146725 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] The token cache is being invalidate because project 33bddc4bccd646f19a46c490038a090e was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:35:28.147010 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.147855 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.149331 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1417/2880] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:35:28 2022] DELETE /identity/v3/projects/33bddc4bccd646f19a46c490038a090e => generated 0 bytes in 101 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:28.153226 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca00bcf-b333-45cf-b177-322a30ffadf1 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:28.162633 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ca00bcf-b333-45cf-b177-322a30ffadf1 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:28.180902 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:28.221034 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-112f7aa1-1f6d-4298-817d-9cc2d47b01a6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:28.221934 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f7aa1-1f6d-4298-817d-9cc2d47b01a6 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:28.222211 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f7aa1-1f6d-4298-817d-9cc2d47b01a6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:28.222507 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-112f7aa1-1f6d-4298-817d-9cc2d47b01a6 admin admin] PATH_INFO: `/v3/users/da6a2bcaf4754c6a92f31eadb67fef64` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:28.223661 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f7aa1-1f6d-4298-817d-9cc2d47b01a6 admin admin] RBAC: Authorizing `identity:delete_user(user_id=da6a2bcaf4754c6a92f31eadb67fef64)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:28.225720 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-112f7aa1-1f6d-4298-817d-9cc2d47b01a6 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:28.270679 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-112f7aa1-1f6d-4298-817d-9cc2d47b01a6 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'da6a2bcaf4754c6a92f31eadb67fef64'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.271320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-112f7aa1-1f6d-4298-817d-9cc2d47b01a6 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'da6a2bcaf4754c6a92f31eadb67fef64'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.278121 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-112f7aa1-1f6d-4298-817d-9cc2d47b01a6 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'da6a2bcaf4754c6a92f31eadb67fef64'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.278754 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-112f7aa1-1f6d-4298-817d-9cc2d47b01a6 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'da6a2bcaf4754c6a92f31eadb67fef64'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.290285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-112f7aa1-1f6d-4298-817d-9cc2d47b01a6 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'da6a2bcaf4754c6a92f31eadb67fef64'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.302415 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1464/2881] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:35:28 2022] DELETE /identity/v3/users/da6a2bcaf4754c6a92f31eadb67fef64 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:28.560377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:28.561951 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:28.574822 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93fa9395-15e5-4815-9577-4b47cf04fb7a admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:28.630912 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-320ce72e-2b70-45da-8367-1f066a26330f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:28.631766 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ce72e-2b70-45da-8367-1f066a26330f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:28.632043 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ce72e-2b70-45da-8367-1f066a26330f admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:28.632316 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-320ce72e-2b70-45da-8367-1f066a26330f admin admin] PATH_INFO: `/v3/projects/0afc56f906c645408311c3878d478def` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:28.633511 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ce72e-2b70-45da-8367-1f066a26330f admin admin] RBAC: Authorizing `identity:delete_project(project_id=0afc56f906c645408311c3878d478def)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:28.635409 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-320ce72e-2b70-45da-8367-1f066a26330f admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:28.663413 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=91,keystone:DELETE=8,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:28.682876 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-320ce72e-2b70-45da-8367-1f066a26330f admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '0afc56f906c645408311c3878d478def', 'request_id': 'req-320ce72e-2b70-45da-8367-1f066a26330f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.689850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-320ce72e-2b70-45da-8367-1f066a26330f admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '0afc56f906c645408311c3878d478def', 'request_id': 'req-320ce72e-2b70-45da-8367-1f066a26330f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.695540 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-320ce72e-2b70-45da-8367-1f066a26330f admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '0afc56f906c645408311c3878d478def', 'request_id': 'req-320ce72e-2b70-45da-8367-1f066a26330f'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.706282 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-320ce72e-2b70-45da-8367-1f066a26330f admin admin] The token cache is being invalidate because project 0afc56f906c645408311c3878d478def was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:35:28.706571 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-320ce72e-2b70-45da-8367-1f066a26330f admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.707209 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-320ce72e-2b70-45da-8367-1f066a26330f admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:28.708799 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1418/2882] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:35:28 2022] DELETE /identity/v3/projects/0afc56f906c645408311c3878d478def => generated 0 bytes in 149 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:28.714435 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3f54-4500-493b-8c17-7b18d43f4899 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:28.714912 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3f54-4500-493b-8c17-7b18d43f4899 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:28.715010 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f9f3f54-4500-493b-8c17-7b18d43f4899 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:28.733527 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-9f9f3f54-4500-493b-8c17-7b18d43f4899 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:28.734666 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9f9f3f54-4500-493b-8c17-7b18d43f4899 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:28.792501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1465/2883] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 79 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:28.800197 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b2f10-d7da-4169-b86a-a386a15d471d None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:28.800483 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b2f10-d7da-4169-b86a-a386a15d471d None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:28.800761 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-743b2f10-d7da-4169-b86a-a386a15d471d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:28.818377 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-743b2f10-d7da-4169-b86a-a386a15d471d None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:28.819547 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-743b2f10-d7da-4169-b86a-a386a15d471d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:28.827156 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1419/2884] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:28 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 28 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:28.831103 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f3f54-4500-493b-8c17-7b18d43f4899 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:28.841349 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f9f3f54-4500-493b-8c17-7b18d43f4899 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:28.845911 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6b27f-39e2-4b9a-9ae1-8540f38596a7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:28.846563 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6b27f-39e2-4b9a-9ae1-8540f38596a7 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:28.846851 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6b27f-39e2-4b9a-9ae1-8540f38596a7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:28.847133 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff6b27f-39e2-4b9a-9ae1-8540f38596a7 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:28.847883 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6b27f-39e2-4b9a-9ae1-8540f38596a7 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:35:28.848195 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6b27f-39e2-4b9a-9ae1-8540f38596a7 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:28.849834 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff6b27f-39e2-4b9a-9ae1-8540f38596a7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:28.862147 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1466/2885] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:35:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:35:28.866128 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b2f10-d7da-4169-b86a-a386a15d471d None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:28.875107 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-743b2f10-d7da-4169-b86a-a386a15d471d None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:28.879561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73a14b-8816-4c41-9535-2c1a18302c34 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:28.880191 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73a14b-8816-4c41-9535-2c1a18302c34 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:28.880468 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73a14b-8816-4c41-9535-2c1a18302c34 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:28.880741 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf73a14b-8816-4c41-9535-2c1a18302c34 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:28.881461 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73a14b-8816-4c41-9535-2c1a18302c34 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:28.883343 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf73a14b-8816-4c41-9535-2c1a18302c34 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:28.907703 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1420/2886] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:35:28 2022] POST /identity/v3/projects => generated 377 bytes in 42 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:35:28.911679 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6b27f-39e2-4b9a-9ae1-8540f38596a7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:28.921964 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff6b27f-39e2-4b9a-9ae1-8540f38596a7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:28.946747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:28.979369 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8d27b-7b58-4bd0-af67-febe3ce33c57 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:28.980038 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8d27b-7b58-4bd0-af67-febe3ce33c57 admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:28.980323 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8d27b-7b58-4bd0-af67-febe3ce33c57 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:28.980601 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4af8d27b-7b58-4bd0-af67-febe3ce33c57 admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:28.981332 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8d27b-7b58-4bd0-af67-febe3ce33c57 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:28.983253 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4af8d27b-7b58-4bd0-af67-febe3ce33c57 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:29.002246 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1467/2887] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:35:28 2022] POST /identity/v3/users => generated 289 bytes in 91 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:35:29.006206 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73a14b-8816-4c41-9535-2c1a18302c34 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:29.016282 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf73a14b-8816-4c41-9535-2c1a18302c34 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:29.020839 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104043f-e357-41c8-b483-06d899d5dfa6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:29.021530 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104043f-e357-41c8-b483-06d899d5dfa6 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:29.021818 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104043f-e357-41c8-b483-06d899d5dfa6 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:29.022101 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3104043f-e357-41c8-b483-06d899d5dfa6 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:29.023016 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104043f-e357-41c8-b483-06d899d5dfa6 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:29.025145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3104043f-e357-41c8-b483-06d899d5dfa6 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:29.035640 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1421/2888] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:35:29.040250 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8d27b-7b58-4bd0-af67-febe3ce33c57 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:29.050289 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4af8d27b-7b58-4bd0-af67-febe3ce33c57 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:29.054843 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01682f45-2f22-49e7-8215-3ccc9ce70dc3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:29.055488 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01682f45-2f22-49e7-8215-3ccc9ce70dc3 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:29.055772 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01682f45-2f22-49e7-8215-3ccc9ce70dc3 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:29.056050 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01682f45-2f22-49e7-8215-3ccc9ce70dc3 admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:29.056784 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01682f45-2f22-49e7-8215-3ccc9ce70dc3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:29.058400 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01682f45-2f22-49e7-8215-3ccc9ce70dc3 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:29.068224 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1468/2889] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:35:29 2022] GET /identity/v3/roles => generated 1420 bytes in 29 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:35:29.071837 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104043f-e357-41c8-b483-06d899d5dfa6 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:29.082702 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3104043f-e357-41c8-b483-06d899d5dfa6 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:29.087850 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b67ed-c1bf-444c-97dd-d4fe7d1c8e00 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:29.088724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b67ed-c1bf-444c-97dd-d4fe7d1c8e00 admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:29.089065 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b67ed-c1bf-444c-97dd-d4fe7d1c8e00 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:29.089346 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f95b67ed-c1bf-444c-97dd-d4fe7d1c8e00 admin admin] PATH_INFO: `/v3/projects/43b521508dd142b88b36cbefdcfd8ee4/users/4e2fa6c314724e32a39d72da57e78193/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:29.104647 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b67ed-c1bf-444c-97dd-d4fe7d1c8e00 admin admin] RBAC: Authorizing `identity:create_grant(project_id=43b521508dd142b88b36cbefdcfd8ee4, user_id=4e2fa6c314724e32a39d72da57e78193, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:29.107340 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f95b67ed-c1bf-444c-97dd-d4fe7d1c8e00 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:29.119632 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1422/2890] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:35:29 2022] PUT /identity/v3/projects/43b521508dd142b88b36cbefdcfd8ee4/users/4e2fa6c314724e32a39d72da57e78193/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 48 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:29.129853 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89234b71-9b85-46f4-bfa2-2bff4dc2fce1 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:29.130145 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89234b71-9b85-46f4-bfa2-2bff4dc2fce1 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:29.130426 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89234b71-9b85-46f4-bfa2-2bff4dc2fce1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:29.157431 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-89234b71-9b85-46f4-bfa2-2bff4dc2fce1 None None] MFA Rules not processed for user `4e2fa6c314724e32a39d72da57e78193`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:29.158659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-89234b71-9b85-46f4-bfa2-2bff4dc2fce1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:29.222141 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1469/2891] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:29 2022] POST /identity/v3/auth/tokens => generated 3244 bytes in 93 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:29.233883 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b67ed-c1bf-444c-97dd-d4fe7d1c8e00 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:29.235545 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f95b67ed-c1bf-444c-97dd-d4fe7d1c8e00 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:29.291341 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f95b67ed-c1bf-444c-97dd-d4fe7d1c8e00 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:29.294878 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dbecfc80-730a-4fcb-8b70-1c1ba1b42421 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'a2fbb5beba8a45a5b0a9b0beba0e0d63', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:29.295517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecfc80-730a-4fcb-8b70-1c1ba1b42421 service glance] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:29.295809 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecfc80-730a-4fcb-8b70-1c1ba1b42421 service glance] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:29.296088 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dbecfc80-730a-4fcb-8b70-1c1ba1b42421 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:29.304183 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecfc80-730a-4fcb-8b70-1c1ba1b42421 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:29.305657 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dbecfc80-730a-4fcb-8b70-1c1ba1b42421 service glance] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:29.314272 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1423/2892] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:35:29 2022] GET /identity/v3/auth/tokens => generated 3244 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:35:39.219208 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=53,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:39.310328 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:DELETE=6,keystone:SELECT=67,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:47.888142 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89234b71-9b85-46f4-bfa2-2bff4dc2fce1 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:47.947813 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89234b71-9b85-46f4-bfa2-2bff4dc2fce1 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:47.952247 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7be13c-a624-4419-b1cf-b5cee4194ddc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:47.953143 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be13c-a624-4419-b1cf-b5cee4194ddc admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:47.953420 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be13c-a624-4419-b1cf-b5cee4194ddc admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:47.953693 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e7be13c-a624-4419-b1cf-b5cee4194ddc admin admin] PATH_INFO: `/v3/users/4e2fa6c314724e32a39d72da57e78193` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:47.954877 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7be13c-a624-4419-b1cf-b5cee4194ddc admin admin] RBAC: Authorizing `identity:delete_user(user_id=4e2fa6c314724e32a39d72da57e78193)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:47.957294 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e7be13c-a624-4419-b1cf-b5cee4194ddc admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:48.001751 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3e7be13c-a624-4419-b1cf-b5cee4194ddc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '4e2fa6c314724e32a39d72da57e78193'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:48.002414 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3e7be13c-a624-4419-b1cf-b5cee4194ddc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '4e2fa6c314724e32a39d72da57e78193'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:48.009164 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3e7be13c-a624-4419-b1cf-b5cee4194ddc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '4e2fa6c314724e32a39d72da57e78193'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:48.009795 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3e7be13c-a624-4419-b1cf-b5cee4194ddc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '4e2fa6c314724e32a39d72da57e78193'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:48.022283 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-3e7be13c-a624-4419-b1cf-b5cee4194ddc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '4e2fa6c314724e32a39d72da57e78193'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:48.034845 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1470/2893] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:35:47 2022] DELETE /identity/v3/users/4e2fa6c314724e32a39d72da57e78193 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:48.039354 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3d03d-481f-46f3-bd39-9498b0c12383 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:48.039848 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3d03d-481f-46f3-bd39-9498b0c12383 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:48.039977 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32a3d03d-481f-46f3-bd39-9498b0c12383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:48.056865 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-32a3d03d-481f-46f3-bd39-9498b0c12383 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:48.058078 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-32a3d03d-481f-46f3-bd39-9498b0c12383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:48.114925 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1424/2894] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 77 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:48.124603 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7be13c-a624-4419-b1cf-b5cee4194ddc admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:48.126064 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-3e7be13c-a624-4419-b1cf-b5cee4194ddc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:48.184176 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e7be13c-a624-4419-b1cf-b5cee4194ddc admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:48.187946 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47b87d2b-4b2e-4a44-9b75-f18031b01356 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:48.188587 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b87d2b-4b2e-4a44-9b75-f18031b01356 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:48.188866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b87d2b-4b2e-4a44-9b75-f18031b01356 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:48.189170 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47b87d2b-4b2e-4a44-9b75-f18031b01356 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:48.198590 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b87d2b-4b2e-4a44-9b75-f18031b01356 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:48.200007 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47b87d2b-4b2e-4a44-9b75-f18031b01356 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:48.209846 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1471/2895] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:35:48 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 86 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:35:48.472449 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3d03d-481f-46f3-bd39-9498b0c12383 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:48.474028 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-32a3d03d-481f-46f3-bd39-9498b0c12383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:48.486973 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32a3d03d-481f-46f3-bd39-9498b0c12383 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:48.491731 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7b79eca-e0ca-452b-8bd9-a528d60aa064 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:48.492650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b79eca-e0ca-452b-8bd9-a528d60aa064 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:48.492974 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b79eca-e0ca-452b-8bd9-a528d60aa064 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:48.493419 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7b79eca-e0ca-452b-8bd9-a528d60aa064 admin admin] PATH_INFO: `/v3/projects/43b521508dd142b88b36cbefdcfd8ee4` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:48.494650 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b79eca-e0ca-452b-8bd9-a528d60aa064 admin admin] RBAC: Authorizing `identity:delete_project(project_id=43b521508dd142b88b36cbefdcfd8ee4)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:48.496565 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7b79eca-e0ca-452b-8bd9-a528d60aa064 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:48.542212 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d7b79eca-e0ca-452b-8bd9-a528d60aa064 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '43b521508dd142b88b36cbefdcfd8ee4', 'request_id': 'req-d7b79eca-e0ca-452b-8bd9-a528d60aa064'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:48.550076 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d7b79eca-e0ca-452b-8bd9-a528d60aa064 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '43b521508dd142b88b36cbefdcfd8ee4', 'request_id': 'req-d7b79eca-e0ca-452b-8bd9-a528d60aa064'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:48.555750 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d7b79eca-e0ca-452b-8bd9-a528d60aa064 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '43b521508dd142b88b36cbefdcfd8ee4', 'request_id': 'req-d7b79eca-e0ca-452b-8bd9-a528d60aa064'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:48.567930 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d7b79eca-e0ca-452b-8bd9-a528d60aa064 admin admin] The token cache is being invalidate because project 43b521508dd142b88b36cbefdcfd8ee4 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:35:48.568213 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d7b79eca-e0ca-452b-8bd9-a528d60aa064 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:48.568873 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-d7b79eca-e0ca-452b-8bd9-a528d60aa064 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:48.570458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1425/2896] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:35:48 2022] DELETE /identity/v3/projects/43b521508dd142b88b36cbefdcfd8ee4 => generated 0 bytes in 99 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:48.575659 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e425dc-4f1a-41b3-8de6-b09e3c6a5770 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:48.575950 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e425dc-4f1a-41b3-8de6-b09e3c6a5770 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:48.576229 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e425dc-4f1a-41b3-8de6-b09e3c6a5770 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:48.593259 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-78e425dc-4f1a-41b3-8de6-b09e3c6a5770 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:48.594462 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-78e425dc-4f1a-41b3-8de6-b09e3c6a5770 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:48.611822 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:48.654818 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1472/2897] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 80 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:48.664561 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19a4d-2095-4e3d-86ab-a67897f34aec None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:48.664857 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19a4d-2095-4e3d-86ab-a67897f34aec None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:48.665203 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afc19a4d-2095-4e3d-86ab-a67897f34aec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:48.684742 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-afc19a4d-2095-4e3d-86ab-a67897f34aec None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:48.685986 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-afc19a4d-2095-4e3d-86ab-a67897f34aec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:48.694471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1426/2898] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:48 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:48.698585 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e425dc-4f1a-41b3-8de6-b09e3c6a5770 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:48.708532 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e425dc-4f1a-41b3-8de6-b09e3c6a5770 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:48.713070 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd3a65-7521-4099-a2f5-de68459c4096 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:48.713722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd3a65-7521-4099-a2f5-de68459c4096 admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:48.714002 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd3a65-7521-4099-a2f5-de68459c4096 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:48.714274 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41dd3a65-7521-4099-a2f5-de68459c4096 admin admin] PATH_INFO: `/v3/domains` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:48.714987 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd3a65-7521-4099-a2f5-de68459c4096 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=80231) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} May 26 18:35:48.715292 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd3a65-7521-4099-a2f5-de68459c4096 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:48.716888 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41dd3a65-7521-4099-a2f5-de68459c4096 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:48.729712 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1473/2899] 10.222.0.64 () {58 vars in 1152 bytes} [Thu May 26 18:35:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) May 26 18:35:48.734190 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc19a4d-2095-4e3d-86ab-a67897f34aec None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:48.743819 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afc19a4d-2095-4e3d-86ab-a67897f34aec None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:48.748461 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55189b64-59f7-43e6-a6ba-6da987f57289 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:48.749131 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55189b64-59f7-43e6-a6ba-6da987f57289 admin admin] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:48.749410 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55189b64-59f7-43e6-a6ba-6da987f57289 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:48.749676 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55189b64-59f7-43e6-a6ba-6da987f57289 admin admin] PATH_INFO: `/v3/projects` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:48.750348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55189b64-59f7-43e6-a6ba-6da987f57289 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:48.752862 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55189b64-59f7-43e6-a6ba-6da987f57289 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:48.780360 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1427/2900] 10.222.0.64 () {60 vars in 1152 bytes} [Thu May 26 18:35:48 2022] POST /identity/v3/projects => generated 375 bytes in 44 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) May 26 18:35:48.781662 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd3a65-7521-4099-a2f5-de68459c4096 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:48.791501 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41dd3a65-7521-4099-a2f5-de68459c4096 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:48.848392 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe940a-034a-4bce-b131-297dce74aefb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:48.849084 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe940a-034a-4bce-b131-297dce74aefb admin admin] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:48.849373 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe940a-034a-4bce-b131-297dce74aefb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:48.849651 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdbe940a-034a-4bce-b131-297dce74aefb admin admin] PATH_INFO: `/v3/users` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:48.850327 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe940a-034a-4bce-b131-297dce74aefb admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:48.852244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fdbe940a-034a-4bce-b131-297dce74aefb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:48.872992 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1474/2901] 10.222.0.64 () {60 vars in 1143 bytes} [Thu May 26 18:35:48 2022] POST /identity/v3/users => generated 288 bytes in 92 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) May 26 18:35:48.877042 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55189b64-59f7-43e6-a6ba-6da987f57289 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:48.887204 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55189b64-59f7-43e6-a6ba-6da987f57289 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:48.891847 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397376cc-767e-44cb-aff8-00f959503a68 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:48.892499 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397376cc-767e-44cb-aff8-00f959503a68 admin admin] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:48.892784 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397376cc-767e-44cb-aff8-00f959503a68 admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:48.893109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-397376cc-767e-44cb-aff8-00f959503a68 admin admin] PATH_INFO: `/v3/roles` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:48.893827 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397376cc-767e-44cb-aff8-00f959503a68 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:48.895834 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-397376cc-767e-44cb-aff8-00f959503a68 admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:48.906320 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1428/2902] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:35:48.910728 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe940a-034a-4bce-b131-297dce74aefb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:48.920866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdbe940a-034a-4bce-b131-297dce74aefb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:48.926483 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93a9bf9d-c845-4b0a-9a6a-c2398291e67a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:48.927157 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9bf9d-c845-4b0a-9a6a-c2398291e67a admin admin] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:48.927438 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9bf9d-c845-4b0a-9a6a-c2398291e67a admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:48.927714 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93a9bf9d-c845-4b0a-9a6a-c2398291e67a admin admin] PATH_INFO: `/v3/roles` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:48.928431 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9bf9d-c845-4b0a-9a6a-c2398291e67a admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:48.930051 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93a9bf9d-c845-4b0a-9a6a-c2398291e67a admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:48.940302 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1475/2903] 10.222.0.64 () {58 vars in 1121 bytes} [Thu May 26 18:35:48 2022] GET /identity/v3/roles => generated 1420 bytes in 30 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) May 26 18:35:48.944474 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397376cc-767e-44cb-aff8-00f959503a68 admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:48.954471 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-397376cc-767e-44cb-aff8-00f959503a68 admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:48.959044 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ff564-dc4c-499d-99c0-878893f4d25e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:48.959918 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ff564-dc4c-499d-99c0-878893f4d25e admin admin] REQUEST_METHOD: `PUT` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:48.960198 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ff564-dc4c-499d-99c0-878893f4d25e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:48.960469 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6ff564-dc4c-499d-99c0-878893f4d25e admin admin] PATH_INFO: `/v3/projects/c6c3f7f55ba8449c88b893d3f34d134d/users/90c374e90d7845a1b64019c0efd76148/roles/f4ccd6ca72d7486d85d90f7585de12c9` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:48.975145 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ff564-dc4c-499d-99c0-878893f4d25e admin admin] RBAC: Authorizing `identity:create_grant(project_id=c6c3f7f55ba8449c88b893d3f34d134d, user_id=90c374e90d7845a1b64019c0efd76148, role_id=f4ccd6ca72d7486d85d90f7585de12c9)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:48.977815 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb6ff564-dc4c-499d-99c0-878893f4d25e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:48.991109 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1429/2904] 10.222.0.64 () {60 vars in 1482 bytes} [Thu May 26 18:35:48 2022] PUT /identity/v3/projects/c6c3f7f55ba8449c88b893d3f34d134d/users/90c374e90d7845a1b64019c0efd76148/roles/f4ccd6ca72d7486d85d90f7585de12c9 => generated 0 bytes in 47 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:49.001434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033e1a8-b13e-47ae-97aa-e9583eae09c8 None None] REQUEST_METHOD: `POST` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:49.001734 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033e1a8-b13e-47ae-97aa-e9583eae09c8 None None] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:49.002046 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5033e1a8-b13e-47ae-97aa-e9583eae09c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:49.027810 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.auth.core [None req-5033e1a8-b13e-47ae-97aa-e9583eae09c8 None None] MFA Rules not processed for user `90c374e90d7845a1b64019c0efd76148`. Rule list: `[]` (Enabled: `True`). {{(pid=80231) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:49.029039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-5033e1a8-b13e-47ae-97aa-e9583eae09c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:49.091696 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1476/2905] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:48 2022] POST /identity/v3/auth/tokens => generated 3242 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) May 26 18:35:49.102789 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ff564-dc4c-499d-99c0-878893f4d25e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:49.104499 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bb6ff564-dc4c-499d-99c0-878893f4d25e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:49.126738 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=90,keystone:DELETE=7,keystone:INSERT=3 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:49.166447 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb6ff564-dc4c-499d-99c0-878893f4d25e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:49.169983 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28ba99d3-bf21-436b-bbef-f0d9748dad79 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '0c09ffb276b84b2aa8735d6907a0de73', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:49.170619 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba99d3-bf21-436b-bbef-f0d9748dad79 service cinder] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:49.170898 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba99d3-bf21-436b-bbef-f0d9748dad79 service cinder] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:49.171169 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28ba99d3-bf21-436b-bbef-f0d9748dad79 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:49.179857 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba99d3-bf21-436b-bbef-f0d9748dad79 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:49.181309 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28ba99d3-bf21-436b-bbef-f0d9748dad79 service cinder] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:49.190017 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1430/2906] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:35:49 2022] GET /identity/v3/auth/tokens => generated 3242 bytes in 88 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:35:58.092099 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033e1a8-b13e-47ae-97aa-e9583eae09c8 None None] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:58.111497 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:35:58.158126 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5033e1a8-b13e-47ae-97aa-e9583eae09c8 None None] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:58.164638 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee7cee-ae18-4f15-be7a-89e9027f8f4f admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:58.165737 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee7cee-ae18-4f15-be7a-89e9027f8f4f admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:58.166319 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee7cee-ae18-4f15-be7a-89e9027f8f4f admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:58.167948 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ee7cee-ae18-4f15-be7a-89e9027f8f4f admin admin] PATH_INFO: `/v3/users/90c374e90d7845a1b64019c0efd76148` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:58.168343 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee7cee-ae18-4f15-be7a-89e9027f8f4f admin admin] RBAC: Authorizing `identity:delete_user(user_id=90c374e90d7845a1b64019c0efd76148)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:58.171561 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ee7cee-ae18-4f15-be7a-89e9027f8f4f admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:58.216722 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-63ee7cee-ae18-4f15-be7a-89e9027f8f4f admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '90c374e90d7845a1b64019c0efd76148'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:58.217434 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-63ee7cee-ae18-4f15-be7a-89e9027f8f4f admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '90c374e90d7845a1b64019c0efd76148'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:58.224888 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-63ee7cee-ae18-4f15-be7a-89e9027f8f4f admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '90c374e90d7845a1b64019c0efd76148'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:58.225547 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-63ee7cee-ae18-4f15-be7a-89e9027f8f4f admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '90c374e90d7845a1b64019c0efd76148'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:58.238120 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-63ee7cee-ae18-4f15-be7a-89e9027f8f4f admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '90c374e90d7845a1b64019c0efd76148'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:58.250487 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1477/2907] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:35:58 2022] DELETE /identity/v3/users/90c374e90d7845a1b64019c0efd76148 => generated 0 bytes in 159 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:35:58.255138 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b54ee8-7835-48bc-b5be-37c1b8c62ba6 None None] REQUEST_METHOD: `POST` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:58.255625 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b54ee8-7835-48bc-b5be-37c1b8c62ba6 None None] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:58.255747 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2b54ee8-7835-48bc-b5be-37c1b8c62ba6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:58.272528 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.auth.core [None req-e2b54ee8-7835-48bc-b5be-37c1b8c62ba6 None None] MFA Rules not processed for user `99d73c7eb544437daee425e1da4f8bea`. Rule list: `[]` (Enabled: `True`). {{(pid=80230) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} May 26 18:35:58.273782 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e2b54ee8-7835-48bc-b5be-37c1b8c62ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:58.330031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1431/2908] 10.222.0.64 () {58 vars in 957 bytes} [Thu May 26 18:35:58 2022] POST /identity/v3/auth/tokens => generated 3229 bytes in 76 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) May 26 18:35:58.341371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee7cee-ae18-4f15-be7a-89e9027f8f4f admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:58.345712 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-63ee7cee-ae18-4f15-be7a-89e9027f8f4f admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:58.403973 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ee7cee-ae18-4f15-be7a-89e9027f8f4f admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:58.407657 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b5b29-c3af-47c0-9d83-ae449ad1685e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:58.408300 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b5b29-c3af-47c0-9d83-ae449ad1685e service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:58.408588 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b5b29-c3af-47c0-9d83-ae449ad1685e service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:58.408866 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d7b5b29-c3af-47c0-9d83-ae449ad1685e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:58.418410 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b5b29-c3af-47c0-9d83-ae449ad1685e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:58.419844 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d7b5b29-c3af-47c0-9d83-ae449ad1685e service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:58.429346 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1478/2909] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:35:58 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 89 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:35:58.699515 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b54ee8-7835-48bc-b5be-37c1b8c62ba6 None None] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:35:58.701031 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-e2b54ee8-7835-48bc-b5be-37c1b8c62ba6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:35:58.714348 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2b54ee8-7835-48bc-b5be-37c1b8c62ba6 None None] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:35:58.718902 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:35:58.719768 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:35:58.720048 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:35:58.720321 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] PATH_INFO: `/v3/projects/c6c3f7f55ba8449c88b893d3f34d134d` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:35:58.721511 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=c6c3f7f55ba8449c88b893d3f34d134d)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:35:58.723427 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:35:58.769858 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'c6c3f7f55ba8449c88b893d3f34d134d', 'request_id': 'req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:58.776751 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'c6c3f7f55ba8449c88b893d3f34d134d', 'request_id': 'req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:58.782096 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'c6c3f7f55ba8449c88b893d3f34d134d', 'request_id': 'req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:58.792644 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] The token cache is being invalidate because project c6c3f7f55ba8449c88b893d3f34d134d was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:35:58.792928 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:58.793569 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:35:58.795073 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1432/2910] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:35:58 2022] DELETE /identity/v3/projects/c6c3f7f55ba8449c88b893d3f34d134d => generated 0 bytes in 96 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:36:08.425097 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=71,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:36:08.789777 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=71,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:36:22.803728 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b5b29-c3af-47c0-9d83-ae449ad1685e service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:36:22.812682 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d7b5b29-c3af-47c0-9d83-ae449ad1685e service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:36:22.861671 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cdbcd-d7f4-40c1-9bfb-fa8c46560d29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1b725c28490f4f90b5eec565cd0fb603', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:36:22.862249 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cdbcd-d7f4-40c1-9bfb-fa8c46560d29 service neutron] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:36:22.862533 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cdbcd-d7f4-40c1-9bfb-fa8c46560d29 service neutron] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:36:22.862809 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-763cdbcd-d7f4-40c1-9bfb-fa8c46560d29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:36:22.864672 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-763cdbcd-d7f4-40c1-9bfb-fa8c46560d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:36:22.924658 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cdbcd-d7f4-40c1-9bfb-fa8c46560d29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:36:22.926129 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-763cdbcd-d7f4-40c1-9bfb-fa8c46560d29 service neutron] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:36:22.936302 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1479/2911] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:36:22 2022] GET /identity/v3/auth/tokens => generated 3229 bytes in 133 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:36:25.909717 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:36:25.911179 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:36:26.017724 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfba07f2-4ef8-47aa-9471-9d74f7c5db2e admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:36:26.031549 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffea2a-5c68-4592-9363-3ff98f4308b8 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab4efe6f79d4b3ca5618c089c5f3d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:36:26.032351 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffea2a-5c68-4592-9363-3ff98f4308b8 service placement] REQUEST_METHOD: `GET` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:36:26.032733 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffea2a-5c68-4592-9363-3ff98f4308b8 service placement] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:36:26.033265 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0ffea2a-5c68-4592-9363-3ff98f4308b8 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:36:26.035121 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-c0ffea2a-5c68-4592-9363-3ff98f4308b8 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:36:26.048936 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffea2a-5c68-4592-9363-3ff98f4308b8 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:36:26.050859 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0ffea2a-5c68-4592-9363-3ff98f4308b8 service placement] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:36:26.064937 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1433/2912] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:36:25 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:36:28.769978 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cdbcd-d7f4-40c1-9bfb-fa8c46560d29 service neutron] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:36:28.772187 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-763cdbcd-d7f4-40c1-9bfb-fa8c46560d29 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:36:28.786032 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-763cdbcd-d7f4-40c1-9bfb-fa8c46560d29 service neutron] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:36:28.790800 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a85a7-31f2-4b0a-955b-c1178d692af7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:36:28.791684 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a85a7-31f2-4b0a-955b-c1178d692af7 admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:36:28.792130 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a85a7-31f2-4b0a-955b-c1178d692af7 admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:36:28.792244 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c6a85a7-31f2-4b0a-955b-c1178d692af7 admin admin] PATH_INFO: `/v3/users/c9ea995f9000416ebe923ebb5b171189` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:36:28.795175 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a85a7-31f2-4b0a-955b-c1178d692af7 admin admin] RBAC: Authorizing `identity:delete_user(user_id=c9ea995f9000416ebe923ebb5b171189)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:36:28.795464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0c6a85a7-31f2-4b0a-955b-c1178d692af7 admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:36:28.841340 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c6a85a7-31f2-4b0a-955b-c1178d692af7 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'c9ea995f9000416ebe923ebb5b171189'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:28.841986 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c6a85a7-31f2-4b0a-955b-c1178d692af7 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'c9ea995f9000416ebe923ebb5b171189'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:28.848756 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c6a85a7-31f2-4b0a-955b-c1178d692af7 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'c9ea995f9000416ebe923ebb5b171189'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:28.849464 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c6a85a7-31f2-4b0a-955b-c1178d692af7 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'c9ea995f9000416ebe923ebb5b171189'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:28.861648 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-0c6a85a7-31f2-4b0a-955b-c1178d692af7 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'c9ea995f9000416ebe923ebb5b171189'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:28.874152 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1480/2913] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:36:28 2022] DELETE /identity/v3/users/c9ea995f9000416ebe923ebb5b171189 => generated 0 bytes in 105 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:36:29.048458 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffea2a-5c68-4592-9363-3ff98f4308b8 service placement] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:36:29.060501 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0ffea2a-5c68-4592-9363-3ff98f4308b8 service placement] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:36:29.118151 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:36:29.118999 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:36:29.119278 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:36:29.119553 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] PATH_INFO: `/v3/projects/4e3c79f07f9f4882b4df96c9b342c60c` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:36:29.120697 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] RBAC: Authorizing `identity:delete_project(project_id=4e3c79f07f9f4882b4df96c9b342c60c)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:36:29.122627 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:36:29.167919 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '4e3c79f07f9f4882b4df96c9b342c60c', 'request_id': 'req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.174965 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '4e3c79f07f9f4882b4df96c9b342c60c', 'request_id': 'req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.180642 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '4e3c79f07f9f4882b4df96c9b342c60c', 'request_id': 'req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.191517 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] The token cache is being invalidate because project 4e3c79f07f9f4882b4df96c9b342c60c was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:36:29.191798 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.192432 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.194060 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1434/2914] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:36:29 2022] DELETE /identity/v3/projects/4e3c79f07f9f4882b4df96c9b342c60c => generated 0 bytes in 146 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:36:29.197997 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a85a7-31f2-4b0a-955b-c1178d692af7 admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:36:29.199424 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-0c6a85a7-31f2-4b0a-955b-c1178d692af7 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:36:29.212709 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c6a85a7-31f2-4b0a-955b-c1178d692af7 admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:36:29.230972 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:36:29.274747 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdae11-0076-46b5-b87b-a03015e74aeb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:36:29.275628 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdae11-0076-46b5-b87b-a03015e74aeb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:36:29.275914 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdae11-0076-46b5-b87b-a03015e74aeb admin admin] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:36:29.276192 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebdae11-0076-46b5-b87b-a03015e74aeb admin admin] PATH_INFO: `/v3/users/5957f80f6aae4d059face3c811c1202e` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:36:29.277407 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdae11-0076-46b5-b87b-a03015e74aeb admin admin] RBAC: Authorizing `identity:delete_user(user_id=5957f80f6aae4d059face3c811c1202e)` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:36:29.279320 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebdae11-0076-46b5-b87b-a03015e74aeb admin admin] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:36:29.325618 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9ebdae11-0076-46b5-b87b-a03015e74aeb admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '5957f80f6aae4d059face3c811c1202e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.326199 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9ebdae11-0076-46b5-b87b-a03015e74aeb admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '5957f80f6aae4d059face3c811c1202e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.333048 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9ebdae11-0076-46b5-b87b-a03015e74aeb admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '5957f80f6aae4d059face3c811c1202e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.334285 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9ebdae11-0076-46b5-b87b-a03015e74aeb admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '5957f80f6aae4d059face3c811c1202e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.346496 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.notifications [None req-9ebdae11-0076-46b5-b87b-a03015e74aeb admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '5957f80f6aae4d059face3c811c1202e'} {{(pid=80231) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.361417 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1481/2915] 10.222.0.64 () {58 vars in 1223 bytes} [Thu May 26 18:36:29 2022] DELETE /identity/v3/users/5957f80f6aae4d059face3c811c1202e => generated 0 bytes in 164 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:36:29.530194 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] Authenticating user token {{(pid=80230) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:36:29.531619 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.fernet_utils [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80230) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:36:29.544763 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a53527-23d1-4c85-8c0e-71dd7ebd7c2d admin admin] Validating token access rules against request {{(pid=80230) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:36:29.562342 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:36:29.603910 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0383fbe-b513-479e-9577-49e729600edb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '99d73c7eb544437daee425e1da4f8bea', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '04b116e5fb9e430e9155c1db8872f881', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80230) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:36:29.604689 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0383fbe-b513-479e-9577-49e729600edb admin admin] REQUEST_METHOD: `DELETE` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:36:29.604968 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0383fbe-b513-479e-9577-49e729600edb admin admin] SCRIPT_NAME: `/identity` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:36:29.605268 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0383fbe-b513-479e-9577-49e729600edb admin admin] PATH_INFO: `/v3/projects/b3cc7af656244e4a8316605e4ac0f218` {{(pid=80230) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:36:29.606428 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0383fbe-b513-479e-9577-49e729600edb admin admin] RBAC: Authorizing `identity:delete_project(project_id=b3cc7af656244e4a8316605e4ac0f218)` {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:36:29.608319 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0383fbe-b513-479e-9577-49e729600edb admin admin] RBAC: Authorization granted {{(pid=80230) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:36:29.653374 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a0383fbe-b513-479e-9577-49e729600edb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'b3cc7af656244e4a8316605e4ac0f218', 'request_id': 'req-a0383fbe-b513-479e-9577-49e729600edb'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.660425 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a0383fbe-b513-479e-9577-49e729600edb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'b3cc7af656244e4a8316605e4ac0f218', 'request_id': 'req-a0383fbe-b513-479e-9577-49e729600edb'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.665834 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a0383fbe-b513-479e-9577-49e729600edb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'b3cc7af656244e4a8316605e4ac0f218', 'request_id': 'req-a0383fbe-b513-479e-9577-49e729600edb'} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.676703 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a0383fbe-b513-479e-9577-49e729600edb admin admin] The token cache is being invalidate because project b3cc7af656244e4a8316605e4ac0f218 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=80230) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} May 26 18:36:29.677004 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a0383fbe-b513-479e-9577-49e729600edb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.678170 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG keystone.notifications [None req-a0383fbe-b513-479e-9577-49e729600edb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=80230) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} May 26 18:36:29.679700 dv-cinder-843493-1-smb devstack@keystone.service[80230]: [pid: 80230|app: 0|req: 1435/2916] 10.222.0.64 () {58 vars in 1232 bytes} [Thu May 26 18:36:29 2022] DELETE /identity/v3/projects/b3cc7af656244e4a8316605e4ac0f218 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) May 26 18:36:39.357500 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=43,keystone:DELETE=10,keystone:INSERT=1 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:36:39.673672 dv-cinder-843493-1-smb devstack@keystone.service[80230]: DEBUG dbcounter [-] [80230] Writing DB stats keystone:SELECT=42,keystone:DELETE=7,keystone:INSERT=1 {{(pid=80230) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} May 26 18:40:43.756471 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdae11-0076-46b5-b87b-a03015e74aeb admin admin] Authenticating user token {{(pid=80231) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} May 26 18:40:43.757899 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-9ebdae11-0076-46b5-b87b-a03015e74aeb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:40:43.828039 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebdae11-0076-46b5-b87b-a03015e74aeb admin admin] Validating token access rules against request {{(pid=80231) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} May 26 18:40:43.885605 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0aef28e-f40e-4393-b002-5c6c50e28e9f service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '1ab4efe6f79d4b3ca5618c089c5f3d24', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ab7fe8d932964e7ab1f442f26ef0735b', 'project_domain_id': 'default', 'roles': ['reader', 'admin', 'member', 'service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=80231) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} May 26 18:40:43.886242 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef28e-f40e-4393-b002-5c6c50e28e9f service placement] REQUEST_METHOD: `GET` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} May 26 18:40:43.886522 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef28e-f40e-4393-b002-5c6c50e28e9f service placement] SCRIPT_NAME: `/identity` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} May 26 18:40:43.886797 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0aef28e-f40e-4393-b002-5c6c50e28e9f service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=80231) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} May 26 18:40:43.889098 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.fernet_utils [None req-b0aef28e-f40e-4393-b002-5c6c50e28e9f service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=80231) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} May 26 18:40:43.900307 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aef28e-f40e-4393-b002-5c6c50e28e9f service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} May 26 18:40:43.901915 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0aef28e-f40e-4393-b002-5c6c50e28e9f service placement] RBAC: Authorization granted {{(pid=80231) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} May 26 18:40:43.912371 dv-cinder-843493-1-smb devstack@keystone.service[80231]: [pid: 80231|app: 0|req: 1482/2917] 10.222.0.64 () {60 vars in 1365 bytes} [Thu May 26 18:40:43 2022] GET /identity/v3/auth/tokens => generated 3298 bytes in 156 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) May 26 18:40:53.908235 dv-cinder-843493-1-smb devstack@keystone.service[80231]: DEBUG dbcounter [-] [80231] Writing DB stats keystone:SELECT=58 {{(pid=80231) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}